Project

General

Profile

Actions
Copy link

Task #60879

open

Task #49925: WP 6: first level trigger (FLT)

Task #49928: WP 6.3: testbench

Task #51438: test bench pour DL: CNN

CNN with template dataset

Added by Colley Jean-Marc 6 months ago. Updated about 2 months ago.

Status:
In progress
Priority:
Normal
Assigned To:
Colley Jean-Marc
Category:
-
Start date:
05/19/2024
Due date:
% Done:

80%

Estimated time:
Remaining (hours)

Description

with template dataset, available at CCIN2P3

/sps/grand/pcorrea/nutrig/database/bkg/bkg_dataset_nutrig_gp13_train_seed_300.npz
/sps/grand/pcorrea/nutrig/database/bkg/bkg_dataset_nutrig_gp13_test_seed_300.npz
/sps/grand/pcorrea/nutrig/database/sig/sig_dataset_nutrig_gp13_train_seed_300.npz
/sps/grand/pcorrea/nutrig/database/sig/sig_dataset_nutrig_gp13_test_seed_300.npz

Files

Download all files
CNN_2_layer_loss_template_wpp_2l_xy_19600.png (59.9 KB) CNN_2_layer_loss_template_wpp_2l_xy_19600.png Colley Jean-Marc, 05/19/2024 04:35 PM
CNN_2_layer_accuracy_template_wpp_2l_xy_19600.png (45.3 KB) CNN_2_layer_accuracy_template_wpp_2l_xy_19600.png Colley Jean-Marc, 05/19/2024 04:35 PM
CNN_2_layer_loss_template_wpp_2l_20000.png (46.9 KB) CNN_2_layer_loss_template_wpp_2l_20000.png Colley Jean-Marc, 05/19/2024 04:38 PM
CNN_2_layer_accuracy_template_wpp_2l_20000.png (42.4 KB) CNN_2_layer_accuracy_template_wpp_2l_20000.png Colley Jean-Marc, 05/19/2024 04:38 PM
bkg_proba_cnn_nutrig_gp13_test_seed_300.npy (39.2 KB) bkg_proba_cnn_nutrig_gp13_test_seed_300.npy Colley Jean-Marc, 05/19/2024 04:46 PM
sig_proba_cnn_nutrig_gp13_test_seed_300.npy (39.2 KB) sig_proba_cnn_nutrig_gp13_test_seed_300.npy Colley Jean-Marc, 05/19/2024 04:46 PM
cnn_dist_template.png (37.6 KB) cnn_dist_template.png Colley Jean-Marc, 05/19/2024 10:19 PM
cnn_seprability_versus_snr_threashold_for_ds_template.png (36.9 KB) cnn_seprability_versus_snr_threashold_for_ds_template.png Colley Jean-Marc, 05/21/2024 09:31 AM
dataset_template_test_versus_snr.png (48.5 KB) dataset_template_test_versus_snr.png Colley Jean-Marc, 05/21/2024 10:11 AM
Actions
Copy link
 #1

Updated by Colley Jean-Marc 6 months ago

CNN with only axis X and Y

Conclusion: no convergence with only the X and Y. the addition of the Z axis is essential

Actions
Copy link
 #2

Updated by Colley Jean-Marc 6 months ago

CNN training with 3 axis

Conclusion:

  • Convergence is struggling to begin, 30 iterations without progress
  • from iteration 40 the convergence is very slow
  • 150 itérations take 10mn with 4 CPU on my laptop
  • try to add iteration at CCIN2P3 with GPU
Actions
Copy link
 #3

Updated by Colley Jean-Marc 6 months ago

CNN test

Create files with probabilty

With test files:
  • bkg_dataset_nutrig_gp13_test_seed_300.npz
  • sig_dataset_nutrig_gp13_test_seed_300.npz

with same index order

Time for inference

Inference CPU time= 1.52 s, for 10000 traces on laptop 4 CPUs

Actions
Copy link
 #4

Updated by Colley Jean-Marc 6 months ago

  • File flt_cnn_dataset_template.png added

Plot distribution of CNN proba for signal/background

Separability index

index_sep= 0.50

To compare with the ICRC dataset: 0.87

with définition

https://github.com/grand-mother/NUTRIG1/blob/7efde4e45f8d00259e0f93e66022efc00a2a24a3/src/nutrig/eval/cnn_ref.py#L136

Fix bug separability index: now surface intersection is really computed

Actions
Copy link
 #5

Updated by Colley Jean-Marc 6 months ago

  • File deleted (flt_cnn_dataset_template.png)
Actions
Copy link
 #8

Updated by Colley Jean-Marc 6 months ago

  • File deleted (Figure_1.png)
Actions
Copy link
 #9

Updated by Colley Jean-Marc 6 months ago

Plot separability index versus SNR threshold

Actions
Copy link
 #10

Updated by Colley Jean-Marc about 2 months ago

  • % Done changed from 0 to 80
Actions
Copy link

Also available in: Atom PDF