FIT Profiler Report

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  Action                                                                                                                                                                                                     	|  Mean duration (s)	|  Num calls      	|  Total time (s) 	|  Percentage %   	|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  Total                                                                                                                                                                                                      	|  -              	|  881713         	|  661.55         	|  100 %          	|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  run_training_epoch                                                                                                                                                                                         	|  31.039         	|  20             	|  620.78         	|  93.837         	|
|  run_training_batch                                                                                                                                                                                         	|  0.023422       	|  20000          	|  468.45         	|  70.81          	|
|  [LightningModule]NeRFSystem.optimizer_step                                                                                                                                                                 	|  0.023174       	|  20000          	|  463.48         	|  70.06          	|
|  [Strategy]SingleDeviceStrategy.training_step                                                                                                                                                               	|  0.0089874      	|  20000          	|  179.75         	|  27.171         	|
|  [TrainingEpochLoop].train_dataloader_next                                                                                                                                                                  	|  0.0048787      	|  20000          	|  97.574         	|  14.749         	|
|  [Strategy]SingleDeviceStrategy.backward                                                                                                                                                                    	|  0.0017835      	|  20000          	|  35.67          	|  5.392          	|
|  [Strategy]SingleDeviceStrategy.validation_step                                                                                                                                                             	|  0.39242        	|  78             	|  30.609         	|  4.6268         	|
|  [LightningModule]NeRFSystem.setup                                                                                                                                                                          	|  26.519         	|  1              	|  26.519         	|  4.0087         	|
|  [Callback]TQDMProgressBar.on_train_batch_end                                                                                                                                                               	|  0.00047421     	|  20000          	|  9.4842         	|  1.4336         	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_epoch_end                 	|  0.21191        	|  20             	|  4.2382         	|  0.64064        	|
|  [Strategy]SingleDeviceStrategy.batch_to_device                                                                                                                                                             	|  0.00012138     	|  20078          	|  2.4371         	|  0.36839        	|
|  [LightningModule]NeRFSystem.transfer_batch_to_device                                                                                                                                                       	|  7.8305e-05     	|  20078          	|  1.5722         	|  0.23766        	|
|  [EvaluationEpochLoop].val_dataloader_idx_0_next                                                                                                                                                            	|  0.0064148      	|  78             	|  0.50035        	|  0.075634       	|
|  [LightningModule]NeRFSystem.optimizer_zero_grad                                                                                                                                                            	|  1.8786e-05     	|  20000          	|  0.37572        	|  0.056795       	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_batch_end                 	|  1.4897e-05     	|  20000          	|  0.29794        	|  0.045036       	|
|  [LightningModule]NeRFSystem.configure_gradient_clipping                                                                                                                                                    	|  1.3552e-05     	|  20000          	|  0.27105        	|  0.040972       	|
|  [Callback]GradientAccumulationScheduler.on_train_batch_end                                                                                                                                                 	|  4.6351e-06     	|  20000          	|  0.092702       	|  0.014013       	|
|  [Callback]TQDMProgressBar.on_after_backward                                                                                                                                                                	|  3.2173e-06     	|  20000          	|  0.064345       	|  0.0097265      	|
|  [Callback]TQDMProgressBar.on_batch_start                                                                                                                                                                   	|  3.1108e-06     	|  20000          	|  0.062216       	|  0.0094046      	|
|  [Callback]TQDMProgressBar.on_before_optimizer_step                                                                                                                                                         	|  3.0789e-06     	|  20000          	|  0.061578       	|  0.0093081      	|
|  [LightningModule]NeRFSystem.on_validation_start                                                                                                                                                            	|  0.02832        	|  2              	|  0.05664        	|  0.0085617      	|
|  [Callback]TQDMProgressBar.on_before_zero_grad                                                                                                                                                              	|  2.8199e-06     	|  20000          	|  0.056398       	|  0.0085251      	|
|  [Callback]TQDMProgressBar.on_before_backward                                                                                                                                                               	|  2.6253e-06     	|  20000          	|  0.052505       	|  0.0079368      	|
|  [Callback]TQDMProgressBar.on_train_batch_start                                                                                                                                                             	|  2.6075e-06     	|  20000          	|  0.05215        	|  0.007883       	|
|  [Callback]GradientAccumulationScheduler.on_batch_start                                                                                                                                                     	|  2.4781e-06     	|  20000          	|  0.049562       	|  0.0074919      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_batch_start                     	|  2.3816e-06     	|  20000          	|  0.047631       	|  0.0072         	|
|  [Callback]TQDMProgressBar.on_batch_end                                                                                                                                                                     	|  2.3231e-06     	|  20000          	|  0.046462       	|  0.0070232      	|
|  [Callback]GradientAccumulationScheduler.on_train_batch_start                                                                                                                                               	|  2.2575e-06     	|  20000          	|  0.04515        	|  0.0068249      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_batch_start               	|  2.2571e-06     	|  20000          	|  0.045143       	|  0.0068238      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_batch_end                       	|  2.1412e-06     	|  20000          	|  0.042824       	|  0.0064734      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_after_backward                  	|  2.1255e-06     	|  20000          	|  0.042511       	|  0.0064259      	|
|  [Callback]GradientAccumulationScheduler.on_before_optimizer_step                                                                                                                                           	|  2.0912e-06     	|  20000          	|  0.041823       	|  0.006322       	|
|  [Callback]GradientAccumulationScheduler.on_after_backward                                                                                                                                                  	|  2.0789e-06     	|  20000          	|  0.041578       	|  0.0062849      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_optimizer_step           	|  2.0478e-06     	|  20000          	|  0.040957       	|  0.0061911      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_zero_grad                	|  2.0226e-06     	|  20000          	|  0.040451       	|  0.0061146      	|
|  [Callback]GradientAccumulationScheduler.on_batch_end                                                                                                                                                       	|  2.0184e-06     	|  20000          	|  0.040368       	|  0.0061021      	|
|  [Callback]GradientAccumulationScheduler.on_before_zero_grad                                                                                                                                                	|  2.0104e-06     	|  20000          	|  0.040207       	|  0.0060778      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_backward                 	|  1.9753e-06     	|  20000          	|  0.039506       	|  0.0059718      	|
|  [Callback]GradientAccumulationScheduler.on_before_backward                                                                                                                                                 	|  1.9693e-06     	|  20000          	|  0.039387       	|  0.0059537      	|
|  [Callback]TQDMProgressBar.on_validation_batch_end                                                                                                                                                          	|  0.00044919     	|  78             	|  0.035037       	|  0.0052961      	|
|  [LightningModule]NeRFSystem.on_before_batch_transfer                                                                                                                                                       	|  1.1876e-06     	|  20078          	|  0.023844       	|  0.0036043      	|
|  [LightningModule]NeRFSystem.on_train_batch_end                                                                                                                                                             	|  1.1008e-06     	|  20000          	|  0.022016       	|  0.003328       	|
|  [LightningModule]NeRFSystem.training_step_end                                                                                                                                                              	|  1.0917e-06     	|  20000          	|  0.021835       	|  0.0033005      	|
|  [LightningModule]NeRFSystem.on_after_batch_transfer                                                                                                                                                        	|  1.0852e-06     	|  20078          	|  0.021788       	|  0.0032936      	|
|  [Strategy]SingleDeviceStrategy.training_step_end                                                                                                                                                           	|  9.9406e-07     	|  20000          	|  0.019881       	|  0.0030052      	|
|  [LightningModule]NeRFSystem.on_before_backward                                                                                                                                                             	|  8.7689e-07     	|  20000          	|  0.017538       	|  0.002651       	|
|  [LightningModule]NeRFSystem.on_train_batch_start                                                                                                                                                           	|  8.7364e-07     	|  20000          	|  0.017473       	|  0.0026412      	|
|  [Strategy]SingleDeviceStrategy.on_train_batch_start                                                                                                                                                        	|  8.677e-07      	|  20000          	|  0.017354       	|  0.0026232      	|
|  [LightningModule]NeRFSystem.on_before_optimizer_step                                                                                                                                                       	|  8.4643e-07     	|  20000          	|  0.016929       	|  0.0025589      	|
|  [LightningModule]NeRFSystem.on_after_backward                                                                                                                                                              	|  8.1475e-07     	|  20000          	|  0.016295       	|  0.0024632      	|
|  [LightningModule]NeRFSystem.on_before_zero_grad                                                                                                                                                            	|  7.7557e-07     	|  20000          	|  0.015511       	|  0.0023447      	|
|  [LightningModule]NeRFSystem.validation_epoch_end                                                                                                                                                           	|  0.0045138      	|  2              	|  0.0090277      	|  0.0013646      	|
|  [Callback]TQDMProgressBar.on_train_epoch_end                                                                                                                                                               	|  0.00023267     	|  20             	|  0.0046534      	|  0.00070341     	|
|  [Callback]TQDMProgressBar.on_train_epoch_start                                                                                                                                                             	|  0.00021553     	|  20             	|  0.0043105      	|  0.00065158     	|
|  [LightningModule]NeRFSystem.configure_optimizers                                                                                                                                                           	|  0.0029118      	|  1              	|  0.0029118      	|  0.00044014     	|
|  [Callback]TQDMProgressBar.on_validation_batch_start                                                                                                                                                        	|  3.6161e-05     	|  78             	|  0.0028205      	|  0.00042635     	|
|  [LightningModule]NeRFSystem.lr_scheduler_step                                                                                                                                                              	|  9.7865e-05     	|  20             	|  0.0019573      	|  0.00029587     	|
|  [Callback]TQDMProgressBar.on_validation_end                                                                                                                                                                	|  0.000836       	|  2              	|  0.001672       	|  0.00025274     	|
|  [LightningModule]NeRFSystem.on_validation_model_eval                                                                                                                                                       	|  0.00080075     	|  2              	|  0.0016015      	|  0.00024208     	|
|  [LightningModule]NeRFSystem.on_validation_model_train                                                                                                                                                      	|  0.00041864     	|  2              	|  0.00083728     	|  0.00012656     	|
|  [Callback]TQDMProgressBar.on_validation_start                                                                                                                                                              	|  0.00037318     	|  2              	|  0.00074636     	|  0.00011282     	|
|  [LightningModule]NeRFSystem.train_dataloader                                                                                                                                                               	|  0.00058294     	|  1              	|  0.00058294     	|  8.8117e-05     	|
|  [Callback]GradientAccumulationScheduler.on_validation_batch_end                                                                                                                                            	|  7.0318e-06     	|  78             	|  0.00054848     	|  8.2908e-05     	|
|  [Callback]GradientAccumulationScheduler.on_validation_batch_start                                                                                                                                          	|  3.719e-06      	|  78             	|  0.00029009     	|  4.385e-05      	|
|  [Callback]TQDMProgressBar.on_train_start                                                                                                                                                                   	|  0.00028253     	|  1              	|  0.00028253     	|  4.2707e-05     	|
|  [LightningModule]NeRFSystem.val_dataloader                                                                                                                                                                 	|  0.00028124     	|  1              	|  0.00028124     	|  4.2512e-05     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_batch_end            	|  3.5106e-06     	|  78             	|  0.00027382     	|  4.1392e-05     	|
|  [Callback]TQDMProgressBar.on_train_end                                                                                                                                                                     	|  0.00024085     	|  1              	|  0.00024085     	|  3.6407e-05     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_batch_start          	|  3.0275e-06     	|  78             	|  0.00023615     	|  3.5696e-05     	|
|  [LightningModule]NeRFSystem.validation_step_end                                                                                                                                                            	|  2.8181e-06     	|  78             	|  0.00021981     	|  3.3227e-05     	|
|  [LightningModule]NeRFSystem.on_validation_batch_end                                                                                                                                                        	|  1.6886e-06     	|  78             	|  0.00013171     	|  1.9909e-05     	|
|  [LightningModule]NeRFSystem.on_validation_batch_start                                                                                                                                                      	|  1.5788e-06     	|  78             	|  0.00012315     	|  1.8615e-05     	|
|  [Callback]GradientAccumulationScheduler.on_train_epoch_start                                                                                                                                               	|  5.8256e-06     	|  20             	|  0.00011651     	|  1.7612e-05     	|
|  [Strategy]SingleDeviceStrategy.validation_step_end                                                                                                                                                         	|  1.324e-06      	|  78             	|  0.00010327     	|  1.561e-05      	|
|  [Callback]GradientAccumulationScheduler.on_train_epoch_end                                                                                                                                                 	|  4.682e-06      	|  20             	|  9.3641e-05     	|  1.4155e-05     	|
|  [Callback]TQDMProgressBar.on_epoch_end                                                                                                                                                                     	|  3.6713e-06     	|  22             	|  8.0769e-05     	|  1.2209e-05     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_epoch_start               	|  3.7241e-06     	|  20             	|  7.4482e-05     	|  1.1259e-05     	|
|  [Callback]TQDMProgressBar.on_epoch_start                                                                                                                                                                   	|  3.2224e-06     	|  22             	|  7.0892e-05     	|  1.0716e-05     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_end                  	|  3.319e-05      	|  2              	|  6.6381e-05     	|  1.0034e-05     	|
|  [Callback]GradientAccumulationScheduler.on_epoch_end                                                                                                                                                       	|  2.9017e-06     	|  22             	|  6.3837e-05     	|  9.6496e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_epoch_end                       	|  2.1153e-06     	|  22             	|  4.6536e-05     	|  7.0345e-06     	|
|  [Callback]GradientAccumulationScheduler.on_epoch_start                                                                                                                                                     	|  1.9835e-06     	|  22             	|  4.3638e-05     	|  6.5964e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_epoch_start                     	|  1.9588e-06     	|  22             	|  4.3093e-05     	|  6.514e-06      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.setup                              	|  3.6539e-05     	|  1              	|  3.6539e-05     	|  5.5232e-06     	|
|  [LightningModule]NeRFSystem.on_epoch_start                                                                                                                                                                 	|  1.3772e-06     	|  22             	|  3.0298e-05     	|  4.5798e-06     	|
|  [LightningModule]NeRFSystem.on_train_epoch_end                                                                                                                                                             	|  1.4313e-06     	|  20             	|  2.8627e-05     	|  4.3273e-06     	|
|  [LightningModule]NeRFSystem.on_epoch_end                                                                                                                                                                   	|  1.246e-06      	|  22             	|  2.7413e-05     	|  4.1437e-06     	|
|  [LightningModule]NeRFSystem.on_train_epoch_start                                                                                                                                                           	|  1.3596e-06     	|  20             	|  2.7192e-05     	|  4.1103e-06     	|
|  [Callback]GradientAccumulationScheduler.on_validation_start                                                                                                                                                	|  8.7754e-06     	|  2              	|  1.7551e-05     	|  2.653e-06      	|
|  [Callback]TQDMProgressBar.on_validation_epoch_end                                                                                                                                                          	|  5.6652e-06     	|  2              	|  1.133e-05      	|  1.7127e-06     	|
|  [Callback]GradientAccumulationScheduler.on_validation_end                                                                                                                                                  	|  5.2853e-06     	|  2              	|  1.0571e-05     	|  1.5978e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_start                	|  5.1954e-06     	|  2              	|  1.0391e-05     	|  1.5707e-06     	|
|  [Callback]TQDMProgressBar.on_before_accelerator_backend_setup                                                                                                                                              	|  9.6597e-06     	|  1              	|  9.6597e-06     	|  1.4602e-06     	|
|  [LightningModule]NeRFSystem.on_validation_epoch_end                                                                                                                                                        	|  4.2296e-06     	|  2              	|  8.4592e-06     	|  1.2787e-06     	|
|  [Strategy]SingleDeviceStrategy.on_validation_end                                                                                                                                                           	|  3.8999e-06     	|  2              	|  7.7998e-06     	|  1.179e-06      	|
|  [Callback]TQDMProgressBar.setup                                                                                                                                                                            	|  7.2494e-06     	|  1              	|  7.2494e-06     	|  1.0958e-06     	|
|  [LightningModule]NeRFSystem.configure_callbacks                                                                                                                                                            	|  7.0687e-06     	|  1              	|  7.0687e-06     	|  1.0685e-06     	|
|  [Callback]TQDMProgressBar.on_validation_epoch_start                                                                                                                                                        	|  3.5204e-06     	|  2              	|  7.0408e-06     	|  1.0643e-06     	|
|  [Callback]GradientAccumulationScheduler.on_validation_epoch_end                                                                                                                                            	|  3.505e-06      	|  2              	|  7.0101e-06     	|  1.0596e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_epoch_end            	|  3.295e-06      	|  2              	|  6.59e-06       	|  9.9615e-07     	|
|  [LightningModule]NeRFSystem.on_train_end                                                                                                                                                                   	|  5.8906e-06     	|  1              	|  5.8906e-06     	|  8.9043e-07     	|
|  [Callback]TQDMProgressBar.on_fit_end                                                                                                                                                                       	|  5.3998e-06     	|  1              	|  5.3998e-06     	|  8.1624e-07     	|
|  [Strategy]SingleDeviceStrategy.on_validation_start                                                                                                                                                         	|  2.6701e-06     	|  2              	|  5.3402e-06     	|  8.0723e-07     	|
|  [Callback]TQDMProgressBar.on_pretrain_routine_start                                                                                                                                                        	|  5.3197e-06     	|  1              	|  5.3197e-06     	|  8.0413e-07     	|
|  [Callback]GradientAccumulationScheduler.on_validation_epoch_start                                                                                                                                          	|  2.5751e-06     	|  2              	|  5.1502e-06     	|  7.7851e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_epoch_start          	|  2.4699e-06     	|  2              	|  4.9397e-06     	|  7.4669e-07     	|
|  [Callback]GradientAccumulationScheduler.on_train_start                                                                                                                                                     	|  4.61e-06       	|  1              	|  4.61e-06       	|  6.9686e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_start                     	|  4.5402e-06     	|  1              	|  4.5402e-06     	|  6.863e-07      	|
|  [LightningModule]NeRFSystem.on_validation_epoch_start                                                                                                                                                      	|  2.1197e-06     	|  2              	|  4.2394e-06     	|  6.4083e-07     	|
|  [Callback]GradientAccumulationScheduler.on_train_end                                                                                                                                                       	|  4.19e-06       	|  1              	|  4.19e-06       	|  6.3337e-07     	|
|  [LightningModule]NeRFSystem.configure_sharded_model                                                                                                                                                        	|  4.1202e-06     	|  1              	|  4.1202e-06     	|  6.2281e-07     	|
|  [Callback]TQDMProgressBar.on_fit_start                                                                                                                                                                     	|  4e-06          	|  1              	|  4e-06          	|  6.0465e-07     	|
|  [Callback]TQDMProgressBar.on_pretrain_routine_end                                                                                                                                                          	|  3.8305e-06     	|  1              	|  3.8305e-06     	|  5.7903e-07     	|
|  [Callback]TQDMProgressBar.on_configure_sharded_model                                                                                                                                                       	|  3.2298e-06     	|  1              	|  3.2298e-06     	|  4.8822e-07     	|
|  [Callback]GradientAccumulationScheduler.setup                                                                                                                                                              	|  3.1702e-06     	|  1              	|  3.1702e-06     	|  4.7921e-07     	|
|  [Callback]TQDMProgressBar.teardown                                                                                                                                                                         	|  2.7195e-06     	|  1              	|  2.7195e-06     	|  4.1108e-07     	|
|  [Callback]GradientAccumulationScheduler.on_fit_start                                                                                                                                                       	|  2.4894e-06     	|  1              	|  2.4894e-06     	|  3.763e-07      	|
|  [Callback]GradientAccumulationScheduler.on_before_accelerator_backend_setup                                                                                                                                	|  2.3395e-06     	|  1              	|  2.3395e-06     	|  3.5364e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_end                       	|  2.3302e-06     	|  1              	|  2.3302e-06     	|  3.5223e-07     	|
|  [Callback]GradientAccumulationScheduler.on_fit_end                                                                                                                                                         	|  2.3209e-06     	|  1              	|  2.3209e-06     	|  3.5082e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_fit_start                       	|  2.3097e-06     	|  1              	|  2.3097e-06     	|  3.4913e-07     	|
|  [LightningModule]NeRFSystem.on_validation_end                                                                                                                                                              	|  1.1302e-06     	|  2              	|  2.2603e-06     	|  3.4167e-07     	|
|  [Callback]GradientAccumulationScheduler.on_pretrain_routine_start                                                                                                                                          	|  2.2501e-06     	|  1              	|  2.2501e-06     	|  3.4012e-07     	|
|  [LightningModule]NeRFSystem.on_fit_start                                                                                                                                                                   	|  2.1299e-06     	|  1              	|  2.1299e-06     	|  3.2196e-07     	|
|  [Callback]GradientAccumulationScheduler.teardown                                                                                                                                                           	|  2.1001e-06     	|  1              	|  2.1001e-06     	|  3.1746e-07     	|
|  [Callback]GradientAccumulationScheduler.on_configure_sharded_model                                                                                                                                         	|  2.0806e-06     	|  1              	|  2.0806e-06     	|  3.145e-07      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_configure_sharded_model         	|  2.0796e-06     	|  1              	|  2.0796e-06     	|  3.1436e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_pretrain_routine_start          	|  2.0601e-06     	|  1              	|  2.0601e-06     	|  3.114e-07      	|
|  [LightningModule]NeRFSystem.on_pretrain_routine_start                                                                                                                                                      	|  2.0592e-06     	|  1              	|  2.0592e-06     	|  3.1126e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_fit_end                         	|  2.0303e-06     	|  1              	|  2.0303e-06     	|  3.069e-07      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_accelerator_backend_setup	|  2.0005e-06     	|  1              	|  2.0005e-06     	|  3.0239e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.teardown                           	|  1.9604e-06     	|  1              	|  1.9604e-06     	|  2.9634e-07     	|
|  [Callback]GradientAccumulationScheduler.on_pretrain_routine_end                                                                                                                                            	|  1.9297e-06     	|  1              	|  1.9297e-06     	|  2.9169e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_pretrain_routine_end            	|  1.8701e-06     	|  1              	|  1.8701e-06     	|  2.8268e-07     	|
|  [LightningModule]NeRFSystem.prepare_data                                                                                                                                                                   	|  1.8105e-06     	|  1              	|  1.8105e-06     	|  2.7368e-07     	|
|  [LightningModule]NeRFSystem.teardown                                                                                                                                                                       	|  1.5702e-06     	|  1              	|  1.5702e-06     	|  2.3735e-07     	|
|  [LightningModule]NeRFSystem.on_save_checkpoint                                                                                                                                                             	|  1.4901e-06     	|  1              	|  1.4901e-06     	|  2.2525e-07     	|
|  [LightningModule]NeRFSystem.on_fit_end                                                                                                                                                                     	|  1.4203e-06     	|  1              	|  1.4203e-06     	|  2.1469e-07     	|
|  [LightningModule]NeRFSystem.on_train_start                                                                                                                                                                 	|  1.2098e-06     	|  1              	|  1.2098e-06     	|  1.8287e-07     	|
|  [Strategy]SingleDeviceStrategy.on_train_start                                                                                                                                                              	|  1.1502e-06     	|  1              	|  1.1502e-06     	|  1.7386e-07     	|
|  [LightningModule]NeRFSystem.on_pretrain_routine_end                                                                                                                                                        	|  1.0598e-06     	|  1              	|  1.0598e-06     	|  1.6021e-07     	|
|  [Strategy]SingleDeviceStrategy.on_train_end                                                                                                                                                                	|  1.0105e-06     	|  1              	|  1.0105e-06     	|  1.5275e-07     	|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
