FIT Profiler Report

--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  Action                                                                                                                                                         	|  Mean duration (s)	|  Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  Total                                                                                                                                                          	|  -              	|  30303          	|  149.7          	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  run_training_epoch                                                                                                                                             	|  139.41         	|  1              	|  139.41         	|  93.123         	|
|  run_training_batch                                                                                                                                             	|  0.096438       	|  1000           	|  96.438         	|  64.421         	|
|  [LightningModule]NeRFSystem.optimizer_step                                                                                                                     	|  0.096301       	|  1000           	|  96.301         	|  64.329         	|
|  [Strategy]SingleDeviceStrategy.training_step                                                                                                                   	|  0.024718       	|  1000           	|  24.718         	|  16.511         	|
|  [Strategy]SingleDeviceStrategy.validation_step                                                                                                                 	|  1.0151         	|  21             	|  21.317         	|  14.24          	|
|  [_TrainingEpochLoop].train_dataloader_next                                                                                                                     	|  0.019584       	|  1000           	|  19.584         	|  13.082         	|
|  [LightningModule]NeRFSystem.setup                                                                                                                              	|  4.4621         	|  1              	|  4.4621         	|  2.9807         	|
|  [Strategy]SingleDeviceStrategy.backward                                                                                                                        	|  0.0032128      	|  1000           	|  3.2128         	|  2.1461         	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.on_train_epoch_end       	|  2.422          	|  1              	|  2.422          	|  1.6179         	|
|  [Callback]TQDMProgressBar.on_train_batch_end                                                                                                                   	|  0.00056577     	|  1000           	|  0.56577        	|  0.37793        	|
|  [Strategy]SingleDeviceStrategy.batch_to_device                                                                                                                 	|  0.00020997     	|  1021           	|  0.21438        	|  0.14321        	|
|  [_EvaluationLoop].val_next                                                                                                                                     	|  0.0083323      	|  21             	|  0.17498        	|  0.11689        	|
|  [LightningModule]NeRFSystem.transfer_batch_to_device                                                                                                           	|  0.00013748     	|  1021           	|  0.14037        	|  0.093766       	|
|  [LightningModule]NeRFSystem.on_validation_start                                                                                                                	|  0.042903       	|  1              	|  0.042903       	|  0.028659       	|
|  [LightningModule]NeRFSystem.configure_gradient_clipping                                                                                                        	|  2.3428e-05     	|  1000           	|  0.023428       	|  0.01565        	|
|  [LightningModule]NeRFSystem.optimizer_zero_grad                                                                                                                	|  2.3356e-05     	|  1000           	|  0.023356       	|  0.015602       	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.on_train_batch_end       	|  1.665e-05      	|  1000           	|  0.01665        	|  0.011122       	|
|  [Callback]TQDMProgressBar.on_validation_batch_end                                                                                                              	|  0.00028248     	|  21             	|  0.005932       	|  0.0039626      	|
|  [LightningModule]NeRFSystem.on_validation_epoch_end                                                                                                            	|  0.0051766      	|  1              	|  0.0051766      	|  0.003458       	|
|  [LightningModule]NeRFSystem.configure_optimizers                                                                                                               	|  0.0043031      	|  1              	|  0.0043031      	|  0.0028745      	|
|  [Callback]TQDMProgressBar.on_after_backward                                                                                                                    	|  3.7353e-06     	|  1000           	|  0.0037353      	|  0.0024952      	|
|  [Callback]TQDMProgressBar.on_before_optimizer_step                                                                                                             	|  2.9937e-06     	|  1000           	|  0.0029937      	|  0.0019998      	|
|  [Callback]TQDMProgressBar.on_before_zero_grad                                                                                                                  	|  2.6391e-06     	|  1000           	|  0.0026391      	|  0.0017629      	|
|  [LightningModule]NeRFSystem.on_before_batch_transfer                                                                                                           	|  2.2388e-06     	|  1021           	|  0.0022858      	|  0.0015269      	|
|  [Callback]TQDMProgressBar.on_train_batch_start                                                                                                                 	|  2.1429e-06     	|  1000           	|  0.0021429      	|  0.0014315      	|
|  [Callback]TQDMProgressBar.on_before_backward                                                                                                                   	|  2.1408e-06     	|  1000           	|  0.0021408      	|  0.00143        	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.on_before_zero_grad      	|  1.7138e-06     	|  1000           	|  0.0017138      	|  0.0011448      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.on_train_batch_start     	|  1.6736e-06     	|  1000           	|  0.0016736      	|  0.0011179      	|
|  [LightningModule]NeRFSystem.on_train_batch_start                                                                                                               	|  1.6032e-06     	|  1000           	|  0.0016032      	|  0.0010709      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.on_after_backward        	|  1.5045e-06     	|  1000           	|  0.0015045      	|  0.001005       	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.on_before_optimizer_step 	|  1.4601e-06     	|  1000           	|  0.0014601      	|  0.00097536     	|
|  [LightningModule]NeRFSystem.on_train_batch_end                                                                                                                 	|  1.4424e-06     	|  1000           	|  0.0014424      	|  0.00096356     	|
|  [LightningModule]NeRFSystem.on_before_zero_grad                                                                                                                	|  1.3682e-06     	|  1000           	|  0.0013682      	|  0.00091397     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.on_before_backward       	|  1.3313e-06     	|  1000           	|  0.0013313      	|  0.00088932     	|
|  [Callback]TQDMProgressBar.on_validation_batch_start                                                                                                            	|  6.3278e-05     	|  21             	|  0.0013288      	|  0.00088766     	|
|  [Strategy]SingleDeviceStrategy.on_train_batch_start                                                                                                            	|  1.2632e-06     	|  1000           	|  0.0012632      	|  0.00084385     	|
|  [LightningModule]NeRFSystem.on_after_batch_transfer                                                                                                            	|  1.2209e-06     	|  1021           	|  0.0012466      	|  0.00083272     	|
|  [LightningModule]NeRFSystem.on_after_backward                                                                                                                  	|  1.2412e-06     	|  1000           	|  0.0012412      	|  0.00082913     	|
|  [LightningModule]NeRFSystem.on_before_optimizer_step                                                                                                           	|  1.1828e-06     	|  1000           	|  0.0011828      	|  0.00079012     	|
|  [LightningModule]NeRFSystem.on_before_backward                                                                                                                 	|  1.1203e-06     	|  1000           	|  0.0011203      	|  0.00074833     	|
|  [LightningModule]NeRFSystem.on_validation_model_eval                                                                                                           	|  0.0010052      	|  1              	|  0.0010052      	|  0.00067149     	|
|  [Callback]TQDMProgressBar.on_validation_start                                                                                                                  	|  0.00089126     	|  1              	|  0.00089126     	|  0.00059536     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.setup                    	|  0.00062902     	|  1              	|  0.00062902     	|  0.00042019     	|
|  [LightningModule]NeRFSystem.on_validation_model_zero_grad                                                                                                      	|  0.00050903     	|  1              	|  0.00050903     	|  0.00034004     	|
|  [LightningModule]NeRFSystem.on_validation_model_train                                                                                                          	|  0.00046318     	|  1              	|  0.00046318     	|  0.00030941     	|
|  [Callback]TQDMProgressBar.on_train_end                                                                                                                         	|  0.00041894     	|  1              	|  0.00041894     	|  0.00027986     	|
|  [Callback]TQDMProgressBar.on_validation_end                                                                                                                    	|  0.00039739     	|  1              	|  0.00039739     	|  0.00026545     	|
|  [LightningModule]NeRFSystem.train_dataloader                                                                                                                   	|  0.00034323     	|  1              	|  0.00034323     	|  0.00022928     	|
|  [Callback]TQDMProgressBar.on_train_start                                                                                                                       	|  0.00031985     	|  1              	|  0.00031985     	|  0.00021366     	|
|  [Callback]TQDMProgressBar.on_train_epoch_start                                                                                                                 	|  0.00021757     	|  1              	|  0.00021757     	|  0.00014534     	|
|  [Callback]TQDMProgressBar.on_train_epoch_end                                                                                                                   	|  0.00018417     	|  1              	|  0.00018417     	|  0.00012302     	|
|  [LightningModule]NeRFSystem.val_dataloader                                                                                                                     	|  0.000181       	|  1              	|  0.000181       	|  0.00012091     	|
|  [LightningModule]NeRFSystem.lr_scheduler_step                                                                                                                  	|  8.1359e-05     	|  1              	|  8.1359e-05     	|  5.4348e-05     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.on_validation_batch_end  	|  2.9337e-06     	|  21             	|  6.1608e-05     	|  4.1155e-05     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.on_validation_batch_start	|  2.5442e-06     	|  21             	|  5.3428e-05     	|  3.569e-05      	|
|  [LightningModule]NeRFSystem.on_validation_batch_end                                                                                                            	|  1.9876e-06     	|  21             	|  4.1739e-05     	|  2.7882e-05     	|
|  [LightningModule]NeRFSystem.on_validation_batch_start                                                                                                          	|  1.5334e-06     	|  21             	|  3.2201e-05     	|  2.1511e-05     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.on_validation_end        	|  2.602e-05      	|  1              	|  2.602e-05      	|  1.7382e-05     	|
|  [Callback]TQDMProgressBar.setup                                                                                                                                	|  1.311e-05      	|  1              	|  1.311e-05      	|  8.7574e-06     	|
|  [Callback]TQDMProgressBar.on_fit_end                                                                                                                           	|  1.055e-05      	|  1              	|  1.055e-05      	|  7.0474e-06     	|
|  [LightningModule]NeRFSystem.configure_callbacks                                                                                                                	|  8.1002e-06     	|  1              	|  8.1002e-06     	|  5.4109e-06     	|
|  [Callback]TQDMProgressBar.teardown                                                                                                                             	|  7.4301e-06     	|  1              	|  7.4301e-06     	|  4.9633e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.on_validation_start      	|  6.0699e-06     	|  1              	|  6.0699e-06     	|  4.0547e-06     	|
|  [LightningModule]NeRFSystem.on_validation_end                                                                                                                  	|  5.6089e-06     	|  1              	|  5.6089e-06     	|  3.7468e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.on_train_epoch_start     	|  5.2396e-06     	|  1              	|  5.2396e-06     	|  3.5001e-06     	|
|  [Strategy]SingleDeviceStrategy.on_validation_start                                                                                                             	|  5.0901e-06     	|  1              	|  5.0901e-06     	|  3.4002e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.on_train_end             	|  4.5598e-06     	|  1              	|  4.5598e-06     	|  3.0459e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.on_train_start           	|  3.9404e-06     	|  1              	|  3.9404e-06     	|  2.6322e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.teardown                 	|  3.4398e-06     	|  1              	|  3.4398e-06     	|  2.2978e-06     	|
|  [LightningModule]NeRFSystem.prepare_data                                                                                                                       	|  3.3802e-06     	|  1              	|  3.3802e-06     	|  2.258e-06      	|
|  [LightningModule]NeRFSystem.teardown                                                                                                                           	|  3.35e-06       	|  1              	|  3.35e-06       	|  2.2378e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.on_fit_end               	|  3.2e-06        	|  1              	|  3.2e-06        	|  2.1376e-06     	|
|  [Callback]TQDMProgressBar.on_fit_start                                                                                                                         	|  3.0803e-06     	|  1              	|  3.0803e-06     	|  2.0577e-06     	|
|  [LightningModule]NeRFSystem.on_train_epoch_start                                                                                                               	|  3.0803e-06     	|  1              	|  3.0803e-06     	|  2.0577e-06     	|
|  [Callback]TQDMProgressBar.on_validation_epoch_end                                                                                                              	|  3.0398e-06     	|  1              	|  3.0398e-06     	|  2.0306e-06     	|
|  [LightningModule]NeRFSystem.on_fit_end                                                                                                                         	|  2.82e-06       	|  1              	|  2.82e-06       	|  1.8838e-06     	|
|  [LightningModule]NeRFSystem.on_train_end                                                                                                                       	|  2.7702e-06     	|  1              	|  2.7702e-06     	|  1.8505e-06     	|
|  [LightningModule]NeRFSystem.on_fit_start                                                                                                                       	|  2.4596e-06     	|  1              	|  2.4596e-06     	|  1.643e-06      	|
|  [Callback]TQDMProgressBar.on_validation_epoch_start                                                                                                            	|  2.3399e-06     	|  1              	|  2.3399e-06     	|  1.5631e-06     	|
|  [Strategy]SingleDeviceStrategy.on_validation_end                                                                                                               	|  2.1099e-06     	|  1              	|  2.1099e-06     	|  1.4094e-06     	|
|  [LightningModule]NeRFSystem.on_save_checkpoint                                                                                                                 	|  2e-06          	|  1              	|  2e-06          	|  1.336e-06      	|
|  [Strategy]SingleDeviceStrategy.on_train_end                                                                                                                    	|  1.8999e-06     	|  1              	|  1.8999e-06     	|  1.2691e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.on_validation_epoch_end  	|  1.8799e-06     	|  1              	|  1.8799e-06     	|  1.2558e-06     	|
|  [LightningModule]NeRFSystem.on_train_epoch_end                                                                                                                 	|  1.79e-06       	|  1              	|  1.79e-06       	|  1.1957e-06     	|
|  [Strategy]SingleDeviceStrategy.on_train_start                                                                                                                  	|  1.5004e-06     	|  1              	|  1.5004e-06     	|  1.0022e-06     	|
|  [LightningModule]NeRFSystem.on_train_start                                                                                                                     	|  1.4999e-06     	|  1              	|  1.4999e-06     	|  1.0019e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.on_fit_start             	|  1.4496e-06     	|  1              	|  1.4496e-06     	|  9.6834e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}.on_validation_epoch_start	|  1.41e-06       	|  1              	|  1.41e-06       	|  9.419e-07      	|
|  [LightningModule]NeRFSystem.on_validation_epoch_start                                                                                                          	|  9.2993e-07     	|  1              	|  9.2993e-07     	|  6.2119e-07     	|
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
FIT Profiler Report

--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  Action                                                                                                                                                          	|  Mean duration (s)	|  Num calls      	|  Total time (s) 	|  Percentage %   	|
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  Total                                                                                                                                                           	|  -              	|  600724         	|  1646.0         	|  100 %          	|
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  run_training_epoch                                                                                                                                              	|  81.745         	|  20             	|  1634.9         	|  99.323         	|
|  run_training_batch                                                                                                                                              	|  0.057047       	|  20000          	|  1140.9         	|  69.314         	|
|  [LightningModule]NeRFSystem.optimizer_step                                                                                                                      	|  0.056882       	|  20000          	|  1137.6         	|  69.113         	|
|  [_TrainingEpochLoop].train_dataloader_next                                                                                                                      	|  0.021411       	|  20000          	|  428.23         	|  26.015         	|
|  [Strategy]SingleDeviceStrategy.training_step                                                                                                                    	|  0.016084       	|  20000          	|  321.68         	|  19.543         	|
|  [Strategy]SingleDeviceStrategy.backward                                                                                                                         	|  0.0032384      	|  20000          	|  64.768         	|  3.9348         	|
|  [Strategy]SingleDeviceStrategy.validation_step                                                                                                                  	|  0.70016        	|  42             	|  29.407         	|  1.7865         	|
|  [Callback]TQDMProgressBar.on_train_batch_end                                                                                                                    	|  0.00065274     	|  20000          	|  13.055         	|  0.79311        	|
|  [LightningModule]NeRFSystem.setup                                                                                                                               	|  4.8931         	|  1              	|  4.8931         	|  0.29726        	|
|  [Strategy]SingleDeviceStrategy.batch_to_device                                                                                                                  	|  0.0002291      	|  20042          	|  4.5915         	|  0.27894        	|
|  [LightningModule]NeRFSystem.transfer_batch_to_device                                                                                                            	|  0.00015692     	|  20042          	|  3.145          	|  0.19107        	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.on_train_epoch_end       	|  0.13893        	|  20             	|  2.7787         	|  0.16881        	|
|  [LightningModule]NeRFSystem.optimizer_zero_grad                                                                                                                 	|  3.1063e-05     	|  20000          	|  0.62127        	|  0.037743       	|
|  [LightningModule]NeRFSystem.configure_gradient_clipping                                                                                                         	|  2.8534e-05     	|  20000          	|  0.57069        	|  0.03467        	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.on_train_batch_end       	|  1.8606e-05     	|  20000          	|  0.37212        	|  0.022607       	|
|  [_EvaluationLoop].val_next                                                                                                                                      	|  0.0047528      	|  42             	|  0.19962        	|  0.012127       	|
|  [LightningModule]NeRFSystem.on_before_batch_transfer                                                                                                            	|  5.7381e-06     	|  20042          	|  0.115          	|  0.0069866      	|
|  [Callback]TQDMProgressBar.on_before_optimizer_step                                                                                                              	|  4.9428e-06     	|  20000          	|  0.098856       	|  0.0060057      	|
|  [Callback]TQDMProgressBar.on_before_zero_grad                                                                                                                   	|  4.7131e-06     	|  20000          	|  0.094262       	|  0.0057266      	|
|  [Callback]TQDMProgressBar.on_after_backward                                                                                                                     	|  4.622e-06      	|  20000          	|  0.092439       	|  0.0056158      	|
|  [LightningModule]NeRFSystem.on_validation_start                                                                                                                 	|  0.045342       	|  2              	|  0.090684       	|  0.0055092      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.on_before_zero_grad      	|  2.9456e-06     	|  20000          	|  0.058912       	|  0.003579       	|
|  [Callback]TQDMProgressBar.on_train_batch_start                                                                                                                  	|  2.5273e-06     	|  20000          	|  0.050545       	|  0.0030707      	|
|  [Callback]TQDMProgressBar.on_before_backward                                                                                                                    	|  2.332e-06      	|  20000          	|  0.046641       	|  0.0028335      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.on_train_batch_start     	|  2.2665e-06     	|  20000          	|  0.045329       	|  0.0027538      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.on_before_optimizer_step 	|  2.1745e-06     	|  20000          	|  0.043491       	|  0.0026421      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.on_before_backward       	|  1.9462e-06     	|  20000          	|  0.038924       	|  0.0023647      	|
|  [LightningModule]NeRFSystem.on_train_batch_start                                                                                                                	|  1.7204e-06     	|  20000          	|  0.034408       	|  0.0020903      	|
|  [LightningModule]NeRFSystem.on_before_optimizer_step                                                                                                            	|  1.6811e-06     	|  20000          	|  0.033623       	|  0.0020426      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.on_after_backward        	|  1.5776e-06     	|  20000          	|  0.031552       	|  0.0019168      	|
|  [LightningModule]NeRFSystem.on_after_batch_transfer                                                                                                             	|  1.5689e-06     	|  20042          	|  0.031444       	|  0.0019103      	|
|  [Strategy]SingleDeviceStrategy.on_train_batch_start                                                                                                             	|  1.5628e-06     	|  20000          	|  0.031257       	|  0.0018989      	|
|  [LightningModule]NeRFSystem.on_after_backward                                                                                                                   	|  1.4738e-06     	|  20000          	|  0.029476       	|  0.0017907      	|
|  [LightningModule]NeRFSystem.on_train_batch_end                                                                                                                  	|  1.4396e-06     	|  20000          	|  0.028791       	|  0.0017491      	|
|  [LightningModule]NeRFSystem.on_before_zero_grad                                                                                                                 	|  1.4383e-06     	|  20000          	|  0.028766       	|  0.0017476      	|
|  [LightningModule]NeRFSystem.on_before_backward                                                                                                                  	|  1.3281e-06     	|  20000          	|  0.026562       	|  0.0016137      	|
|  [Callback]TQDMProgressBar.on_validation_batch_end                                                                                                               	|  0.00029948     	|  42             	|  0.012578       	|  0.00076415     	|
|  [LightningModule]NeRFSystem.on_validation_epoch_end                                                                                                             	|  0.0057134      	|  2              	|  0.011427       	|  0.00069419     	|
|  [LightningModule]NeRFSystem.configure_optimizers                                                                                                                	|  0.0051542      	|  1              	|  0.0051542      	|  0.00031312     	|
|  [Callback]TQDMProgressBar.on_train_epoch_start                                                                                                                  	|  0.00024215     	|  20             	|  0.004843       	|  0.00029422     	|
|  [Callback]TQDMProgressBar.on_train_epoch_end                                                                                                                    	|  0.00019874     	|  20             	|  0.0039747      	|  0.00024147     	|
|  [Callback]TQDMProgressBar.on_validation_start                                                                                                                   	|  0.0012959      	|  2              	|  0.0025918      	|  0.00015745     	|
|  [LightningModule]NeRFSystem.lr_scheduler_step                                                                                                                   	|  0.00010565     	|  20             	|  0.0021131      	|  0.00012837     	|
|  [LightningModule]NeRFSystem.on_validation_model_eval                                                                                                            	|  0.0010243      	|  2              	|  0.0020486      	|  0.00012446     	|
|  [Callback]TQDMProgressBar.on_validation_batch_start                                                                                                             	|  2.7944e-05     	|  42             	|  0.0011736      	|  7.1301e-05     	|
|  [LightningModule]NeRFSystem.on_validation_model_train                                                                                                           	|  0.00054757     	|  2              	|  0.0010951      	|  6.6531e-05     	|
|  [LightningModule]NeRFSystem.on_validation_model_zero_grad                                                                                                       	|  0.00050319     	|  2              	|  0.0010064      	|  6.114e-05      	|
|  [Callback]TQDMProgressBar.on_validation_end                                                                                                                     	|  0.00045181     	|  2              	|  0.00090363     	|  5.4897e-05     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.setup                    	|  0.00088636     	|  1              	|  0.00088636     	|  5.3848e-05     	|
|  [LightningModule]NeRFSystem.train_dataloader                                                                                                                    	|  0.00037456     	|  1              	|  0.00037456     	|  2.2755e-05     	|
|  [Callback]TQDMProgressBar.on_train_start                                                                                                                        	|  0.00036232     	|  1              	|  0.00036232     	|  2.2012e-05     	|
|  [Callback]TQDMProgressBar.on_train_end                                                                                                                          	|  0.0003281      	|  1              	|  0.0003281      	|  1.9933e-05     	|
|  [LightningModule]NeRFSystem.val_dataloader                                                                                                                      	|  0.00027937     	|  1              	|  0.00027937     	|  1.6972e-05     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.on_validation_batch_end  	|  3.3185e-06     	|  42             	|  0.00013938     	|  8.4675e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.on_validation_batch_start	|  2.7398e-06     	|  42             	|  0.00011507     	|  6.9907e-06     	|
|  [LightningModule]NeRFSystem.on_validation_batch_end                                                                                                             	|  2.1766e-06     	|  42             	|  9.1417e-05     	|  5.5537e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.on_validation_end        	|  3.7394e-05     	|  2              	|  7.4789e-05     	|  4.5436e-06     	|
|  [LightningModule]NeRFSystem.on_validation_batch_start                                                                                                           	|  1.6103e-06     	|  42             	|  6.7632e-05     	|  4.1087e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.on_train_epoch_start     	|  2.9719e-06     	|  20             	|  5.9437e-05     	|  3.6109e-06     	|
|  [LightningModule]NeRFSystem.on_train_epoch_start                                                                                                                	|  2.1235e-06     	|  20             	|  4.2471e-05     	|  2.5802e-06     	|
|  [LightningModule]NeRFSystem.on_train_epoch_end                                                                                                                  	|  1.8144e-06     	|  20             	|  3.6288e-05     	|  2.2045e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.on_validation_start      	|  5.98e-06       	|  2              	|  1.196e-05      	|  7.2659e-07     	|
|  [LightningModule]NeRFSystem.on_validation_end                                                                                                                   	|  5.8801e-06     	|  2              	|  1.176e-05      	|  7.1446e-07     	|
|  [Strategy]SingleDeviceStrategy.on_validation_start                                                                                                              	|  5.275e-06      	|  2              	|  1.055e-05      	|  6.4093e-07     	|
|  [LightningModule]NeRFSystem.configure_callbacks                                                                                                                 	|  9.479e-06      	|  1              	|  9.479e-06      	|  5.7586e-07     	|
|  [Callback]TQDMProgressBar.setup                                                                                                                                 	|  8.32e-06       	|  1              	|  8.32e-06       	|  5.0545e-07     	|
|  [Callback]TQDMProgressBar.on_fit_end                                                                                                                            	|  5.9204e-06     	|  1              	|  5.9204e-06     	|  3.5968e-07     	|
|  [Callback]TQDMProgressBar.teardown                                                                                                                              	|  5.6499e-06     	|  1              	|  5.6499e-06     	|  3.4324e-07     	|
|  [Callback]TQDMProgressBar.on_validation_epoch_end                                                                                                               	|  2.7597e-06     	|  2              	|  5.5195e-06     	|  3.3532e-07     	|
|  [Callback]TQDMProgressBar.on_validation_epoch_start                                                                                                             	|  2.5602e-06     	|  2              	|  5.1204e-06     	|  3.1107e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.on_train_start           	|  4.6901e-06     	|  1              	|  4.6901e-06     	|  2.8493e-07     	|
|  [LightningModule]NeRFSystem.prepare_data                                                                                                                        	|  4.4298e-06     	|  1              	|  4.4298e-06     	|  2.6912e-07     	|
|  [Callback]TQDMProgressBar.on_fit_start                                                                                                                          	|  4.1602e-06     	|  1              	|  4.1602e-06     	|  2.5274e-07     	|
|  [LightningModule]NeRFSystem.on_fit_start                                                                                                                        	|  3.9702e-06     	|  1              	|  3.9702e-06     	|  2.412e-07      	|
|  [Strategy]SingleDeviceStrategy.on_validation_end                                                                                                                	|  1.6899e-06     	|  2              	|  3.3798e-06     	|  2.0533e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.on_validation_epoch_start	|  1.59e-06       	|  2              	|  3.18e-06       	|  1.9319e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.on_validation_epoch_end  	|  1.5597e-06     	|  2              	|  3.1195e-06     	|  1.8951e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.on_train_end             	|  2.9802e-06     	|  1              	|  2.9802e-06     	|  1.8105e-07     	|
|  [LightningModule]NeRFSystem.on_validation_epoch_start                                                                                                           	|  1.23e-06       	|  2              	|  2.4601e-06     	|  1.4945e-07     	|
|  [LightningModule]NeRFSystem.on_train_end                                                                                                                        	|  2.4298e-06     	|  1              	|  2.4298e-06     	|  1.4762e-07     	|
|  [LightningModule]NeRFSystem.on_save_checkpoint                                                                                                                  	|  2.36e-06       	|  1              	|  2.36e-06       	|  1.4337e-07     	|
|  [LightningModule]NeRFSystem.on_fit_end                                                                                                                          	|  1.98e-06       	|  1              	|  1.98e-06       	|  1.2029e-07     	|
|  [LightningModule]NeRFSystem.teardown                                                                                                                            	|  1.77e-06       	|  1              	|  1.77e-06       	|  1.0753e-07     	|
|  [LightningModule]NeRFSystem.on_train_start                                                                                                                      	|  1.62e-06       	|  1              	|  1.62e-06       	|  9.842e-08      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.teardown                 	|  1.6098e-06     	|  1              	|  1.6098e-06     	|  9.7797e-08     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.on_fit_end               	|  1.56e-06       	|  1              	|  1.56e-06       	|  9.477e-08      	|
|  [Strategy]SingleDeviceStrategy.on_train_end                                                                                                                     	|  1.5199e-06     	|  1              	|  1.5199e-06     	|  9.2338e-08     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None}.on_fit_start             	|  1.4999e-06     	|  1              	|  1.4999e-06     	|  9.1121e-08     	|
|  [Strategy]SingleDeviceStrategy.on_train_start                                                                                                                   	|  1.1497e-06     	|  1              	|  1.1497e-06     	|  6.9847e-08     	|
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
