Unfortunately, the measurement stopped at 23:42 LT after generating Wavefront 29, at the level of the HWS software called by the hwsAna.py script. The recently introduced logfile shows the error:

Traceback (most recent call last):
  File "/virgoDev/TCS_HWS/Python/HWS_ANA/v3/hwsAna.py", line 310, in
    generateCentroid(workDirProbe,1,nRef , workDirProbe, 1, nLive,livePrefix, workOut,co
unt);
  File "/virgoDev/TCS_HWS/Python/VIRGO/HWS/HWS_Run.py", line 131, in generateCentroid
    hsi_live.read_image()
  File "/virgoDev/TCS_HWS/Python/VIRGO/HWS/HS_Image.py", line 333, in read_image
    self.read_and_average_frames()
  File "/virgoDev/TCS_HWS/Python/VIRGO/HWS/HS_Image.py", line 439, in read_and_average_f
rames
    raise Exception('There are no image files to read: ' + self.location + self.fprefix)
Exception: There are no image files to read: /data/tcs/buffer/test/HWS-RC/DET/20230307T2
234//probe/0030clive

It doesn't look like a filesystem space issue, as df -h shows:

nfsvols1:/tcs                          8.0T  4.8T  3.3T  60% /data/tcs

A more detailed history of the log content is attached: it seems that the failure happened when trying to generate 0029liveCentroidsPy.dat (lines 132-135); wavefront 29 is generated (incorrectly?), then wavefront 30 fails as the "30"-prefixed images are not present, as reported from the Traceback above.

I left the automation end the measurement anyway. Metatron-wise, the logic is working as in the stripped down tries done earlier in the evening; the full sequence is reported in the Figure: channels of interest are the indexes of the relevant Metatron nodes, the Metatron channels pertaining to the Compensation measurement and the use of the DET HWS, and the status of the flip mirrors for the NI TCS actuators.

The timers shown by the ITF_LOCK GUI are still a bit imprecise, as the node implies them from the TCS_MAIN.ini configuration file without tracking each step of TCS_MAIN; in any case, TCS_MAIN shows the correct ones by definition, and the state transitions are driven by successful state requests, not timers.

An improvement, which takes into account also the timer for the HWS initialization, has been already uploaded.

I left the ITF in LOCKED_ARMS_IR (the flip-down of the CH has been uncommented).