ITF found in CARM_NULL_1F in Troubleshooting mode and SQZ team at work on FDS FC recovery (Vardaro, Zendri).
Activity concluded at 20:00 UTC with ITF locked at LN2.
Unfortunately, after the activity, the ITF was very unstable. It unlocked sistematically at LOCKING_CARM_NULL_1F.
After several unsuccessfully locking attempts, according with commissioners, I relocked at LOCKED_ARMS_IR.
SBE
16:00 UTC - SPRB vertical position recovered via stepping motors.
Today while locked in LN2 we found the MAR actuation of SR and PR payloads slighlty mistuned (former values pre-shutdown were not saved). We measured the coupling and corrected the driving.
DSP cards properly saved afterwards.
Today, on site, we
-Switched on the output of the NCal power supply (which were switched off due to the large general power supply failure of Feb 28th).
-Replaced the NWN controller. The removed one is suspect of being wrongly parametrised (slow frequency ramp up observed on 14 Oct 2025) and we will check this at IPHC.
With the replaced controller, the NWN frequency ramps up much faster than with the old one (see picture). The NWN phase control also looks better and needs to be tuned further which we will probably do next Tuesday during maintenance.
Time details of the changes:
10:30 utc in WEB:
Power on WEB NCal power and restart all rotors at default frequencies
11:00 utc in NEB:
Successfully test restart of NEB NCals before changing NWN motor controller
Replace NWN controller by new one (we bring back the replaced one to IPHC)
Restart all NEB NCal power supply and restart all NEB NCals with success.
ITF found in Troubleshooting mode with arms locked.
At 7:00 UTC ITF in Maintenance mode, below the list of the activties communicated in control room:
| CH [W] | OUTER RING [W] | INNER RING [W] | |
| WI | 0.44 | 0.26 | 0.03 |
| NI | 0.61 | 0.59 | 0.09 |
At around 12:00 UTC we started to relcok the ITF; the commissioning team is now working at the lock recovery.
DET
SDB1 LC opened by the guardian; properly closed at 8:25 UTC.
The power emitted by the CO₂ WI auxiliary laser is shown in the attached figure.
As can be seen, the power emitted by the laser dropped to about half following the blackout.
Yesterday evening, taking advantage of Antonio’s intervention to replace the pump on the WI tower, I went to the TCS room to check whether a better operating point could be found by adjusting the duty cycle of the square wave (as we did in the past).
I tested different duty cycle settings and found that the duty cycle value that maximizes the power is 74%. However, the power level measured before the blackout could not be recovered.
This morning we replaced the failed pump on WI.
About the disturbances observed yesterday evening , the failed pump was offline but still connected to the controller (failure of the magnetic bearing controller, replaced just after the shutdown), we can't exclude noisy effects due to the faulty electronics.
The Imaging servers have been restarted with the release v17r0p7 aligned with the latest Fr(v8r49p0) and Fd(v8r65p1) librairies
Operations performed between 2026-03-10-06h17m33-UTC and 2026-03-10-06h20m37-UTC
After the WI pump failure, WI suspension is moving quite a lot, more with respect to the usual, fig.1.
I don't know if this is related to the failed locking attempts, tomorrow the problem will be better addressed.
ITF still in recovery - TROUBLESHOOTING at the beginning of the shift, which kept on going through the afternoon
Here the steps taken during the recovery and the edits to automation (Pinto, Spinicelli, Nardecchia, Was, Ruggi). LN2 was achieved three twice (18:30 UTC - vac pump failure, 19:57 UTC) lasting only a few minutes in both cases.
18:30 UTC Vacuum pump failure, fixed (Vacuum Team)
20:43 UTC ITF in LN2
20:56 UTC unlock, then unlock at LOCKING_CARM_NULL_1F (21:06 UTC), REDUCING_CARM_OFFSET_2_OF_3 (21:20 UTC), LOCKING_CARM_NULL_1F (21:30 UTC)
At the end of the shift, as instructed, I left the ITF in LOCKED_ARMS_IR - TROUBLESHOOTING, since it had not been possible to keep a stable lock in LN2 or to reach CARM_NULL_1F during the other locking attempts.
After the WI pump failure, WI suspension is moving quite a lot, more with respect to the usual, fig.1.
I don't know if this is related to the failed locking attempts, tomorrow the problem will be better addressed.
Today we continued the recovery of the ITF. We managed to reach LOW_NOISE 2.
At the beginning we noticed a lower power values on the 112 and 12 MHz sidebands, which was taken care of by Ilaria, acting on CH:
NI CH = 0.577W -> 0.708 W
WI CH = 0.324 W -> 0.416 W
At the end, we partially reversed the NI CH PWR increase: 0.708 W -> 0.630 W. (17.32 UTC finish of the actions).
After this, we had several issues in finding a good configuration of demodulation phases in order to get past the handoff from 3f to 1f in CARM null. In particular DIFFp was showing during the transient some misbehaviour (not entirely clear the rigth explanation), in which with good phases both I and Q (on TX DoF) were witnesses of some movement which ended up in a quick drift of the alignment and eventually the unlock. Curiously enough, the phase able to get past the initial transient was showing a ~45 deg mistuning. After several trials in which we noticed this behaviour, we implemented a double condition in the automation in which we use two phases, one 'wrong' for the transient and one good for the steady state (similarly to what we do for B4 56 MHz).
With this configuration we were able to lock the OMC, after a tuning of the OMC locking phases, and go up to LOWNOISE 2. However, after a while we unlocked due a to a WI tower pump failure. Antonio went to CEB to take care of it.
We leave the ITF locking on LOWNOISE2 for the night, to acquire some statistics on the acquisition.
N.B. the modification on the automation are the following:
ITF_LOCK.py: added lines 4681-82; 4685-86.
ITF_LOCK.ini, in the SHUTTER section: added the steady state DIFFp phases.
If the acquisition is robust enough, tomorrow we will proceed to fine tune all the several phases, if needed.
:)
This morning we replaced the failed pump on WI.
About the disturbances observed yesterday evening , the failed pump was offline but still connected to the controller (failure of the magnetic bearing controller, replaced just after the shutdown), we can't exclude noisy effects due to the faulty electronics.
Also SC is aligned into the OPA. The heighest peak is 0.2% of TEM00
ITF found in LOCKED_ARMS_IR in TROUBLESHOOTING mode.
SIB2 position loop found opened. Properly closed.
ITF relocking up to CARM_NULL_3F after the usual cross-alignment in ACQUIRE_DRMI.
ITF phase tuning in progress up to CARM_NULL_1F.
This morning around 11 LT the Krakow POLGRAV team (Michal Ostrowski and Jerzy Kubitsz) installed two high sensitivity and low noise magnetometers near to the Virgo EXTternal magnetometer (ENV_EXT_MAG_N). The two magnetometers have been oriented along the geographic North, which in our location is approx +4 deg with respect to the magnetic North. Sensors are connectew with a local supply and DAQ synchronized with GPS.
It has been checked that the magnetometers are not saturating: their dynamic range is 19nT RMS, and the actual measured RMS is approx 5nT RMS.
The plan is to record 24 hrs of data and then move to another location. Before removing this installation some magnetic pulses will be injected locally in order to test the sensors synchronization.
ITF found in LOCKED_ARMS_IR State and TROUBLESHOOTING Mode.
ITF recovery ongoing after NI CO2 Laser RF Driver replacement (see #68263).
All times are UTC.
15:12 TCS Chillers Guardian restored with slightly higher flow (Menzione, Nardecchia).
19:07 Activity on ITF recovery concluded with ITF able to reach CARM_NULL_3F. ITF to be left in LOCKED_ARMS_IR (see #68841).
ITF left in LOCKED_ARMS_IR State and TROUBLESHOOTING Mode.
Fabio and Suzanne successfully replaced the RF driver of the NI CO2 laser (see Fig 1). To perform the intervention, the 220 V line was completely disabled from the electrical panel in the TCS room and re-enabled once the operation was completed.
The lasers (both CH and DAS) were switched on at 14:31 UTC, and the lost power was recovered (see Fig. 2).
[Nicola took care of re-engaging the Guardian system.]
A thermal image of the rings was acquired for a quick check, and the rings appear to have returned to their pre-blackout conditions (see Fig. 3).
After waiting for the strongest thermal transient to settle, and following a phase tuning performed by Manuel, the CITF locked and the sideband levels returned to values consistent with the pre-blackout conditions (see Fig. 3).
After that, Manuel and Diego started working on the lock acquisition (see entry 68841).
Today we continued with the recovery of the ITF.
From DRMI 1f we managed to reach carm null 3F, by tuning the demodulation phases of mostly 56 MHz and 169 MHz (MICH SRCL DARM and DIFFp), plus some less invasive tuning on PRAA and PRCL. We will continue the recovery next week.
As the NI DAS has been repaired and seem to be making a similar correction to what was the case before the blackout of last weekend. I have restored the nominal offset of 350um on the SDB1 B5 QD2 V around 16:06 UTC.
ITF found in LOCKED_ARMS_BEATING.
At around 7:45 UTC, in agreement with Ilaria, Nicola switched off the TCS chiller guardian to allow the activity of Ilaria: CO2 laser temperature scan for DAS rings recovery
The replacement of the NI CO2 RF driver was completed around 14:30 UTC; after that Nicola went in TCS chiller room to reactivate the guardian.
At the moment we are waiting for the thermal stabilization of the TCS.
ISC
Etalon setpoint changed under request of Maddalena, see the log from LSC_Etalon_Acl process:
SBE
SDB2 loop opened by the guardian; vertical position recovere and loop properly closed at 12:53 UTC.
This morning we attempted to reproduce the laser temperature corresponding to the pre-blackout configuration (26.8 °C) in order to try to recover the previous DAS rings.
After Nicola disengaged the Guardian system, I progressively increased the CO2 laser temperature.
NI set-point adjustments:
09:29 UTC: from 19.01 °C to 20.0 °C
10:01 UTC: from 20.01 °C to 21.0 °C
10:23 UTC: from 21.0 °C to 22.0 °C
11:01 UTC: from 22.0 °C to 23.0 °C
11:26 UTC: from 23.0 °C to 23.3 °C
11:34 UTC: from 23.3 °C to 23.5 °C
At around 13:40 UTC I checked the DAS rings again, but no changes were observed (see figures).
It was then decided to proceed with the replacement of the NI CO2 RF driver. Fabio and Suzanne are currently working on it.
Today at 13h10 utc U adjusted again the offset of the B1_PD3_DC channel by +0.12 uW.
Today Fabio switched off and on the DDS pf the fiber noise cancellation system. After that we recovered the INJ pick off for the main PLL and we easily managed to locke the PLL.
After that I locked the FC on green. I saw a very big shift in vertical that I recovered with +130 steps of SQB1 M1. After few hours we went back to +90. Still to chceck.
All it is reovered except the alignment of SC into the OPA that it is not yet checked.
Upon arrival (at 15:00 UTC) I found ITF locked at LOCKIED_ARMS_BEAT_DRMI in TROUBLESHOOTING mode and commissioners at work to recover the standard state of ITF.
A better TCS tuning is needed in order to improve the sidebands power. Tomorrow it will be done.
Activities concluded at 20:50 UTC.
