Reports of 59882
Virgo Runs (O4b)
irace - 15:07 Thursday 14 November 2024 (65527) Print this report
Operator Report - Morning shift

ITF found in LOW_NOISE_3_SQZ and SCIENCE mode.

It unlocked at 08:45 UTC. After two failed attempts, the ITF was back in SCIENCE mode at 11:19 UTC.

Images attached to this report
AdV-DAQ (Calibration)
vanhove - 14:45 Thursday 14 November 2024 (65532) Print this report
NSN NCal rotor phase problem
Today the NCal NSN rotor phase unlocked from 11h13 to 11h15, resulting in incorrect calibration line subtraction (at 36.24 Hz) for about 2 minutes.

The reason for the NCal phase unlocking is a decrease of the LED signal used to capture rotor rotation as can be seen on top plot of LED_Alim_rotor_phase.png
The bottom plot of this image shows that about 1 minute later, the rotor phase begins to diverge from 0. When LED signal gets back to its normal value, the phase lock back after few cycles.

The second image shows how the phase unlock result in the bad subtraction of calibration line at about 36Hz
The problem is under investigation.
Images attached to this report
AdV-SAT (Suspension control upgrade)
Boschi, Montanari - 12:33 Thursday 14 November 2024 (65531) Print this report
Comment to NE Issues after Fan Unit Replacement (65400)

On Monday 11th we replaced the distribution box connected to NE accelerometers in order to exclude it from the possible sources of the glitches. Unfortunately the test was unsuccessful: the glitches reappeared after a few hours. In the next days we will replace the boards. 

AdV-INF (Virgo Reference System Geometry)
a.paoli, r.romboli, l.paoli, c.fabozzi - 11:05 Thursday 14 November 2024 (65530) Print this report
19th Tunnels' height monitoring campaing - West Tunnel

On October 30, we completed the 19th height monitoring campaign of the West Tunnel - West End Building reference points.

Tab.1 summarizes the result of the survey and Fig.1 shows the longitudinal profile, that reports graphically the trend of the subsidence over time.

Non-image files attached to this report
AdV-COM (AdV commissioning (1st part) )
ruggi, pinto - 10:32 Thursday 14 November 2024 (65529) Print this report
Comment to Locking correction to IP (65424)

The automatic engagement of locking reallocation to IP for PR and BS works fine. Fig 1 shows the evolution of PR CORR and BS CORR slow rms: both minimum level and peaks in windy conitions are reduced a lot.

In fig 2, a comparison of data for medium level wind speed condition is shown. The lowering of PR and BS MAR correction correspond to a certain reduction of BS TY low frequency spectral level, but the gain in CMRF stability is quite poor.

In fig 3, the evolution of BS TY slow rms is added: the reduction of BS CORR corresponds to a visible (small) reduciton of BS TY. On the contrary, CMRF rms evolution seems not correlated.

Images attached to this comment
AdV-DAQ (Data collection)
masserot - 9:19 Thursday 14 November 2024 (65528) Print this report
Comment to DAQ : latency jumps since the 2024-10-14-16h57m-UTC (65361)

Since the 2024-10-21-16h28-UTC , the FmRawBack server is stopped and none improvements were observed in the DAQ latency jumps 

The FmRawBack server, running on the olserver119 and providing the raw_bck.ffl file, has been restarted at  2024-10-05-07h52m34-UTC.

Images attached to this comment
Virgo Runs (O4b)
Sposito - 6:58 Thursday 14 November 2024 (65526) Print this report
Operator Report - Night shift

I found ITF in SCIENCE; It remained locked for the whole shift.

NO DMS event.

Guard tour (UTC):

  • 22:03 - 22:33
  • 00:00 - 00:30
  • 02:00 - 02:28
  • 04:00 - 04:26
Images attached to this report
Virgo Runs (O4b)
amagazzu - 23:01 Wednesday 13 November 2024 (65522) Print this report
Operator Report - Afternoon shift

ITF found in LOW_NOISE_3 and in Science Mode.
At 16:56 UTC the ITF unlocked, at the same time the data of the ACS DET became unavailable. While investigating the issue I found the related UTA panel was switched off, and the DET humidier tank was spilling water. The water has passed throught a passing cable hole in the floor and hit the UPS in the room below, causing a switch off of the Air conditioniong of the DET Lab. D'Andrea was able to bypass the UPS, which now require repairment, and at around 17:55 UTC the UTA panel was restarted.
ITF back in LOW_NOISE_3 and Science Mode at 19:22 UTC. At 19:40 UTC, in agreement with Vardaro, I set the ITF back in LOW_NOISE_3_SQZ.
ITF left locked.

SBE
After the unlock at 16:56 UTC, I recovered the SPRB Vertical correction using the related Motor3.

Oncall events

Air Conditioning
(13-11-2024 18:10 - 13-11-2024 19:10) Operator on site with expert from remote
Status: Ended
Description: At 16:56 UTC, in parallel with the Unlock, the data from the ACS DET became unavailabe. After a brief investigation I found the the UTA DET was not reachable anymore. When I went to investigate the issue in the Central Building I've found the interface switched off, and the close tank of the humidifier was spilling water from the overflow valve.
Actions undertaken: I've contacted Soldani, D'Andrea find out that the water of the humidier tank has spilled out from the floor above and hit the UPS, triggering a switch off the the DET air condition (which could be the cause of the unlock). After the bypass of the UPS it was possible to restore the UTA Interface at around 18:00 UTC, and the system was restored.

Electricity
(13-11-2024 18:20 - 13-11-2024 19:10) On site
Status: Ended
Description: While investigating the issue with the UTA DET, I found that the related inferface was switched off. Soldani contacted D'Andrea, who went to the central Building to investigate the issue.
Actions undertaken: The DET ACS UPS was found wet due to the water spilling from the floor above and showing errors on screen, but still switched on. D'Andrea put the area in safety and bypassed the broken UPS in order to restore the ACS of the Detection Lab.

Images attached to this report
Virgo Runs (O4b)
vardaro - 18:49 Wednesday 13 November 2024 (65525) Print this report
Comment to Operator Report - Night shift (65508)

In order to reemove the lines I forced the switch off of the line in DOWN,
I re switch on the line in SQZ_INJECTING. I pressed load duirng the Troubleshooting

AdV-INJ (Reference cavity (RFC))
spinicelli, derossi, melo - 18:34 Wednesday 13 November 2024 (65524) Print this report
Comment to Swap of RFC TRA photodiode (65462)

Yesterday morning, during the maintenance time, we made a visual inspection to the RFC tra setup. In particular, we tried to estimate which beam splitter is actually used to split the beam between RFC_TRA photodiode and camera without unmounting it. By only using an IR sensor card, we expect few mW of light going onto the camera, which would probably mean a 50/50 beam splitter or similar, and not the 1/99 as in the optocad design.
To be noted that, at the end of the intervention in LaserLab, we found that the RFC tra photodiode was almost completely misaligned. Since we didn't touch any optics, we couldn't identify which component moved.  Anyway, the realignment procedure was quite difficult since the RFC doesn't lock without the transmission trigger, and the new photodiode surface is much smaller than the previous one.

Images attached to this comment
AdV-INJ (Reference cavity (RFC))
mwas - 17:28 Wednesday 13 November 2024 (65523) Print this report
Comment to Swap of RFC TRA photodiode (65462)

I have compared the specturm of RFC Tra before and after replacement of the photodiode. To compare the spectra, I have used the spectrum of the new photodiode as it is, as it should be calibrated correctly into mW based on the value of the resistors used in the photodiode. For the old photodiode, I have adjusted the calibration to match the two spectra at 1501Hz, the frequency of the PSTAB line. They also matche well below 10Hz after the adjustments, which adds confidence that the comparison is done in the same units.

Figure 1 shows the two spectra. They agree well above 200Hz. Below that frequency there are bumps that are different frequencies, and the overall noise floor before the PD change seems lower. From a few mW on the photodiode one would expect a quantum shot noise of a few 1e-8 mW/rtHz, so at high frequency the spectrum is likely dominated by quantum noise. Depending on which data I look at I conclude the power is 2.3mW or 5mW on the PD. Hence it is difficult to be sure if it is only quantum noise.

At lower frequency one can try to explain the noise floor with a 1/f^0.66 shape. I honestly don't know if it is really the noise floor, or just the effect of the many bumps give a floor which looks to have the same slope as the mystery 1/f^{2/3} noise.

Images attached to this comment
Virgo Runs (O4b)
berni - 15:00 Wednesday 13 November 2024 (65521) Print this report
Operator Report - Morning shift

ITF found in Prepare_Science with Mattia working from remote trying to understand and fix the lcking troubles; in the meantime Paolo reached the site

At 6:26 UTC we reached LN3; we decided to set Adjusting mode to allow Paolo to recover the proper PR vertical position. To do that I went in CB to switch ON the PR motors; the ITF unlocked during this operation.

At 6:51 UTC ITF in Troubleshooting mode; Paolo was able to recover the PR and the BPC (at the end of this activity I switched off the PR motor drivers).

After one failed attempt we could relock the ITF in LN3 and Science mode was set at 9:19 UTC.

Then, at 10:21 UTC the ITF unlocked; after one failled attempt we could relock the ITF in LN3 and Science mode was set at 11:33 UTC.

At 12:56 UTC ITF in Adjusting mode for one minute to allow Marco to switch off the dithering lines of the Squeezing.

 

SBE

SPRB vertical actuator close to saturation; to restore at the next unlock.

Images attached to this report
On-call intervention (General)
boldrini, menzione - 7:36 Wednesday 13 November 2024 (65520) Print this report
ISC on-call intervention

I was called at about 5:30 local time. The ITF had unlock continously over the night.

There are at least 15 unlocks to look at, all apparently for different reasons. While I could not check all of them, I found an unlock during ACQUIRE_LOW_NOISE_3 apparently due to BS_TX fbw being engaged while a 400 mHz oscillation was affecting the loop (Fig.1). While I was looking at another unlock, the ITF managed to reach LN2 by pure chance, and I took the occasion to comment line 6137 in ITF_LOCK.py to prevent the engagement of BS_TX fbw.

This worked, the ITF reached LN3. At this point, I manually engaged the fbw configuration for BS_TX and restored ITF_LOCK.py as it was.

Unfortunately the ITF unlocked shortly after, due to a high gain oscillation of DIFFp_TY. The servos of DIFFp were not functioning due to low line coherence (Fig.2)

In the last attempt, I replicated the BS fbw trick and increased (online, without saving) the DIFFp lines amplitude as a patch (by about 60%). The Audio channels on B1 are not saturating as a consequence.

The servo started working again and changed DIFFp gains significantly. This solution seems to work and at the moment the lock has lasted about 10 minutes.

I am closing this intervention and moving on site to continue.

Images attached to this report
Virgo Runs (O4b)
menzione - 6:45 Wednesday 13 November 2024 (65519) Print this report
Operator Report - Night shift

ITF was found in CARM_NULL_1F and PREPARE_SCIENCE mode. 
Unfortunately, the increasing wind activity (fig1) prevented the lock for the first part of the shift. BAD_WEATHER mode set.

At 02:30 UTC, although the weather conditions improved, ITF unlocked however at various steps. TROUBLESHOOTING mode set.
I contacted the ISC OnCall to investigate it. Boldrini commented a line in ITF_LOCK.py which closes BS loop in full bandwidth.
ITF relocked at LN3 only at 05:32 UTC. SCIENCE Mode set at 05:34 UTC but ITF unlocked again at 05:43 UTC.
Relocking in progress...


Guard tour (UTC):
22:06 - 22:36
00:00 - 00:30
02:00 - 02:31
04:00 - 04:28

Sub-system reports

ISYS
BPC - BsX_TX started to drift this afternoon and reached a value of 14 (plot3). Experts informed, and in accordance with Melo, we decided to operate on it on the morning shift.
At 02:56 UTC the B2 QD2 galvo loop remained open. I closed it via VPM.

SUSP
Sa_PR_F0_COIL_V1_50Hz has drifted out of range since this afternoon (plot2). Experts informed, and in accordance with Ruggi, we decided to operate on it on the morning shift.

Oncall events

ISC
(13-11-2024 04:20 - ) From remote
Status: On-going
Description: Problems with the lock acquisition

ISYS
(13-11-2024 01:45 - 13-11-2024 02:00) From remote
Status: Ended
Description: BPC - BsX_TX drifting out of range
NO actions for this night

SUSP
(13-11-2024 00:15 - 13-11-2024 00:15) Other
Status: Ended
Description: Sa_PR_F0_COIL_V1_50Hz drift out of range
NO actions for this night

Images attached to this report
Virgo Runs (O4b)
Sposito - 22:59 Tuesday 12 November 2024 (65517) Print this report
Operator Report - Afternoon shift

 ITF status in BAD WEATHER, strong wind activity that affect the lock. 16:50 UTC ITF back in SCIENCE (LOW_NOISE_3). 18:16 UTC ITF in SCIENCE (LOW_NOISE_3_SQZ). 18:56 UTC SQZ was disengaged, and the ITF transitioned to LOW_NOISE_3 so I put SCIENCE again. 20:36 UTC ITF unlocked. ITF left in relocking acquisition.

Sub-system reports

SQZ
SQB2 SBE and LC control left open as requested by M. Vardaro

Images attached to this report
Virgo Runs (O4b)
Montanari, Dattilo, Baldocchi - 18:01 Tuesday 12 November 2024 (65518) Print this report
Comment to Operator Report - Morning shift (65514)

This morning, the inspection and increase of rodent traps were also carried out inside the experimental buildings.

The personnel of an external company, under the supervision of N. Baldocchi, increased the number of rodent traps installed in terminal buildings to mitigate the damage caused by them.
As part of the same intervention, an inspection was conducted in the central building to review traps installed in previous operations. During the inspection, any damaged devices were replaced.

The monitoring and implementation of the traps is ongoing, to ensure the effectiveness of the measures adopted and, if necessary, to plan additional actions.

Infrastructures (Air Conditioning)
soldani, nenci - 15:38 Tuesday 12 November 2024 (65516) Print this report
Tuesday controls and short maintenance
These are the activities carried out during "Tuesday Maintenance" :
- check of installation for TB, CEB and MC;
- short maintenance for DET Lab humidifier (N.B.: no faults present, limescale sediments removed from water pump and drain tank)
- short maintenance for gasoil boiler in TB, NEB and WEB (periodic operating test, nozzle cleaning)
- TB LPG tank refill
Virgo Runs (O4b)
amagazzu - 15:31 Tuesday 12 November 2024 (65514) Print this report
Operator Report - Morning shift

ITF found in relocking and in PREPARE_SCIENCE Mode. It was not possible to relock due to the ITF unlocking at various steps of the locking acquisitions.
At 7:00 UTC I set the ITF in MAINTENANCE Mode and manually unlocked. Here a list of the activity reported to the Control Room:

- Cleaning of Scientifc Area (External firm managed by Ciardelli);
- OMC Scan/Lock (Operator);
- At 7:20 UTC, TCS Chiller Refill (Ciardelli);
- Cranes Inspection (Bazzi);
- At 8:05 UTC, Check of IMC Working Point and Position (Operator);
- TCS power adjustment (Nardecchia);
- From 8:20 UTC to 9:00 UTC, TCS Camera reference and Power checks (Operator);
- From 9:30 UTC to 11:10 UTC, INJ activity inside Laser LAb / EE Room (Spinicelli, Montanari, Melo, De Rossi);
- ACS check on DET Humidifer (external firm managed by Soldani);
- At 10:00 UTC, Final check performed by Nenci. 

At 11:10 UTC, after the INJ activity was concluded, I started the relock. 
In agreement with the expert, at 13:42 UTC we put the ITF in TROUBLESHOOTING and DOWN State to allow Montanari to go back to the NE to disconnect the accelerometers of the Suspension to revert the action performed yesterday.
ITF left unlocked.

DET
7:20 UTC - 5 minutes of OMC Lock in NI Single Bounce configuration
From 7:27 UTC to 7:47 UTC - OMC Scan

TCS Power Checks

    CH [W] INNER DAS [W] OUTER DAS [W]
W on the pickoff  0.28 0.05 0.258
N on the pickoff  0.646 0.047 0.602
Images attached to this report
Comments to this report:
Montanari, Dattilo, Baldocchi - 18:01 Tuesday 12 November 2024 (65518) Print this report

This morning, the inspection and increase of rodent traps were also carried out inside the experimental buildings.

The personnel of an external company, under the supervision of N. Baldocchi, increased the number of rodent traps installed in terminal buildings to mitigate the damage caused by them.
As part of the same intervention, an inspection was conducted in the central building to review traps installed in previous operations. During the inspection, any damaged devices were replaced.

The monitoring and implementation of the traps is ongoing, to ensure the effectiveness of the measures adopted and, if necessary, to plan additional actions.

AdV-DAQ (Calibration)
grimaud, masserot, verkindt - 10:28 Tuesday 12 November 2024 (65515) Print this report
Comment to Test on NE PCal glitches (65487)

The NE and WE PCal config has been changed to allow more transparent switch of control loop photodiodes. When the switch button is pressed it will automatically change the photodiode use to create the hpcal channel used by hrec to do the line subtraction. The channel are now named V1:PCAL_*_PD_hpcal instead of V1:PCAL_*_PD1_hpcal.

For NE the control loop photodiode has been put back to Tx_PD1, as using Tx_PD2 was not solving the glitch issue.

Hrec and HrecN were restarded at 9h27 UTC.

Virgo Runs (O4b)
menzione - 6:59 Tuesday 12 November 2024 (65513) Print this report
Operator Report - Night shift

ITF found in CARM_NULL_1F and in PREPARE_SCIENCE mode. 
Back in LN3, SCIENCE at 22:40 UTC.

It unlocked  at 23:46 and at 23:59 UTC; after the unlock the OMC shutter remained open (light on B1s2). To restore the situation I applied the procedure: NI single bounce then, from DET MAIN, ask for FORCE_CHECK_OPEN --> SHUTTER_OPEN --> SHUTTER CLOSED.
Back in LN3, SCIENCE at 02:13 UTC.

At 05:35 UTC I noticed an increasing of the ENV..LL_MAIN_CHILLER_PIPE_TE (fig3), I set ITF in TROUBLESHOOTING and I went in EE Room to check the status of the main laser chiller. OnCall expert told me to leave it as it is and wait for the maintenance intervention. Unfortunately my intervention unlocked ITF.
Relocking in progress, PRREPARE_SCIENCE mode set.

Guard tour (UTC):
22:20 - 22:54
00:00 - 00:33
02:00 - 02:33
04:00 - 04:49

Sub-system reports

DAQ
04:31 UTC - TelescreenArt provess crashed. Restarted

ISYS
ENV..LL_MAIN_CHILLER_PIPE_TE increased.

Oncall events

ISYS
(12-11-2024 05:35 - 12-11-2024 05:45) Operator on site with expert from remote
Status: Ended
Description: ENV..LL_MAIN_CHILLER_PIPE_TE increased.
I touched the probe and the temperature got stuck.

Images attached to this report
Virgo Runs (O4b)
Sposito - 23:10 Monday 11 November 2024 (65512) Print this report
Operator Report - Afternoon shift

I found the ITF in SCIENCE mode at 15:21 UTC. The ITF was in the process of ADJUSTING for a distribution box upgrade at the NE accelerometer (Boschi, Montanari), with a test reallocation for PR BS (Ruggi, Bersanetti). The ITF was then unlocked at 15:31 UTC, and the status was in TROUBLESHOOTING. At 16:01 UTC, together with D. Bersanetti, we decided to start the unlocked CALIBRATION early.

Here is the summary:

  • 16:01-16:15: CALIBRATED DELAY
  • 16:17-17:00: CALIBRATED PRWI
  • 18:32: failed CALIBRATED_DF_INtoEND_LN
  • 19:04-19:44: CALIBRATED_DF_INtoEND_LN
  • 19:57 UTC: End of CALIBRATION

At 20:35 UTC, the ITF returned to SCIENCE mode without SQZ (the SQZ does not work due to humidity problems; actions will be performed tomorrow during maintenance). At 20:56 UTC, the ITF was unlocked again. At 21:43 UTC, the ITF returned to SCIENCE mode, and at 21:56 UTC, the ITF was unlocked once more. The ITF is currently left in relocking acquisition.

Images attached to this report
AdV-COM (AdV commissioning (1st part) )
bersanetti, ruggi, carbognani, gkaitatzis - 16:49 Monday 11 November 2024 (65511) Print this report
Gnames for new reallocation of locking correction for PR and BS

Following the recent work on the improvement of the management of the locking correction in the suspension chain of PR and BS (entry 65424), we added two new Gnames in the SatServer configuration in order to turn on/off the new strategy during the lock acquisition. Such Gnames (for PR and BS) are called HCIP_ENBL and they are 0 by default, and 1 when the new strategy is in operation.

The new strategy has been tested while already locked (15:22:20 UTC), and the Gnames have been added to the Automation, in the ITF_LOCK node: flags are put to zero in DOWN, and to 1 at the end of ACQUIRE_LOW_NOISE_3, together with the turnoff of the DRMI lines.


As a reminder, given the "recent" almost TANGO-less implementation of the SatServer, the procedure for adding new Gnames is now the following:

  • knowing from which DSP card the new Gname comes from, check in the file /virgoData/Sa/PySatServer/dsp_config_det.yml the number associated to the board (for example, the BS_mir DSP corresponds to 51181);
  • in the file /virgoData/Sa/PySatServer/SAT_GAINS.ini, add by hand the new gnames in the format GNAME = number in the corresponding section (for this example, [Sc_BS]); the number is the one found above;
  • from VPM, do a Reload Configuration on both SusDAQBridge and SatServer;
  • reload any Python instance of PR and BS DSPs from PythonVirgoTools/Metatron, etc..
Virgo Runs (O4b)
mwas - 15:14 Monday 11 November 2024 (65510) Print this report
Comment to Operator Report - Night shift (65508)

Figure 1. After the squeezing was disengaged two bumps appeared in the specturm around 25Hz and 30Hz. These are related to the squeezer automatic alignment dither signals, and likely mean the residual B1p beam is misaligned on the squeezing benches when the squeezer is switched off.

Images attached to this comment
Virgo Runs (O4b)
amagazzu - 15:06 Monday 11 November 2024 (65509) Print this report
Operator Report - Morning shift

ITF found in LOW_NOISE_3 and in Science Mode.
At 9:28 UTC I unlocked the ITF and set it in Troubleshooting Mode to allow the planned Replacement of the NE Distribution Box, carried out by Boschi and Montanari.
At 11:40 UTC we started to relock, ITF back in Science Mode and LOW_NOISE_3_SQZ at 12:47 UTC.
The ITF was set in Adjusting mode from 13:13 UTC to 13:18 UTC to allow Bersanetti to reload SusDAQBridge to add a new GNAME for the GIPC.
ITF left locked.

ACS
During the night the humidty inside the DET Lab decreased (See attached plot). During the morning Soldani increased the setpoint of the loop, and it was able to engage the Squeezing again. Further checks will be perfomed tomorrow during the maintenance.

Images attached to this report
Virgo Runs (O4b)
gherardini - 6:57 Monday 11 November 2024 (65508) Print this report
Operator Report - Night shift
The ITF kept the lock all the shift, science mode stopped from 0:28UTC to 0:34UTC because of squeezing disengage, the squeezing was not able to relock most probably because of a change in the detection lab humidity (see plot), so I left the ITF without squeezing for the rest of the night.

- guard tours (UTC):
22:12 --> 22:40
0:06 --> 0:36
2:08 --> 2:36
4:11 --> 4:41
Images attached to this report
Comments to this report:
mwas - 15:14 Monday 11 November 2024 (65510) Print this report

Figure 1. After the squeezing was disengaged two bumps appeared in the specturm around 25Hz and 30Hz. These are related to the squeezer automatic alignment dither signals, and likely mean the residual B1p beam is misaligned on the squeezing benches when the squeezer is switched off.

Images attached to this comment
vardaro - 18:49 Wednesday 13 November 2024 (65525) Print this report

In order to reemove the lines I forced the switch off of the line in DOWN,
I re switch on the line in SQZ_INJECTING. I pressed load duirng the Troubleshooting

Search Help
×

Warning

×