Introduction
0.  DAQ basic operations
1.  DAQ description
2.  DAQ User Interfaces
3.  The standard state
4.  The supervisor and the Error Logger
5.  Start/Stop procedure for each DAQ process
6 . Start/Stop sequence
7.  List of Experts
8.  References
Appendix A: Useful commands and aliases
Appendix B: Online and offline utilities
Appendix C: Getting data from DAQ
Appendix D: List of Acronyms
Appendix E: How to repair a file or reprocess a data stream

This document describes the procedures for operating and monitoring the Virgo Data Acquisition system. A copy of this document should be available in Control Room, in the yellow folder called "Interferometer Procedures", and on the WEB from: http://wwwcascina.virgo.infn.it/commissioning/procedures
It is also available from the Virgo Electronic and Software web page: http://wwwcascina.virgo.infn.it/sDoc

The manual is structured as follow:
Section 0 is a brief description of the most usual operations to be done by the DAQ operator.
Section 1 contains a brief description of the functions ensured by the DAQ system, its architecture and a list of all the DAQ processes.
Section 2 lists and describes the set of Graphical User Interfaces used to start and monitor the DAQ processes.
Section 3 describes what should be the standard state of the DAQ system when everything is running correctly.
Section 4 describes the procedure to start/stop and check the Supervisor process. Currently, this process is not used by the DAQ.
Section 5 describes in detail each DAQ process , including start and stop procedures, known problems and specific commands.
Section 6 contains the sequence of operations to restart the DAQ from scratch or to fully stop it.
Section 7 provides the list of expert people to be contacted in case of problems (during working hours).
Section 8 contains a list of documents providing additional information about the DAQ system.

In addition, some appendices provide a list of useful commands and aliases (A) a list of utilities to monitor the DAQ processes (B), some conditions to get data online (C) and a list of acronyms used in the document (D).

A list of people on-call and reachable by phone outside working hours is given at the following web page: http://wwwcascina.virgo.infn.it/commissioning/onCall.html

Current status of the DAQ processes can be found on the WEB page: http://wwwcascina.virgo.infn.it/sDoc
Currently used DAQ software versions can be found in the file /virgoData/DAQ/ClDaqPck.inc

IMPORTANT: to start/stop any DAQ process, DAQ user interface or DAQ utility, you must be under the account "daq".

0.  DAQ basic operations

Are described here some basic rules and operations to follow when operating the Virgo DAQ:

• To monitor the DAQ process, always use the dedicated web pages or the graphical interface on the ax11 workstation.
• If graphical interface is not present on the screen of ax11, click anywhere in the background to get a menu where you can choose one of the graphical interface to start (ClDaqCollect or ClDaqData).
• To start or stop a DAQ process, always use the graphical interface available on ax11.
• If on first column a button is red on the graphical interface, try first to restart the graphical interface. If button is still red, restart the corresponding DAQ process. If button is still red again, call the expert.
• If on second column a button is red on the graphical interface, try to restart the corresponding DAQ process. If button is still red, call the expert.
• If on second column a button is dark green and if in the corresponding white line, you see "lost":
• if lost sources of data are external to DAQ (slow monitoring stations, suspensions DSP data, photodiodes readout, Gx servers, Pi server, Mc server), then check the concerned sub-system.
• if lost sources of data are within DAQ, restart each concerned DAQ process.

1.  DAQ description

The DAQ system includes the following tasks:

• Timing Server: control the timing synchronization and provides the GPS time stamps.
• Fbf: readout data from ADCs or DOL, merge and send them on Ethernet under frame format.
• Fbs: collect slow monitoring data (<1Hz), merge and send them on Ethernet under frame format.
• Fbm producers: collect frames from several sources, merge them and write them in a shared memory
• Fbm consumers: read frames from shared memory and distribute them on Ethernet.
• Fbt: computes trend data and writes on disk the trend data stream.
• Fbt50: filter and resample data at 50 Hz to produce the 50Hz data stream.
• Fbt50Write: write 50Hz data on disk
• FdW: write raw data on disk
• Fm: monitor frames written on disk and updates the ffl (frame files list) files.

 

Name on graphical interface	Cm Name	Function	CPU	Ethernet interface
TiServer	TiServer	Master Timing Server	rio11a	10 Mb
FbfMoniCb	FbfMoniCb	Fast Frame Builder for Central Building Env. Monitoring	rio39a	100 Mb
FbfMoniMc	FbfMoniMc	Fast Frame Builder for Mode Cleaner Building Env. Monitoring	rio61a	10 Mb
FbfMoniNe	FbfMoniNe	Fast Frame Builder for North End Building Env. Monitoring	rio75a	10 Mb
FbfMoniWe	FbfMoniWe	Fast Frame Builder for West End Building Env. Monitoring	rio85a	10 Mb
FbfDetP	FbfDetP	Fast Frame Builder for photodiodes data (Pr28)	rio14a	100 Mb
FbfDet	FbfDet	Fast Frame Builder for photodiodes + GC + Calibration data	rio16a	100 Mb
FbfNe	FbfNe	Fast Frame Builder for North End photodiodes	rio79a	100 Mb
FbfWe	FbfWe	Fast Frame Builder for West End photodiodes	rio89a	100 Mb
FbfSusp	FbfSusp	Fast Frame Builder for Suspensions data	rio17a	100 Mb
FbfInj	FbfInj	Fast Frame Builder for Injection system data	rio17b	100 Mb
FbsMoni	FbsMoni	Slow Frame Builder for injection system (LaDiode)	daq1	1 Gb
FbsSusp	FbsSusp	Slow Frame Builder for temperatures and suspensions	daq2	1 Gb
FbsDet	FbsDet	Slow Frame Builder for Lo, Vb, Sr of detection system	daq3	1 Gb
FbsSt	FbsSt	Slow Frame Builder for vacuum and daq monitoring	daq9	1 Gb
FbmMoni	FbmMoni	Main Frame Builder for Environment Monitoring daq line	daq1	1 Gb
MoniCsm1	FbmMoniCsm1	main consumer	daq1	1 Gb
MoniUsers	FbmMoniUsers	consumer dedicated to online connections	daq1	1 Gb
MoniShift	FbmMoniShift	consumer dedicated to online connections from operators	daq1	1 Gb
Fbt50Moni	Fbt50Moni	consumer resampling data at 50Hz	daq1	1 Gb
MoniNdas	FbmMoniNdas	consumer sending data to the Ndas writer process	daq1	1 Gb
NdasWriter	NdasWriter	writing data on disk for the Ndas (data exchange with Ligo)	ax11	100 Mb
FbmSusp	FbmSusp	Main Frame Builder for Suspensions daq line	daq2	1 Gb
SuspCsm1	FbmSuspCsm1	main consumer	daq2	1 Gb
SuspUsers	FbmSuspUsers	consumer dedicated to online connections	daq2	1 Gb
SuspShift	FbmSuspShift	consumer dedicated to online connections from operators	daq2	1 Gb
Fbt50Susp	Fbt50Susp	consumer resampling data at 50Hz	daq2	1 Gb
FbmDet	FbmDet	Main Frame Builder for Detection daq line	daq3	1 Gb
DetCsm1	FbmDetCsm1	main consumer	daq3	1 Gb
DetUsers	FbmDetUsers	consumer dedicated to online connections	daq3	1 Gb
DetShift	FbmDetShift	consumer dedicated to online connections from operators	daq3	1 Gb
Fbt50Det	Fbt50Det	consumer resampling data at 50 Hz	daq3	1 Gb
FbmMain	FbmMain	Central Main Frame Builder	daq4	1 Gb
MainUsers	FbmMainUsers	consumer dedicated to online connections	daq4	1 Gb
MainShift	FbmMainShift	consumer dedicated to online connections from operators	daq4	1 Gb
MainSt	FbmMainSt	consumer sending data to FbmSt	daq4	1 Gb
MainDM	FbmMainDM	consumer sending data to FbmDM	daq4	1 Gb
FbmSt	FbmSt	Last Main Frame Builder before data storage	daq9	1 Gb
StRaw	FbmStRaw	consumer sending data to raw data storage	daq9	1 Gb
StRawBack	FbmStRawBack	consumer sending data to backup data storage	daq9	1 Gb
StDy	FbmStDy	consumer dedicated to online connections with dataDisplay	daq9	1 Gb
Fbt50Fb	Fbt50Fb	Main Frame Builder for 50Hz data	daq6	1 Gb
Fbt50CsmW	Fbt50CsmW	consumer of Fbt50Fb (writes on disk in /data/50Hz)	daq6	1 Gb
50HzDy	Fbt50FbDy	consumer dedicated to online connections with dataDisplay	daq6	1 Gb
Trend	FbtMain	Trend Frame Builder (writes on disk in /data/trenddata)	daq9	1 Gb
Fbt50Write	Fbt50Write	data writer for the 50Hz data (writes on disk in /data/50Hz)	daq8	1 Gb
Raw	FdWRaw	data writer (writes on disk in /data/raw)	s1	1 Gb
RawBack	FdWRawBack	data writer backup (writes on disk in /data/rawback)	dd	1 Gb
FmRaw	FmRaw	frames monitor for raw data (updates /virgoData/ffl/raw.ffl)	ax11	100 Mb
Fm50Hz	Fm50Hz	frames monitor for 50Hz data (updates /virgoData/ffl/50Hz.ffl)	ax11	100 Mb
FmTrend	FmTrend	frames monitor for trend data (updates /virgoData/ffl/trend.ffl)	ax11	100 Mb
FbmDM	FbmDM	Main Frame Builder for detector monitoring algorithms	daq5	1 Gb

table 1: DAQ processes

First column of table 1 contains the process names used in the graphical interface described in section 2. Those names are sometimes truncation of the process Cm names.

1.1  DAQ Configuration:

The DAQ configuration can be extracted from the configuration files used by the DAQ user interface:
ClDaqCollect.cfg,
ClDaqData.cfg
ClDaqPck.inc
available in the /virgoData/DAQ directory.
Especially, ClDaqPck.inc contains the version, the log file path and the configuration file path of each software process used in the DAQ.

1.2  DAQ architecture:

The Data Acquisition is structured in three lines: MONI, SUSP and DET.

• MONI is the line associated to the Main Frame Builder FbmMoni, which collects the data sent by the environment monitoring readouts and by the injection system.
• SUSP is the line associated to the Main Frame Builder FbmSusp, which collects the data sent by the suspension system and some cameras readouts used in local controls.
• DET is the line associated to the Main Frame Builder FbmDet which collects the data sent by the detection system, the global control system and the alignment system (quadrant photodiodes).

figure 1
 

figure 2

A set of graphical user interface panels, one perDAQ line, allow to monitor and to control the DAQ processes. Each interface can be started by clicking in the background with the left button of the mouse and choosing in the menu "Daq Tools" the appropriate item "ClDaqCollect" or "ClDaqData".
You can use also one of the following commands:

      Cl   /virgoData/DAQ/ClDaqCollect.cfg      (for MONI, SUSP and DET data collection and storage)
      Cl   /virgoData/DAQ/ClDaqData.cfg         (for online data processing and monitoring)

where "Cl" is an alias for the graphical client used (type "alias Cl" if you need to know the full path).
Each of those panels shows the current status of the DAQ processes and some warning or errors messages. The informations provided by those interfaces, updated every 10 seconds, can be found also on the web: wwwcascina.virgo.infn.it/sDoc
or by clicking one of the following links:  All , Collect or Data.
 

2.1 ClDaqCollect

Each line corresponds to a DAQ process. The name of the process appears on the left button of the line (caution: this name is sometimes a truncation of the real Cm Name of the process), while the status of the process is shown in the right button (do not bother if active is written instead of  golden). A menu containing all the actions one can perform on a given process appears when clicking on the right button. To edit the logfile of a process, just click on the small arrow next to the right button of the process line. The color of the arrow indicates the higher error level encountered since the last time the logfile was edited. The white line at the right of the arrow contains some specific informations provided by the process. This information is typically updated every few seconds. Any warning or error message put in the logfile will appear also in the upper white window of the DAQ interface.

Process:
Cl.exe  Version: (see introduction or type "alias Cl")   Machine: ax11   Account: daq

data base / Configuration file:
The configuration file is /virgoData/DAQ/ClDaqCollect.cfg

Check:
If you cannot find the user interface on ax11, you can check if it is running by typing:
   ps -ef | grep ClDaq
If you do not get an answer (a line with name of the process), you should restart the client.

Start:
Be sure to be logged as "daq". To start the interface, you should enter:
  Cl  /virgoData/DAQ/ClDaqCollect.cfg
If the interface does not start, call the expert.

Stop:
To stop the interface, click on the cross at the right-top corner of the interface window.
If the interface does not stop, call the expert.

Specific actions:
Choosing "display server status" in the left button menu of one process (one line of the interface panel), shows informations like the cpu where is running the process, the date of start, the memory consumption of the process, etc...
Several other specific actions are available. Type [F1] key to get the online help.

Error logger / log file:
The error logger is not used by the DAQ interface. Logfiles are produced in /virgoLog/Cl.

Typical error message:
None

Documentation:
None. Type [F1] to get the online help.
 
 

2.2 ClDaqData

Process:
Cl.exe  Version: (see introduction or type "alias Cl")  Machine: ax11   Account: daq

data base / Configuration file:
The configuration file is /virgoData/DAQ/ClDaqData.cfg

Check:
If you cannot find the user interface on ax11, you can check if it is running by typing:
    ps -ef | grep ClDaq
If you do not get an answer, you should restart the client.

Start:
Be sure to be logged as "daq". To start the interface, you should enter:
   Cl  /virgoData/DAQ/ClDaqData.cfg
If the interface does not start, call the expert.

Stop:
To stop the interface, click on the cross at the right-top corner of the interface window.
If the interface does not stop, call the expert.

Specific actions:
Choosing "display server status" in the left button menu of one process (one line of the interface panel), shows informations like the cpu where is running the process, the date of start, the memory consumption of the process, etc...
Several other specific actions are available. Type [F1] key to get the online help.

Error logger / log file:
The error logger is not used by the DAQ interface. Logfiles are produced in /virgoLog/Cl.

Typical error message:
None

Documentation:
None. Type [F1] to get the online help.

Using the DAQ graphical user interface available on ax11 workstation, you can check that all the DAQ processes are active.
This means that left and right button of each line are green and right button shows "active" or "golden". In addition, you can check that each small arrow near to the right button is also green. Finally, to be sure that all foreseen data are taken, you can check for each Fbs, Fbf or Fbm status line that there is no "lost" source of data.

If right button is not green:  (or process name appears red on the web interface)
(there is a problem of Cm connection between the process and the graphical interface or the process is dead)

•  Click on left button of the line and choose "request user info".
•  If this action had no effect and if right button is red, then restart the graphical interface.
•  If this had no effect, then click on this right button and choose "start" in the showed menu.
•  If you do not succeed in restarting, then call the expert.

•  For FbmX or FbsX processes, it means that some sources of data are lost
•  Then, check the missing sources of data and restart them
•  If there is no really missing source of data or if after the restart of some sources, the "active" state persists, then call the expert.

•  Click on left button of the line and choose "request activation".
•  If this action had no effect, stop and restart the graphical user interface.
•  If this interface restart had no effect, call the expert.

If arrow is yellow: do not bother.

If arrow is red: click on it and look at the last ERROR message showed in the logfile.

If you can not understand the logfile message, call the expert.

If you observe some "lost" sources of frames:

• If such lost sources are Fast Frame Builder (Fbf...) or Slow Frame Builder (Fbs...) or Main Frame Builder consumers (Fbm...Csm1), you should see some red button in one of the DAQ interfaces. They are stopped processes. Just have a look at their logfile before restarting them.
• If such lost sources are Gx (camera readout), Mc25 or Pi25, have a look at the Suspension system or Detection system procedure document to know how to restart them.

• In some cases, the origin may be one readout system not sending data anymore through Digital Optical Link (DOL) down to a Fast Frame Builder.
• If this is not the case and only if you cannot call the expert: you can check the Fast Frame Builder DOL reception by logging onto the corresponding rio CPU (see table 1) and typing: /virgoApp/Do/.../RIO806X/DoSpy.exe  /virgoData/Fbf/XXX.cfg  , where XXX.cfg should be replaced by the Fbf config file name. It shows you a table where there should be no 0000 in the first column. Otherwise, check again parts of the readout system (DSP or Timing board) which is the source of data.

Any problem seen on the DAQ, or any restart of a DAQ server, whatever is the reason, should be mentioned in the Electronic logbook, in the task page "DAQ". You should at least describe the problem encountered, with its GPS time (just type "gps" to get it) and the action that was decided to solve the problem.

   Currently, there is no VSU or VSUClient for DAQ. But all the DAQ servers use the Su library and standards Su states and fonctionalities are implemented.
Concerning Error Logger, the use of it implemented in all the DAQ processes and the sending of messages to the Error Logger can be activated or desactivated from the DAQ graphical interface.

For any DAQ process:

• start:  using the graphical interface, click on the right button of the process line and choose "start" in the menu.
• stop:   using the graphical interface, click on the right button of the process line and choose "exit" in the menu.

Description:
This server controls the synchronization timing signals sent to various readouts used in interferometer control loops
and data acquisition. It sends also the GPS time stamp to the Main Frame Builders and to the Slow Frame Builders.
This server sends also slow monitoring data that includes quality flags, timing checks and informations about the GPS system used.

Process:
TiServer.exe  Version: (see introduction)  Machine: (see table 1)   Account: daq

Data Base / Configuration file:
The use of database is not activated. The configuration file is /virgoData/TiM/TiServer.cfg

Check:
On the ClDaqCollect graphical interface, in the "TiServer" status line, the last displayed message should be something like:
        fr:20258 run00126 GPS:738059905 - 2700 - Qc 0x00000000
with FR# and GTimeS incremented regularly and a green color on the two buttons of the line.

Start:
To start TiServer, use the ClDaqCollect interface on ax11. Choose "start" in the TiServer right button menu.

Stop:
To stop the process, choose "stop" in the TiServer right button menu.

Specific actions:
"config" in the right button menu: edit the configuration file.
"NewRun" in the right button menu: to start manually a new run. New runs are automatically managed by the TiServer process, so you should not have to use this action.

Error Logger / Log file:
Errors messages and warnings are  put in a log file in the /virgoLog/TiM directory. In parallel, messages are sent to the Error Logger if the functionality is activated from the graphical interface.

Typical error message:
None

Data outputs:
To visualize the slow monitoring data sent by TiServer, type "dataDisplay" and read the files in /data/trenddata.

Documentation:
/virgoApp/Ti/.../doc/TimingSystem.ps

Description:
FbfX are the Fast Frame Builders that collects data from the front-end readouts. Depending of the origin of the data, different Fbf processes are concerned:

   FbfSusp collects the data sent through DOL by suspension system and send them under frame format to FbmSusp, through Ethernet network.
   FbfInj collects the data sent through DOL by injection system and send them under frame format to FbmSusp.

   FbfDet collects the data sent through DOL by detection system and send them under frame format to FbmDet.
   FbfDetP collects the data sent through DOL by detection system (crate C28) and send them under frame format to FbmDet.
   FbfNe collects the data sent through DOL by North End detection and suspension systems and send frames to FbmDet and FbmSusp.
   FbfWe collects the data sent through DOL by West End detection and suspension systems and send frames to FbmDet and FbmSusp.

   FbfMoniCb collects the data from ADCs (Central Building env. monitoring) and send them under frame format to FbmMoni.
   FbfMoniMc collects the data from ADCs (Mode Cleaner Building env. monitoring) and send them under frame format to FbmMoni.
   FbfMoniNe collects the data from ADCs (North End Building env. monitoring) and send them under frame format to FbmMoni.
   FbfMoniWe collects the data from ADCs (West End Building env. monitoring) and send them under frame format to FbmMoni.

The following procedure applies to FbfSusp but is valuable for the other Fast Frame Builders.

Process:
FbfServer.exe  Version (see introduction)  Machines: (see table 1)   Account: daq

Data Base / Configuration file:
The use of database is not activated. The configuration files used are in /virgoData/Fbf and are defined in the file /virgoData/DAQ/ClDaqCollect.cfg

Check:
On the ClDaqCollect graphical interface, in the "FbfX" status line, the last displayed message should be something like:
        fr:03445 (1340.326 KB)  [0/4]
with FR# incremented regularly and a green color on the two buttons of this line.
If some slow monitoring station is lost, its name should appear in the status line.

Start:
To start FbfX, use the ClDaqCollect interface on ax11. Choose "start" in the FbfX right button menu.

Stop:
To stop the process, choose "stop" in the FbfX right button menu.

Specific actions:
"config" in the right button menu: edit the configuration file.
"display server status" in the left button menu: show informations about the process, include the rio CPU where it runs.

Error Logger / Log file:
Errors messages and warnings are  put in a log file in the /virgoLog/Fbf directory. In parallel, messages are sent to the Error Logger if the functionality is activated from the graphical interface.

Typical error message:
None

Data outputs:
To visualize some of the data sent by FbfSusp, you can type for instance dataDisplay and connect to FbmSuspUsers.

Documentation:
None

Description:
At every TiServer interrupt, this server asks for data to the Slow Monitoring Stations. It then collects the data sent by them and send frames to FbmMoni, through Ethernet network. Current Slow Monitoring Stations are:

• for FbsMoni: Laser diode status (LaDiode).
• for FbsSusp: temperatures and humidity in Central building (BcServer_x). Suspensions LVDTs (Sa_Server_xx).
• for FbsDet: local oscillators Lo25, Lo72, Lo82, Lo34a, Lo34b. Vbias voltages Vb25, Vb72, Vb82. Shutters status Sr25.
• for FbsSt: temperatures, pressures and valves state in each suspension's tower (To_xx). Vacuum status in North and West tubes (Tu_xx)

Data Base / Configuration file:
The use of database is not activated. The configuration files used are in /virgoData/Fbs and are defined in the file /virgoData/DAQ/ClDaqCollect.cfg

Check:
On the ClDaqCollect graphical interface, in the "FbsX" status line, the last displayed message should be something like:
        fr:20214 (9.265 KB) GPS:738059861
with fr and GTimeS incremented regularly and a green color on the two buttons of this line.
If some slow monitoring station is lost, its name should appear in the status line.

Start:
To start FbsMoni, use the ClDaqCollect interface on ax11. Choose "start" in the FbsX right button menu.

Stop:
To stop the process, choose "stop" in the FbsX right button menu.

Specific actions:
"config" in the right button menu: edit the configuration file.

Error Logger / Log file:
Errors messages and warnings are  put in a log file in the /virgoLog/Fbs directory. In parallel, messages are sent to the Error Logger if the functionality is activated from the graphical interface.

Typical error message:
None

Data outputs:
To visualize the slow monitoring data sent by FbsX, type "dataDisplay" and read the files in /data/trenddata.

Documentation:
None

Description:
This server is the producer part of the Main Frame Builder. It collects the frames sent by the sources present in the DAQ line and merge them. The resulting frames are written in a shared memory, ready to be distributed on the Ethernet network.

Process:
Fbm.exe  Version: (see introduction)  Machine: (see table 1)   Account: daq

Data Base / Configuration file:
The use of database is not activated. The configuration files used are in /virgoData/Fbm and are defined in the file /virgoData/DAQ/ClDaqCollect.cfg

Check:
On the ClDaqCollect graphical interface, in the "FbmX" status line, the last displayed message should be something like:
        fr:20255 (0.85 MB) GPS:738059902  adc:144 sms:20
with fr and GPS incremented regularly and a green color on the two buttons of this line.
If some source of frames is lost, its name should appear in the status line.

Start:
To start FbmX, use the ClDaqCollect interface on ax11. Choose "start" in the FbmX right button menu.

Stop:
To stop the process, choose "stop" in the FbmX right button menu.

Specific actions:
"config" on the right button menu: edit the configuration file.

Error Logger / Log file:
Errors messages and warnings are  put in a log file in the /virgoLog/Fbm directory. In parallel, messages are sent to the Error Logger if the functionality is activated from the graphical interface.

Typical error message:
If starting FbmMoni, you get the message "Shm segment problem when recreating it: key=...",
then, using the command "ipcs" on the daq1 workstation, you can check the shared memory
segment segment ID and "ipcrm -m ID" to delete the shared memory segment.
Then, restart FbmMoni. If it does not start, call the expert.

Data outputs:
To visualize the data sent by FbmX, type "dataDisplay", choose "Read From Cm server" in the Input Menu and click on "FbmXUsers".

Documentation:
/virgoApp/Fbm/.../doc/FbmDoc.ps

Description:
This server is the consumer part of a Main Frame Builder. It reads frames in shared memory and sends them on the Ethernet network.
We describe here the consumers for X=Main. Same procedure applies for X=Moni, Susp or Det if you replace "Main" by "Moni", "Susp" or "Det" in the text.
Y=Csm1, St, DM: this is an important consumer. It has the same process priority on the machine as the producer.
Y=Raw, RawBack : this consumer sends frames to a process (Raw or RawBack) that writes data on disk.
Y=Shift  : this consumer allows only connections from some predefinite dataDisplay
Y=Users, Dy : this consumer is for online connections (8 connections maximum)

Process:
FdCsm.exe  Version: (see introduction)  Machine: (see table 1)   Account: daq

Data Base / Configuration file:
The use of database is not activated. The configuration files used are in /virgoData/Fbm
and are defined in /virgoData/DAQ, in the files ClDaqCollect.cfg and ClDaqData.cfg

Check:
On the ClDaqCollect graphical interface, in the "StRaw" status line, the last displayed message should be something like:
      fr:20253 (1.36 MB) GPS:738059901 adc:397 sms:40 out:1 (FdWRaw  (1393.647 kB))
with fr and GPS incremented regularly and a green color on the two buttons of this line.
The names between parenthesis (like FdWRaw) are the outputs to which the consumer sends frames (each followed by the size
of the frames in kiloBytes).

Start:
To start StRaw, use the ClDaqCollect interface on ax11. Choose "start" in the StRaw right button menu.

Stop:
To stop the process, choose "stop" in the StRaw right button menu.

Specific actions:
"config" on the right button menu: edit the configuration file.

Error Logger / Log file:
Errors messages and warnings are  put in a log file in the /virgoLog/Fbm/Csm directory. In parallel, messages are sent to the Error Logger if the functionality is activated from the graphical interface.

Typical error message:
If the corresponding producer FbmX is not present anymore, the message on status line becomes
     no shared memory
until the producer restarts. Then, the consumer should reconnect automatically to the rebuilt shared memory segment.

Data outputs:
To visualize the data sent by FbmStRaw, type "dataDisplay" and read the files in /data/rawdata.

Documentation:
/virgoApp/Fd/.../doc/FdDoc.ps

Description:
This server is the trend frame builder. It collects the frames produced by the producer FbmMain and sent by the consumer FbmMainTrend. From each channel of those frames, it computes trend data (min, max, mean and rms computed over each frame) and produces trend frames of 30 mn each, written on disk in the directory /data/trenddata.

Process:
Fbt.exe   Version: (see introduction)  Machine: (see table 1)  Account: daq

Data Base / Configuration file:
The use of database is not activated. The configuration file is /virgoData/Fbt/FbtMain.cfg

Check:
On the ClDaqData graphical interface, in the "FbtMain" status line, the last displayed message should be something like:
        fr:20253 (1.36 MB) GPS: 73805900  2182 trend channels; latency=4s; 0 frames in the output buffer
with fr and GPS incremented regularly and a green color on the two buttons of this line.

Start:
To start FbtMain, use the ClDaqData interface on ax11. Choose "start" in the "Trend" right button menu.

Stop:
To stop the process, choose "stop" in the "Trend" right button menu.

Specific actions:
"config" on the right button menu: edit the configuration file.

Error Logger / Log file:
Errors messages and warnings are put in a log file in /virgoLog/Fbt directory. In parallel, messages are sent to the Error Logger if the functionality is activated from the graphical interface.

Typical error message:
None

Data outputs:
To visualize the trend data sent by FbtMain, type "dataDisplay" and read the files in /data/trenddata.

Documentation:
/virgoApp/Fbt/.../doc/Fbt.pdf

Description:
This server is the consumer part of the Main Frame Builder dedicated to the resampling of data at 50 Hz.

Process:
Fbt50.exe  Version: (see introduction)  Machine: (see table 1)  Account: daq

Data Base / Configuration file:
The use of database is not activated. The configuration files used are in /virgoData/Fbt50
and are defined in the file /virgoData/DAQ/ClDaqData.cfg

Check:
On the ClDaqData graphical interface, in the "Fbt50X" status line, the last displayed message should be something like:
        fr20213  (0.86 MB)  GPS:738059899  (Input=0.011s Process=0.002s Output=0.012s)
with fr and GPS incremented regularly and a green color on the two buttons of this line.

Start:
To start Fbt50X, use the ClDaqData interface on ax11. Choose "start" in the Fbt50X right button menu.

Stop:
To stop the process, choose "stop" in the Fbt50X right button menu.

Specific actions:
"config" on the right button menu: edit the configuration file.

Error Logger / Log file:
Errors messages and warnings are put in a log file in the /virgoLog/Fbt50 directory. In parallel, messages are sent to the Error Logger if the functionality is activated from the graphical interface.

Typical error message:
None

Data outputs:
To visualize the data sent by Fbt50X, type "dataDisplay" and read the files in /data/50Hz.

Documentation:
/virgoApp/Fbt50/.../doc/Fbt50.pdf

Description:
This server is a Main Frame Builder producer dedicated to the collection of the data resampled at 50 Hz. It merges the frames received from Fbt50Moni, Fbt50Susp and Fbt50Det. The resulting frames are sent by a dedicated consumer (Fbt50CsmW) to a process that writes them on disk: Fbt50Write.

Process:
Fbm.exe  Version: (see introduction)  Machine: (see table 1)  Account: daq

Data Base / Configuration file:
The use of database is not activated. The configuration file is /virgoData/Fbt50/Fbt50Fb.cfg

Check:
On the ClDaqData graphical interface, in the "Fbt50Fb" status line, the last displayed message should be something like:
        fr20254  (0.27 MB) GPS:738059901  adc:568  sms:56
with FR and gps incremented regularly and a green color on the two buttons of this line.
If some source of frames Fbt50Moni, Fbt50Susp or Fbt50Det is lost, its name should appear in the status line.

Start:
To start Fbm, use the ClDaqData interface on ax11. Choose "start" in the Fbt50Fb right button menu.

Stop:
To stop the process, choose "stop" in the Fbt50Fb right button menu.

Specific actions:
"config" on the right button menu: edit the configuration file.

Error Logger / Log file:
Errors messages and warnings are put in a log file in the /virgoLog/Fbt50 directory. In parallel, messages are sent to the Error Logger if the functionality is activated from the graphical interface.

Typical error message:
If starting Fbt50Fb, you get the message "Shm segment problem when recreating it: key=...",
then, using the command "ipcs" on the daq1 workstation, you can check the shared memory
segment segment ID and "ipcrm -m ID" to delete the shared memory segment.
Then, restart Fbt50Fb. If it does not start, call the expert.

Data outputs:
To visualize the data sent by Fbt50Fb, type "dataDisplay" and read the files in /data/50Hz.

Documentation:
/virgoApp/Fbm/.../doc/FbmDoc.ps

Description:
This server is the process that writes the 50Hz data on disk.

Process:
Fbt50.exe  Version: (see introduction)  Machine: (see table 1)  Account: daq

Data Base / Configuration file:
The use of database is not activated. The configuration file is: /virgoData/Fbt50/Fbt50Write.cfg

Check:
On the ClDaqData graphical interface, in the "Fbt50Write" status line, the last displayed message should be something like:
        fr20252  (0.27 MB)  GPS:738059899  (Input=0.011s Process=0.002s Output=0.012s)
with fr and GPS incremented regularly and a green color on the two buttons of this line.

Start:
To start Fbt50Write, use the ClDaqData interface on ax11. Choose "start" in the Fbt50Write right button menu.

Stop:
To stop the process, choose "stop" in the Fbt50Write right button menu.

Specific actions:
"config" on the right button menu: edit the configuration file.

Error Logger / Log file:
Errors messages and warnings are put in a log file in the /virgoLog/Fbt50 directory. In parallel, messages are sent to the Error Logger if the functionality is activated from the graphical interface.

Typical error message:
None

Data outputs:
To visualize the data written by Fbt50Write, type "dataDisplay" and read the files in /data/50Hz.

Documentation:
/virgoApp/Fbt50/.../doc/Fbt50.pdf

5.9 FdWX  (X=Raw , RawBack)

Description:
This server is the process that writes the raw data (or the backup raw data) on disk.

Process:
FdW.exe  Version: (see introduction)  Machine: (see table 1)  Account: daq

Data Base / Configuration file:
The use of database is not activated. The configuration file is: /virgoData/FdW/FdWX.cfg

Check:
On the ClDaqCollect graphical interface, in the "FdWX" status line, the last displayed message should be something like:
        fr:00679 (3.50 MB) latency:6s   File:/storage/st12/v1/data/DAQ/rawdata/V-757953300-12-Jan-2004-15h35-300F.gwf
with fr incremented regularly and a green color on the two buttons of this line.

Start:
To start FdWX, use the ClDaqCollect interface on ax11. Choose "start" in the FdWX right button menu.

Stop:
To stop the process, choose "stop" in the FdWX right button menu.

Specific actions:
"config" on the right button menu: edit the configuration file.

Error Logger / Log file:
Errors messages and warnings are put in a log file in the /virgoLog/FdW directory. In parallel, messages are sent to the Error Logger if the functionality is activated from the graphical interface.

Typical error message:
None

Data outputs:
To visualize the data written by FdWRaw, type "dataDisplay" and read the files in /data/rawdata.

Documentation:
/virgoApp/FdW/.../doc/FdWDoc.html

5.10 FmX  (X=Raw, RawBack, 50Hz, Trend)

Description:
This server is the process that monitors the frames written on disk and update the ffl (frame files list) files in /virgoData/ffl

Process:
Fm.exe  Version: (see introduction)  Machine: (see table 1)  Account: daq

Data Base / Configuration file:
The use of database is not activated. The configuration file is: /virgoData/Fm/FmX.cfg

Check:
On the ClDaqData graphical interface, in the "FmX" status line, the last displayed message should have a file name terminated by
        NOT_YET_CLOSED
and a green color on the two buttons of this line.

Start:
To start FmX, use the ClDaqData interface on ax11. Choose "start" in the FmX right button menu.

Stop:
To stop the process, choose "stop" in the FmX right button menu.

Specific actions:
"config" on the right button menu: edit the configuration file.

Error Logger / Log file:
Errors messages and warnings are put in a log file in the directory /virgoLog/Fm. In parallel, messages are sent to the Error Logger if the functionality is activated from the graphical interface.

Typical error message:
None

Data outputs:
Updated ffl file is in /virgoData/ffl: raw.ffl, 50Hz.ffl or trend.ffl

Documentation:
None
 

Premilinary remark: any start and stop of a DAQ should be done from the graphical client.

A priori, no order is required to start the DAQ servers, except the Master Timing that must be present first (like for instance the Cm Name Server). However, here is a recommanded procedure for Start and Stop of DAQ that allows to have always frames containing all the data channels at the data storage level. Into brackets [ ] are the steps stopping or starting not really DAQ processes.

6.1  DAQ Stop Procedure:

1. Stop the data storage processes: FdWRaw, FdWRawBack, Fbt50Write, FbtMain
2. Stop the consumers dedicated to data storage: FbmStRaw, FbmStRawBack, Fbt50CsmW
3.    [Stop the Slow Monitoring Stations]
4.    [Stop the front-end readouts (Pr, Qr, Gx, suspension servers...) (be sure that suspension's control loops have been opened before!)]
5. Stop the Fast Frame Builders and Slow Frame Builders.
6. Stop the Main Frame Builders producers FbmMain, FbmSt and FbmDM, Fbt50Fb
7. Stop the local Main Frame Builders consumers (including Fbt50Moni, Fbt50Susp and Fbt50Det)
8. Stop the local Main Frame Builders producers FbmMoni, FbmSusp and FbmDet
9. Stop the Timing Server if needed.
10. Switch off the crates if needed (C11, C12, C17, C16, C14, C39, C61, C75, C85)

1. Switch on the crates if needed (C11, C12, C17, C16, C14, C39, C61, C75, C85)
2. Start the Timing Server if needed (caution: if TiServer crate was off, remove first all the files /virgoData/Ti/Tixx)
3. Start the local Main Frame Builders producers FbmMoni, FbmSusp and FbmDet
4. Start the Main Frame Builders producers FbmMain, FbmSt, FbmDM, Fbt50Fb
5. Start the local Main Frame Builders consumers (including Fbt50Moni, Fbt50Susp and Fbt50Det)
6.    [Start the Slow Monitoring Stations]
7. Start the Fast Frame Builders and Slow Frame Builders
8.    [Start the front-end readouts (Pr, Qr, Gx, suspension servers...)]
9. Start consumers dedicated to data storage: FbmStRaw, FbmStRawBack, Fbt50CsmW
10. Start the data storage processes: FdWRaw, FdWRawBack, Fbt50Write, FbtMain

L. Fournier, A. Masserot, B. Mours, D. Verkindt

• Crates contents on Jan. 28th 2003: http://lappweb06.in2p3.fr/virgo/sDoc/CrateContent.html
• DAQ architecture and software components (to be updated): http://lappweb06.in2p3.fr/virgo/daqManual/daqComponents.html
• DAQ description at Real Time conference, May 2003
• VIR-MAN-LAP-5400-114 (signal names list on Sept. 12th 2002): http://wwwcascina.virgo.infn.it/commissioning/signalsNames
• VIR-MAN-LAP-5400-110  (Data Acquisition: Schemes, Signals and Frames (to be updated))
• Frame format documentation: /virgoApp/Fr/v6r09/doc/T970130-F-E.pdf
• Frame library documentation:  /virgoApp/Fr/v6r09/doc/FrDoc.html  or  /virgoApp/Fr/v6r09/doc/FrDoc.pdf

man <command>: to get usage and informations about the Unix command <command>.

cm names : to get the current list of Cm names.

cm connects | grep Shift : to get the current list of Cm connections with only the lines containing the string "Shift".

cm cleanup toto : to remove the name "toto" from the Cm names list (works only if the associated server is not running).

ipcs : to get the list of shared memory segments created. First column gives the ID of the segment. [OSF1, Linux]

ipcrm -m <ID> : to delete a shared memory segment identified by ID. Use with caution! [OSF1, Linux]

ps -axF : to get, on RIO cpu, the list of running processes and associated file descriptors. [LynxOS]

ps -ef : to get, on Alpha workstations, the list of running processes. [OSF1, Linux]

kill -n <ID> : to kill a process identified by ID. n=2 is like Ctrl-C, n=3 is recommended. n=9 must be used only if nothing else works. The ID of the process is given in the first column of "ps -ef".

top : to get the list of active processes with cpu and memory consomption. [OSF1, Linux]

gps : to get the current GPS time from the Timing Server.
 

online utilities:  (only for experts or for regular operators in control room)

FdStat:  (from /virgoApp/Fd)
This tool can be used to survey the output of a Frame Builder (to be used for instance on consumer FbmMainUsers) It gives you some statistical informations about the channels you asked for when connecting to the Frame Builder.
Just type "FdStat" to know the usage.
Example:  FdStat   FbmMainUsers  "Pr_B1p_DC  Gx_MC*   Bs*  Em*"

FbmStat:  (from /virgoApp/Fbm)
This tool can be used to survey the coherency of the frames content at the output of a Fbm consumer. For each frame read, a status line is printed. For instance:
    "fbmstat 19 Jul 2001: from FbmMainUsers : 13 frames  0 errors : fr16254 run2398 (3.098MB)[Thu Jul 19 12:28:35 2001] 392 adc 19 sms"
It says that Cm name of the FbmStat server was "fbmstat", that last data was taken on July 19, 2001, coming from FbmMainUsers. Since start, 13 frames have been received and 0 error detected. Last frame received is frame 16254 from run 2398. Its size is 3.098 MBytes, its GPS time is July 19, 2001 12h28mn35s, it contains data from 392 ADC channels and 19 Slow Monitoring Stations. Each frame read is compared both to a reference frame and to the previous frame read. If any change is detected in the size of the frame, the frame number, the run number, the GPS time, the number of adc
channels, etc... a message is shown. For instance:

Error in this frame:
                       (Error )   (nerr/ntot) : frNbr  frRun  frSize      frDt  frGPSTime  nAdc  nSms  nFB :_______date_______:____sender____: FbList
Current:     ( nAdc )(0002/0002) : 16746  2398  3237272  1.00  679581388   0369    0019     000 : 19 Jul 2001 (14:39:44) : FbmMainUsers :
Previous:    ( nAdc )(0002/0002) : 16745 2398  3239154  1.00  679581387   0392    0019     000 : 19 Jul 2001 (14:39:44) : FbmMainUsers :
Reference: ( nAdc )(0002/0002) : 16621  2398  3246041  1.00  679581263   0392    0019     000 : 19 Jul 2001 (14:39:44) : FbmMainUsers :

It shows the parameters for the current, the previous and the reference frame. You can see here that the type of error is "nAdc" (number of adc channels has changed from 392 to 369) and that this is the 2nd error of this type over 2 errors of all types.
Just type FbmStat to know the usage.
Example:  FbmStat  FbmMainUsers

FdShmSpy:  (from /virgoApp/Fd)  (to be used only if needed!).
To get the current content of a Main Frame Builder shared memory. It shows especially the reading position of each Consumer and the writing position of the Producer in the shared memory. To use it, you must be on the machine where the Producer is running.
Just type FdShmSpy to know the usage.
Example:  FdShmSpy  FbmMain

dataDisplay: (from /virgoApp/Dy)
It can be used to monitor data channels with various plots (1D, 2D, time, spectra, transfert function, etc...). It can be used to display online rawdata or to display offline raw data, 50Hz data and trend data. A configuration file can be used as first parameter. Such a configuration file (named dd.car) is produced each time you push the Start button.
Documentation is in /virgoApp/Dy/v9r03/doc/DyDoc.ps.
Example:  dataDisplay  /virgoData/Dy/NI_align.car
 

offline utilities:

FrDump:  (from /virgoApp/Fr)
Dump the content of a set of frames files.
Just type FrDump to know the usage.
Example:  FrDump -i "file1 file2 file3" -t "Pr_B1p_DC Gx_MC*" -d 3

FrCopy:  (from /virgoApp/Fr)
Copy some channels of some frames from a set of frames files to an output file.
Just type FrCopy to know the usage.
Example:  FrCopy -i "file1 file2 file3" -o outputFile -t "Pr_B1p_DC Gx_MC*"

FdSim:  (from /virgoApp/Fd)    (online usage is reserved to expert)
It simulates a Frame Builder by sending frames on the Ethernet network or writing frames on disk. Generated adc channels , sms channels or proc channels can contains various type of data (zeros, gaussian noise, sinusoide, noise+sinusoide, Nan...), according to the parameters on the command line
Just type FBSim to know the usage.

Example 1:  FdSim  TestedServer  200000  1
(FdSim sends to TestedServer, frames of 200 kB containing 3 adc channels, each containing gaussian noise).

Example 2:  FdSim Fbmtest 0 1 -adc 1000 140 -sms 15 40 -cmname sender1
(FdSim sends frames to Fbmtest. Each frame contains 140 adc channels with sampling frequency of 1000 Hz and 40 sms containing 5 variables each. Data values are just gaussian noise. Cm name of the FBSim process is "sender1").
 

The following logic has been adopted for the DAQ system: it is composed of pieces connected through Ethernet network and exchanging frames through Cm connections, called "static connection" which defined a priori in the configuration of the server sending the frames. In this case, the server try to send frames to the predefined outputs even if they are not present (visible by the Cm Name Server). Any Frame Builder server (especially the Main Frame Builders consumers) has also the ability to receive a request from a process (dataDisplay, FdStat, FdWrite, etc...) through the network and to provide the frames to the requesters. This is called the "dynamical connection". Several requesters can be connected to a given frame builder.

In practice, only authorized persons will have the possibility to connect directly to Fast Frame Builders or dedicated Main Frame Builder consumers. Only operators in shift (people who need to look at data online for alignment and control of the interferometer) are allowed to connect directly at the output of a Main Frame Builder consumer using the online utilities like the dataDisplay.
The table below shows, for each Main Frame Builder consumer, what is the mandatory Cm name of the requester:
 

For offline users, retrieving data must be done from the ffl files present in /virgoData/ffl:

/virgoData/ffl/raw.ffl

/virgoData/ffl/50Hz.ffl

/virgoData/ffl/trend.ffl

• /data/rawdata
• /data/50Hz
• /data/trenddata

• ADC: Analogic to Digital Converter
• BS: Beam Splitter suspension
• CPU: Central Processing Unit (processor used)
• DAQ: Data acquisition
• DaqDet : DAQ line dedicated to the Detection Bench
• DaqMoni : DAQ line dedicated to the Monitoring information
• DaqSusp : DAQ line dedicated to the Suspensions, Alignment and Global control Systems
• OB: Output Bench (detection)
• EB: End Bench (detection)
• DOL: Digital Optical Link
• Fbm : Main Frame Builder
• Fbs : Slow Frame Builder
• Fbf : Fast Frame Builder
• Fbt : Trend Frame Builder
• Fbt50 : Resampler at 50Hz
• GC : Global Control
• GPS : Global Positioning System
• GxS : Galaxy Server (camera readout)
• IB: Input Bench
• NB: North Bench (at the end of north arm)
• NI: North Input suspension
• Pr : Photodiodes Readout
• PR: Power Recycling suspension
• Qr : QuadrantPhotodiodes Readout
• SMS : Slow Monitoring Station
• WB: West Bench (at the end of west arm)
• WI: West Input suspension