Thursday, March 26, 2015

Issues with surface data

Yesterday morning, the data connection to our two surface stations died.  The stations are up. "bao" is archiving data locally, however the local disk on "ehs" appears to have died as well, so we are losing data from it.

In trying to fix this problem, a command on "flux" failed so that we have lost the network connection to it as well and thus cannot view its status or data.  We physically visited flux and verified that it was archiving data from the tower, but even rebooting failed to restore the network connection.

In summary:
- tower data probably are being archived
- bao surface station data are being archived
- ehs surface station data are not being archived
- real-time monitoring of everything is not working

I'll try to fix this, but I don't know what action to take at this point and both "experts" are out of town...

4pm update:
After tracking down several server issues and replacing a USB stick, all data are now coming in.  I'm pretty sure that some data were lost during the past 2 days -- I'll try to generate an inventory after the 00Z updates happen tonight.

11pm update:
After all this, the tower and bao surface data have been recovered.  We lost as much as 2 days of ehs complete high-rate data, though perhaps half of that will be filled in.  The data resynchronization and associated plots are still in process, and hopefully will be done by midnight.

9am (3/27) update:
All data and plots are now up to date.  There is a gap of about 28 hours in ehs.

No comments:

Post a Comment