Thread 'News on Project Outages'

Message boards : Projects : News on Project Outages
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 7 · 8 · 9 · 10 · 11 · Next

AuthorMessage
ProfileGary Charpentier
Avatar

Send message
Joined: 23 Feb 08
Posts: 2492
United States
Message 46497 - Posted: 29 Nov 2012, 20:36:08 UTC

Seti is still coming back up after the power outage that also took BOINC offline this AM. PST
ID: 46497 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 46498 - Posted: 30 Nov 2012, 2:45:50 UTC - in response to Message 46497.  

It doesn't look good -- looks like whatever they were using for UPS support failed as well for an ugly crash.


"Power to the north east side of the Berkeley campus and the Space Science Lab was interruped this morning at about 16:30 UTC until about 17:30. The cause of the outage has not yet been determined. We're working to get our databased back in working order. We don't yet have an ETA for when the BOINC server will be back online."


Seti is still coming back up after the power outage that also took BOINC offline this AM. PST
ID: 46498 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 46499 - Posted: 30 Nov 2012, 2:46:27 UTC - in response to Message 46492.  

Nope, they had some form of an outage -- last I saw, there was no discussion of the issue.


Am I the only one with problems reaching Rosetta?

Can't upload, get new work, report, or go to the main page.

ID: 46499 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 46500 - Posted: 30 Nov 2012, 2:47:43 UTC - in response to Message 46490.  

Moowrap is back -- third time -- and yet again, there is no discussion regarding the outage.


Moowrap came back up late Sunday night, no explanation, no user comment. It went back down again early Wednesday morning -- no explanation. Still offline. I suspect best approach is to suspend process, and set no new work. When it does come back up (I'm hopeful that happens), I'll let my existing work upload and report and process existing queues, but let things drain out until the folks back at the project can provide some idea of what we can expect in the coming weeks.



Moowrap has been down -- no access to home page since early Saturday -- perhaps we will see it live during the coming week.


ID: 46500 · Report as offensive
[CSF] Thomas H.V. Dupont

Send message
Joined: 30 May 12
Posts: 356
France
Message 46501 - Posted: 30 Nov 2012, 6:43:19 UTC

Does anyone have more information on the restarting of the SETI@home project after the blackout on the Berkeley Campus ?
BOINC servers are restarted but why not those of SETI@home ?
THX
ID: 46501 · Report as offensive
ProfileJord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 15558
Netherlands
Message 46504 - Posted: 30 Nov 2012, 7:25:56 UTC - in response to Message 46501.  

BOINC servers are restarted but why not those of SETI@home ?

Do you think that restarting a server is as easy as you restarting your PC?

As it isn't. First off, these things work with large RAID arrays and at least one JBOD which have to be resynced, second there's a good chance that (parts of) the database have been corrupted, so they'll have to check those. Especially when the power flipped off very much unexpectedly...

If they aren't back today, and there's no-one available for the weekend, just think Monday might be a nice time for them to return.
ID: 46504 · Report as offensive
[CSF] Thomas H.V. Dupont

Send message
Joined: 30 May 12
Posts: 356
France
Message 46506 - Posted: 30 Nov 2012, 7:39:34 UTC - in response to Message 46504.  

Hi Ageless,
I'm of course aware that restarting the servers takes time.
My question was purely informative and not of a critical nature.
I know that the staff has a wealth of things to check before it can be restarted safely.
I just wanted to get information on restarting because I found it curious that the BOINC servers have been restarted and not those of SETI@home.
Especially since they had discussed the matter in the brief posted on the home page of SETI@home.
You answered my questions. THX.
ID: 46506 · Report as offensive
ProfileJord
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 29 Aug 05
Posts: 15558
Netherlands
Message 46507 - Posted: 30 Nov 2012, 8:11:29 UTC - in response to Message 46506.  

.. because I found it curious that the BOINC servers have been restarted and not those of SETI@home.

There's a lot less information and traffic on the BOINC server (single, not plural. :-)) when compared to a project's servers.

The whole BOINC domain (the front page, these forums, Trac, the source code, Git) runs from one machine, which is placed in a different part of the SSL building. It no longer lives in the Seti server cabinet, but in David's office. So it's even possible that the power goes off in part of the building, affecting Seti, but not BOINC. It also runs from its own internet connection, not shared with Seti --although I do think it's shared with campus.

So yes, it's easier to restart the BOINC server, than it is to restart Seti. :)

ID: 46507 · Report as offensive
[CSF] Thomas H.V. Dupont

Send message
Joined: 30 May 12
Posts: 356
France
Message 46508 - Posted: 30 Nov 2012, 9:02:12 UTC - in response to Message 46507.  

Thanks so much Ageless for this additional information valuable.
I understand better now ! :)
And thanks for your time.
ID: 46508 · Report as offensive
pencil

Send message
Joined: 30 Nov 12
Posts: 1
Message 46509 - Posted: 30 Nov 2012, 9:48:08 UTC
Last modified: 30 Nov 2012, 9:48:26 UTC

Unscheduled Power Outage

Power to the north east side of the Berkeley campus and the Space Science Lab was interruped this morning at about 16:30 UTC until about 17:30. The cause of the outage has not yet been determined. We're working to get our databased back in working order. Current estimate is that we'll be back online on Tuesday, Dec 6. 30

Nov 2012 | 4:42:45 UTC
ID: 46509 · Report as offensive
Richard Haselgrove
Volunteer tester
Help desk expert

Send message
Joined: 5 Oct 06
Posts: 5126
United Kingdom
Message 46510 - Posted: 30 Nov 2012, 11:02:42 UTC - in response to Message 46509.  

They don't say which year. The next time December 6th falls on a Tuesday is 2016...
ID: 46510 · Report as offensive
ProfileGary Charpentier
Avatar

Send message
Joined: 23 Feb 08
Posts: 2492
United States
Message 46511 - Posted: 30 Nov 2012, 14:49:13 UTC

now we know they were hacked, the hacker looked at Nov but wrote Dec ... :)
ID: 46511 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 46512 - Posted: 30 Nov 2012, 16:55:35 UTC - in response to Message 46511.  

Perhaps the folks at the project side are a tad rattled -- the Tuesday December 6 reference suggests that possibility. It does seem that the project got caught with either non-functioning UPS in the mix, or UPS shut down software that doesn't do its job (been there, dealt with that).

This has been a seriously bad month for the SETI project -- I wonder if, when they restart next month whether we'll then see not only the mass upload/download storm (we can readily depend on that problem), but also the ongoing scheduler problems that troubled SETI for the 2 weeks up to the power outage.

ID: 46512 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 46513 - Posted: 30 Nov 2012, 16:59:28 UTC

On another note, the Malaria project site (servers and web site) are offline.
ID: 46513 · Report as offensive
Richard Haselgrove
Volunteer tester
Help desk expert

Send message
Joined: 5 Oct 06
Posts: 5126
United Kingdom
Message 46519 - Posted: 30 Nov 2012, 19:58:04 UTC

The projected SETI resumption date has been changed to "Tuesday, Dec 4."
ID: 46519 · Report as offensive
[CSF] Thomas H.V. Dupont

Send message
Joined: 30 May 12
Posts: 356
France
Message 46520 - Posted: 30 Nov 2012, 20:05:43 UTC - in response to Message 46519.  

Hi Richard,
Thanks for the info it had to be detected.
What piercing eye ! :)
ID: 46520 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 46521 - Posted: 30 Nov 2012, 20:11:49 UTC - in response to Message 46520.  

The SETI project has had more than its share of power issues - makes you wonder a bit about the Berkeley infrastructure.
ID: 46521 · Report as offensive
ProfileGary Charpentier
Avatar

Send message
Joined: 23 Feb 08
Posts: 2492
United States
Message 46526 - Posted: 1 Dec 2012, 4:10:47 UTC - in response to Message 46521.  

The SETI project has had more than its share of power issues - makes you wonder a bit about the Berkeley infrastructure.

Makes me wonder if they paid the utility bill with a California State check that bounced?

ID: 46526 · Report as offensive
BarryAZ

Send message
Joined: 4 Sep 09
Posts: 381
United States
Message 46554 - Posted: 2 Dec 2012, 16:10:23 UTC - in response to Message 46526.  
Last modified: 2 Dec 2012, 16:12:10 UTC

Makes me wonder if perhaps the first use of funds raised for them will be a functional UPS and proper shut down system -- which clearly was not in place.

As to predictions of 'return to action' -- I'm wondering if what they should do is start with pessimistic predictions -- say instead of 2 to 4 hour outage Tuesdays, describe them as 4 to 8 hours. And instead of 'return on December 4' use return on December 6. Then show up early.



Makes me wonder if they paid the utility bill with a California State check that bounced?

ID: 46554 · Report as offensive
Ralph

Send message
Joined: 30 Sep 05
Posts: 50
Message 46575 - Posted: 3 Dec 2012, 14:50:07 UTC

Again - oh, well. - and I had a weeks worth of work, too.

That's why I signed up for all the other projects.
I'll likely not notice, or sign up for any more SETI work units for quite a while again. I used to really like this project.

Bye, everyone. Merry Christmas!
ID: 46575 · Report as offensive
Previous · 1 . . . 7 · 8 · 9 · 10 · 11 · Next

Message boards : Projects : News on Project Outages

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.