DasSkelett[m] has joined #spacedock
<
DasSkelett[m]>
SpaceDock having problems again
VITAS[m] has joined #spacedock
<
VITAS[m]>
youre sure?
<
VITAS[m]>
i can reach an resolve it
<
DasSkelett[m]>
Up again 🤷♂️
<
VITAS[m]>
so it lost its dns entry for like 2min?
<
VITAS[m]>
how can that be?
<
DasSkelett[m]>
I conincided exactly with CKAN's bot trying to fetch the download counts:
<
VITAS[m]>
hmm ok no idea what could have caused that
<
VITAS[m]>
ill look into it if it happens again
<
VITAS[m]>
thx for notifying me
<
DasSkelett[m]>
I think the same error also happened once last week.
<
DasSkelett[m]>
Weird thing
<
VITAS[m]>
im running my own nameserver so if dns isnt chached it might actualy happen but the secondary ns is hosted by my domain provider
<
DasSkelett[m]>
It's the rev proxy trying to resolve the hostname of sd1 and failing for whatever reason.
<
VITAS[m]>
what rev proxy
<
VITAS[m]>
apache or traffic server?
<
VITAS[m]>
i restarted traffic server
<
VITAS[m]>
lets see if that solves stuff
<
DasSkelett[m]>
The 52k logo was shown, next to it the error text I posted. That should be the traffic server
<
VITAS[m]>
then its trafficserver not beeing able to contact apache/python on sd1
<
VITAS[m]>
lets see if restarting traffic server helped its swap space usage was high
<
VITAS[m]>
that cause io delays
<
DasSkelett[m]>
Seems to be working fine right now
DasSkelett[m] has quit [Quit: Idle timeout reached: 10800s]
VITAS[m] has quit [Quit: Idle timeout reached: 10800s]
DasSkelett[m] has joined #spacedock
<
DasSkelett[m]>
Uploads are not working currently, a 500 is returned.
VITAS[m] has joined #spacedock
<
VITAS[m]>
checking
<
VITAS[m]>
example link?
<
VITAS[m]>
because i randomly dl something and that worked
<
DasSkelett[m]>
upload, not download 😉
<
DasSkelett[m]>
A bit hard to see, because nothing happens on the frontend, but you can see that the upload POST is a 500 in the browser console.
<
DasSkelett[m]>
I'm also looking into why the error is not displayed as it should.
<
VITAS[m]>
ill reboot sd1 sec
<
VITAS[m]>
i had the problem of the cloud storage mount switching to readonly for no reason in the past
<
VITAS[m]>
try again
<
DasSkelett[m]>
Working 🎉
<
VITAS[m]>
my suspicion is that they move the storage arround their servers and every time smb gets confused and goes into emergency read only mode
<
VITAS[m]>
because it fails to write for a while
<
DasSkelett[m]>
Well, now it's entirely down 😦
<
VITAS[m]>
im running update
<
DasSkelett[m]>
Ah okay
<
VITAS[m]>
but it should ask before taking things down
<
VITAS[m]>
was a bit stubborn and wouldnt want to start without kicking
<
VITAS[m]>
time to sleep
<
DasSkelett[m]>
Yep, working again. Have a good night 😴