2018-05-08 Server Memory Probe, 5000 Space Rockets

Details about updates to Shores of Hazeron

2018-05-08 Server Memory Probe, 5000 Space Rockets

Postby Haxus » Tue May 08, 2018 2:57 pm

Server Memory Probe
Servers are consume a lot of memory. They are getting killed by the OS for hitting the wall.

Developed a memory probe to report memory consumption by every single object that persists in memory. Fingers are crossed that some problem will be revealed by this, one that can be fixed without too much pain (for me or anybody else).

5000 Space Rockets
An aircraft factory was causing huge lag in the dark grim city East Aniwbourne.

Fixed a bug that affected aircraft factories that parked space rockets in space vehicle parking spots. The check to see if the parking spot was occupied was failing when a space rocket was parked there. This allowed the factory to stack about 5000 space rockets on top of each other there, and of course consume the materials needed to manufacture them.

The excess space rockets were deleted.
User avatar
Haxus
Site Admin
 
Posts: 3030
Joined: Fri Jan 14, 2011 8:00 pm

Re: 2018-05-08 Server Memory Probe

Postby Haxus » Tue May 08, 2018 5:02 pm

We may have gotten lucky here.

Memory appears to be leaking when old designs get loaded that were saved before their data was compressed. It seems the uncompress routine may be leaking memory when the data isn't actually compressed.

  • Servers were shutdown.
  • Database was backed up.
  • All building and spacecraft designs were loaded and resaved, with data compression.
    • 1,580 Spacecraft Designs Updated
    • 776 Building Designs Updated
  • Servers were restarted.
We'll see how things look when the servers finish loading.
User avatar
Haxus
Site Admin
 
Posts: 3030
Joined: Fri Jan 14, 2011 8:00 pm

Re: 2018-05-08 Server Memory Probe

Postby Ikkir Isth » Tue May 08, 2018 5:58 pm

Eww, thats gotta be a nasty leak.
Making things with OpenGL: Image
Working on- an exploration game.
@Ikkir_Isth
User avatar
Ikkir Isth
 
Posts: 2416
Joined: Fri Jan 14, 2011 9:22 pm

Re: 2018-05-08 Server Memory Probe

Postby Haxus » Tue May 08, 2018 6:04 pm

Prior to the update, the most loaded server after the last restart was using just over 11GB of memory, several others were in the 6Gb to 8Gb range.

After the servers restarted, only two of them are using more than 5GB. Many are in the 2GB - 3GB range.
User avatar
Haxus
Site Admin
 
Posts: 3030
Joined: Fri Jan 14, 2011 8:00 pm

Re: 2018-05-08 Server Memory Probe

Postby AnrDaemon » Tue May 08, 2018 6:06 pm

Nice. Now, to find the cause for the leak, and we can sleep knowing that the bug is extinct.
Yak. Yak never changes.
AnrDaemon
 
Posts: 7572
Joined: Wed Jun 15, 2011 5:37 pm

Re: 2018-05-08 Server Memory Probe

Postby Haxus » Tue May 08, 2018 6:12 pm

The cause was running the uncompress routine on invalid data. There was no way for me to identify if the data was already compressed or not. I was relying on the failure of uncompress to indicate that. I don't know if it would be considered a bug since I was feeding it bad data.

All those fields are compressed now so the problem only affected older building and spacecraft designs, saved before I started compressing them. It should not be an issue any more.
User avatar
Haxus
Site Admin
 
Posts: 3030
Joined: Fri Jan 14, 2011 8:00 pm

Re: 2018-05-08 Server Memory Probe, 5000 Space Rockets

Postby Vectorus » Thu May 10, 2018 11:27 am

I think grading may not be working as it's supposed to.

Trying to grade away from a natural area, without scrolling the mousewheel at all, produces the message "too high above virgin terrain." I believe this is more limiting than old-style slabs, which was not intended?
User avatar
Vectorus
 
Posts: 184
Joined: Sat Mar 03, 2012 10:21 am

Re: 2018-05-08 Server Memory Probe, 5000 Space Rockets

Postby Deantwo » Thu May 10, 2018 11:50 am

Vectorus wrote:I think grading may not be working as it's supposed to.

Trying to grade away from a natural area, without scrolling the mousewheel at all, produces the message "too high above virgin terrain." I believe this is more limiting than old-style slabs, which was not intended?

Both ends of the grading has to land on valid ground according to what Haxus had last time you asked.
viewtopic.php?f=125&t=9566#p102847
Haxus wrote:the terrain grading limit only applies to the end points of the road segment. You could still carve a valley through a mountain or make a land bridge across an ocean.
AnrDaemon is the solution to the [s]Fermi Paradox[/s] Hazeron suggestion flood problem, the great suggestion filter.
User avatar
Deantwo
 
Posts: 5162
Joined: Fri Jan 25, 2013 4:38 am
Location: Rævehale

Re: 2018-05-08 Server Memory Probe, 5000 Space Rockets

Postby Vectorus » Thu May 10, 2018 1:56 pm

Ah yes, thanks - I misunderstood that somehow. I thought it meant you could use the scroll wheel at both ends only up to a certain level, but otherwise it would work as with the old slab grade; i.e. it didn't check if you didn't scroll. Not sure why I was thinking that.

So it is indeed more restrictive than I had thought.
User avatar
Vectorus
 
Posts: 184
Joined: Sat Mar 03, 2012 10:21 am

Re: 2018-05-08 Server Memory Probe, 5000 Space Rockets

Postby Haxus » Thu May 10, 2018 5:04 pm

I plan to change it so the limit is +100m above the highest virgin terrain on the planet and -100m below the lowest virgin terrain on the planet. Was busy working on a different problem for the last few days.
User avatar
Haxus
Site Admin
 
Posts: 3030
Joined: Fri Jan 14, 2011 8:00 pm


Return to Updates

Who is online

Users browsing this forum: No registered users and 1 guest