Bug #3829

Memory Leak in onehost update

Added by Michael Schmidt over 3 years ago. Updated over 3 years ago.

Status:ClosedStart date:06/08/2015
Priority:NormalDue date:
Assignee:-% Done:

0%

Category:Core & System
Target version:Release 4.14
Resolution:fixed Pull request:
Affected Versions:OpenNebula 4.10

Description

We have a script that regularly (once per minute) updates a number of attributes of our virtualization hosts through the xmlrpc API. Since we started running the script, oned starts accumulating as much memory as it can get over the time. This behaviour can be reproduced by updating a single host multiple times via the "onehost update" command using a simple static template.txt file which just has a number of "KEY = VALUE" pairs in it.

Steps to reproduce:
- Download test_update.sh and template.txt to an opennebula server
- Execute test_update.sh as user oneadmin and pass a host ID as a single commandline parameter (e.g. "./test_update.sh 7")
- Watch increasing amount of memory used by oned process while script executes 100 onehost update commands

The bug was observed on a OpenNebula 4.10.2 installation. Running this script once increases memory usage by approx. 4MB on our server. Running it once per minute for 20 hosts means approx. 80MB memory leak / minute, which is a severe issue for our installation.

test_update.sh Magnifier (82 Bytes) Michael Schmidt, 06/08/2015 01:15 PM

template.txt Magnifier (2.72 KB) Michael Schmidt, 06/08/2015 01:15 PM

History

#1 Updated by Ruben S. Montero over 3 years ago

  • Category set to Core & System
  • Target version set to Release 4.14

We'll take a look thanks

#2 Updated by Michael Schmidt over 3 years ago

Have you been able to find the problem already and is there any chance of having a bugfix release of OpenNebula 4.12 for this? It's a pretty serious issue for us. If you need help investigating, we can try to debug the code ourselfes and submit a patch for the leak.

#3 Updated by Robert Waffen over 3 years ago

Hello folks,

only wanted to say, that Michael is a colleague of mine and we are looking forward to hear from you. this bug is really urgent for us.

thanks in adavnce! =)

#4 Updated by Gerald Schmidt over 3 years ago

There was a missing delete in src/pool/PoolObjectSQL.cc.

Pull request: https://github.com/OpenNebula/one/pull/59

#5 Updated by Ruben S. Montero over 3 years ago

  • Status changed from Pending to Closed
  • Resolution set to fixed

Merged! Thanks

#6 Updated by Gerald Schmidt over 3 years ago

Thanks for merging! Are there plans for a 4.12 release that incorporates the patch? We're upgrading to 4.12 at the moment and would prefer to use an official release.

#7 Updated by Ruben S. Montero over 3 years ago

Right now, we are focusing on getting 4.14 in shape, so that will come first.

Also available in: Atom PDF