Feature #3718

Get disk space usage (real and virtual)

Added by Javi Fontan over 5 years ago. Updated about 5 years ago.

Status:ClosedStart date:03/24/2015
Priority:NormalDue date:
Assignee:-% Done:

0%

Category:Drivers - VM
Target version:Release 4.14
Resolution:fixed Pull request:

Description

File based storage not always use the maximum virtual size of the disk. For example qcow2 or sparse raw files.

Create a probe that gets this information from the VM disks.


Related issues

Related to Backlog #2626: Monitor datastores IO Pending 01/12/2014
Related to Feature #2921: (Per VM) DISKIO IO information in Sunstone Closed 05/16/2014

Associated revisions

Revision 16931004
Added by Javi Fontan over 5 years ago

feature #3718: add disk usage to kvm probe

Revision b1b20071
Added by Javi Fontan over 5 years ago

feature #3718: add disk usage to xen probe

Revision 872ef3af
Added by Ruben S. Montero over 5 years ago

feature #3718: Add disk_cost, use disk_actual_size (needs to revisit)

Revision 5f1d630f
Added by Ruben S. Montero over 5 years ago

feature #3718: Rename update_info method to set_deploy_id

Revision 685a4636
Added by Ruben S. Montero over 5 years ago

feature #3718: New template for MONITORING data, it can accomodate any
data, and support the general OpenNebula Template format.

Revision 83a4165f
Added by Ruben S. Montero over 5 years ago

feature #3718: Added missing include file

Revision a6846cec
Added by Jaime Melis over 5 years ago

Feature #3718: replaces old monitoring disk attrs names with new ones

Revision dbc52ac4
Added by Jaime Melis over 5 years ago

Feature #3718: Change NET_TX, NET_RX, CPU and MEMORY for all hypervisors

Revision 29fdafa3
Added by Jaime Melis over 5 years ago

Feature #3718: Use new disk probes for Xen

Revision 9b8d8f56
Added by Jaime Melis over 5 years ago

Feature #3718: Fixes the poll attribute definition
for locally executed monitor drivers

Revision 957a48d1
Added by Jaime Melis over 5 years ago

Feature #3718: Replace NET_TX and NET_RX w/ NETTX and NETRX
in the monitorization probes for VMs

Revision 316fa03e
Added by Jaime Melis over 5 years ago

Feature #3718: Update xpaths for the new probes in onevm and oneacct

Revision fb1415a9
Added by Jaime Melis over 5 years ago

Feature #3718: Display size of disk and snapshots in onevm

Revision 471123a5
Added by Jaime Melis over 5 years ago

Feature #3718: top output has changed

Revision f165cbf9
Added by Jaime Melis over 5 years ago

Feature #3718: fix consistency for disk size output

Revision 094e8e5e
Added by Ruben S. Montero over 5 years ago

feature #3718: Compute disk total costs in showback

Revision b3cc5229
Added by Ruben S. Montero over 5 years ago

feature #3718: Updated dummy driver to new monitor names

Revision e48d1a28
Added by Jaime Melis over 5 years ago

Feature #3718: Fix dummy probe reporting for snapshot_size

Revision 14ce6f5c
Added by Jaime Melis over 5 years ago

Feature #3718: Use Monitoring data for snapshot size in cli commands

Revision 7c30cbbb
Added by Jaime Melis over 5 years ago

Feature #3718: Remove TOTAL_DISK_SIZE from the probes

Revision 979aa0d0
Added by Jaime Melis over 5 years ago

Feature #3718: remove total disk size from onevm and calculate it for oneacct

Revision 8c89226d
Added by Ruben S. Montero over 5 years ago

feature #3718: Fix wrong variable name

Revision e196fae6
Added by Carlos Martín over 5 years ago

Feature #3718: Rename oneacct TOTAL_DISK_SIZE column to DISK

Revision f5b9674f
Added by Carlos Martín over 5 years ago

Feature #3718: Update oneacct.yaml columns

Revision d94bc0e8
Added by Jaime Melis over 5 years ago

Feature #3718: disable i18n in the monitorization poll

Revision db017a47
Added by Carlos Martín over 5 years ago

Feature #3718: Move monitoring attributes in onedb upgrade

Revision 0e708328
Added by Carlos Martín over 5 years ago

Feature #3718: Update flow grammar to look for monitoring attributes

Revision 2c6f9aa1
Added by Daniel Molina over 5 years ago

feature #3718: Show MONITORING info in ovevm show
TODO: Remove CPU, MEMORY, NETTX, NETRX, DISK_SIZE from MONITORING

Revision fc5e264e
Added by Daniel Molina over 5 years ago

feature #3718: Fix external IPs path

Revision 69286039
Added by Daniel Molina over 5 years ago

feature #3718: Fix paths for monitoring graphs

Revision 71caf7ab
Added by Daniel Molina over 5 years ago

feature #3718: Fix cpu and memory monitoring in vms table

Revision 915b20ea
Added by Daniel Molina over 5 years ago

feature #3718: Show monitoring info in vm info panel

Revision a933dd53
Added by Daniel Molina over 5 years ago

feature #3718: Add Size to the disks table in the vm storage panel

Revision f350ec8e
Added by Carlos Martín over 5 years ago

Feature #3718: Implement part of the DB upgrade with oned running

Revision 3d4bfa63
Added by Jaime Melis over 5 years ago

Feature #3718: Monitor regular disk snapshots

Revision f23493d3
Added by Carlos Martín over 5 years ago

Feature #3718: Add hybrid hosts monitoring attr. to onedb upgrade files

Revision fe2e96ab
Added by Carlos Martín over 5 years ago

Feature #3718: Remove USEDCPU from monitoring docs

Revision e5eb92ee
Added by Ruben S. Montero over 5 years ago

feature #3718: Remove STATE from monitor values

Revision 5e2d0640
Added by Ruben S. Montero over 5 years ago

feature #3718: Add DISK on oned.conf comment. DISK_COST is now a restricted
attribute

Revision 368f31a0
Added by Jaime Melis over 5 years ago

Feature #3718: Add units to the onevm show disk and snapshot size columns

Revision 9e1b783b
Added by Jaime Melis over 5 years ago

Feature #3718: Clean the output of onevm show

Revision 273b3381
Added by Tino Vázquez over 5 years ago

Feature #3718: Change ESX_HOST attribute location for VNC

Revision fe07764c
Added by Jaime Melis over 5 years ago

Feature #3718: Display the monitorization info in onevm show

Revision ad1bc310
Added by Jaime Melis over 5 years ago

Feature #3718: Remove snapshots as well as main image for DS_MAD=fs

Revision 91afe375
Added by Ruben S. Montero over 5 years ago

feature #3718: Reduce monitoring info in the monitoring DB table

Revision 0ad70f21
Added by Ruben S. Montero over 5 years ago

feature #3718: Fix errors in acct with new monitor. feature #3782: Fix
acct to account for new snapshots in running. feature #3718: Reset CPU and MEMORY counters

Revision af58c689
Added by Javi Fontan over 5 years ago

feature #3718: VM disk tables width (less than 80c)

Revision dbba077f
Added by Carlos Martín about 5 years ago

Feature #3718: Scheduler takes snapshot size into account

History

#1 Updated by Javi Fontan over 5 years ago

#2 Updated by Javi Fontan over 5 years ago

  • Related to Feature #2921: (Per VM) DISKIO IO information in Sunstone added

#3 Updated by Javi Fontan over 5 years ago

  • Status changed from Pending to Closed
  • Resolution set to fixed

#4 Updated by Ruben S. Montero over 5 years ago

  • Status changed from Closed to New
  • Resolution deleted (fixed)

Needs to

  1. Implement this in vCenter Probe
  2. Include support in oned to parse the disk usage information
  3. Include this information in history records
  4. Evalute adding it to showback/accounting
  5. Add Sunstone support for viewing this metric

#5 Updated by Javi Fontan over 5 years ago

  • Status changed from New to Closed
  • Resolution set to fixed

Probes now return DISK_ACTUAL_SIZE and DISK_VIRTUAL_SIZE for file based images in KVM and Xen.

#6 Updated by Ruben S. Montero over 5 years ago

  • Status changed from Closed to New
  • Assignee deleted (Javi Fontan)
  • Resolution deleted (fixed)

#7 Updated by Ruben S. Montero over 5 years ago

Implement this for VMware

#8 Updated by Ruben S. Montero over 5 years ago

Review behavior on LVM, Ceph and DEV datastores

#9 Updated by Ruben S. Montero over 5 years ago

Commits:
#552e6a8f96cca917a191d1eab6aa872b9472e19a
#552e6a8f96cca917a191d1eab6aa872b9472e19a

Needs migrator to add <DISK_ACTUAL_SIZE> <DISK_VIRTUAL_SIZE>
Needs to update Sunstone views for accounting

#10 Updated by Ruben S. Montero over 5 years ago

Added <DISK_COST> to <SHOWBACK_RECORD> it may require migrator.
Sunstone needs DISK_COST in templates.

Currently DISK_ACTUAL_SIZE is used as a place holder, but DISK_VIRTUAL_SIZE can be used also. Moreover we need to deal with situation where snapshosts are removed within the same history record window. Probably, either add a new record (as we do for attach) or if snapshoting remains only for poweroff that will add the record.

#11 Updated by Ruben S. Montero over 5 years ago

Probes needs to use the same names, and use for known/required information:

POLL_ATTRIBUTE = {                                                                                           :usedmemory  => "USEDMEMORY",                                                                            :usedcpu     => "USEDCPU",                                                                       
:nettx => "NETTX",
:netrx => "NETRX",
:state => "STATE",
:disk_actual => "DISK_ACTUAL_SIZE", :disk_virtual=> "DISK_VIRTUAL_SIZE" }

#12 Updated by Ruben S. Montero over 5 years ago

Needs to update xsd's

Ruben S. Montero wrote:

Probes needs to use the same names, and use for known/required information:

POLL_ATTRIBUTE = { :usedmemory => "USEDMEMORY", :usedcpu => "USEDCPU",
:nettx => "NETTX",
:netrx => "NETRX",
:state => "STATE",
:disk_actual => "DISK_ACTUAL_SIZE", :disk_virtual=> "DISK_VIRTUAL_SIZE" }

#13 Updated by Jaime Melis over 5 years ago

New parameters:

DISK_SIZE = [ ID=<disk_id>, SIZE = <actual_size_in_mb> ]
SNAPSHOT_SIZE = [ ID=<snapshot_id>, DISK_ID=<disk_id>, SIZE = <actual_size_in_mb> ]
TOTAL_DISK_SIZE = <sum of the sizes of all disks and all snapshots in MB>

Use this ticket to update these VM probes too:

USEDMEMORY => MEMORY
USEDCPU => CPU

#14 Updated by Ruben S. Montero about 5 years ago

  • Status changed from New to Closed
  • Resolution set to fixed

Also available in: Atom PDF