[project proposal] Resource Management
Dear All,
I have submitted a Project Proposal for the Resource Management requirements for your review. Find it here:
https://wiki.opnfv.org/requirements_projects/resource_management
This has been introduced in the first F2F TSC/Tech community meeting. It is about reserving resources for future use, capacity management of resource pool.
Best regards,
Ashiq
---------------------------------------------------
Ashiq Khan
ICT Network Cloud Research Group
Research Labs, DOCOMO R&D Center
3-6 Hikarino-oka, Yokosuka-shi
Kanagawa 239-8536, JAPAN
TEL: +81 46 840 3131
---------------------------------------------------
Dear All,
I have submitted a Project Proposal for the Resource Management requirements for your review. Find it here:
https://wiki.opnfv.org/requirements_projects/resource_management
This has been introduced in the first F2F TSC/Tech community meeting. It is about reserving resources for future use, capacity management of resource pool.
Best regards,
Ashiq
---------------------------------------------------
Ashiq Khan
ICT Network Cloud Research Group
Research Labs, DOCOMO R&D Center
3-6 Hikarino-oka, Yokosuka-shi
Kanagawa 239-8536, JAPAN
TEL: +81 46 840 3131
---------------------------------------------------
_______________________________________________
opnfv-tech-discuss mailing list
opnfv-tech-discuss@...
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
Thanks,
Peter Lee
Hi Ashiq,Just finished reviewing the wiki entry and I have a few questions, if you don't mind.1) It's implied that you'll want to reserve storage resources too, but not necessarily stated as one of the deliverables of this project. I'm assuming it is in fact a deliverable. Is this so?
2) Assuming reserving the storage is desired, are you "pre-provisioning" that storage for use by the VM reservation? If the answer is yes, then you're going to deal with an issue of overallocation, which I would presume you might want to avoid. If you're looking to dynamically allocate then there should be some assumption regarding time constraints for creation of the volume, whether or not you care about persisting any state, data, etc., associated with this volume or whether you simply wish to have it bolster the VM and then just do a destroy and a removal of the volume.
3) Are you expecting to use file-based volumes? Or are block-based ones good enough?
I suspect you're going to want to provision RBD (RADOS Block Devices) on the fly due to the previous decision to utilize Ceph for the underlying physical storage. And assuming we've got some type of VNFC image (VM image containing OS and any other required software), I would hope these are sitting on top of LVM volumes on top of these block devices. This will allow us to potentially avoid timely copies of volumes such as via "dd" for a local clone of a volume.
However, if you're expecting that source images will sit on one system and that these time-sensitive volumes will be created on remote systems, then copying sparse file-based volumes may be a better idea.
Anyway, just some things to consider as you begin to dig in deeper.
Best,MikeOn Fri, Oct 17, 2014 at 3:10 AM, Ashiq Khan <khan@...> wrote:Dear All,
I have submitted a Project Proposal for the Resource Management requirements for your review. Find it here:
https://wiki.opnfv.org/requirements_projects/resource_management
This has been introduced in the first F2F TSC/Tech community meeting. It is about reserving resources for future use, capacity management of resource pool.
Best regards,
Ashiq
---------------------------------------------------
Ashiq Khan
ICT Network Cloud Research Group
Research Labs, DOCOMO R&D Center
3-6 Hikarino-oka, Yokosuka-shi
Kanagawa 239-8536, JAPAN
TEL: +81 46 840 3131
---------------------------------------------------
_______________________________________________
opnfv-tech-discuss mailing list
opnfv-tech-discuss@...
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
_______________________________________________
opnfv-tech-discuss mailing list
opnfv-tech-discuss@...
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
Hi Mike,
Thanks for your queries. I know that you know storage very well and your insight on this is much appreciated.
Peter gave a comprehensive reply. I’ll only add few issues inline:
Sent: Saturday, October 18, 2014 2:39 AM
To: Mike Young
Cc: Ashiq Khan; opnfv-tech-discuss@...
Subject: Re: [opnfv-tech-discuss] [project proposal] Resource Management
Hi Mike,
Thanks for reviewing our proposal and providing your considerations.
My comments inline below.
Thanks,
Peter Lee
Chief Technology Officer
ClearPath Networks
310.955.5060
On Oct 17, 2014, at 6:42 AM, "Mike Young" <myoung@...> wrote:
Hi Ashiq,
Just finished reviewing the wiki entry and I have a few questions, if you don't mind.
1) It's implied that you'll want to reserve storage resources too, but not necessarily stated as one of the deliverables of this project. I'm assuming it is in fact a deliverable. Is this so?
Yes we are including storage reservations as one of the functional deliverables of this project.
(AK) Storage is included, as well as network resources. Compute, Storage and Network resource reservation shall be included in the deliverables.
2) Assuming reserving the storage is desired, are you "pre-provisioning" that storage for use by the VM reservation? If the answer is yes, then you're going to deal with an issue of overallocation, which I would presume you might want to avoid. If you're looking to dynamically allocate then there should be some assumption regarding time constraints for creation of the volume, whether or not you care about persisting any state, data, etc., associated with this volume or whether you simply wish to have it bolster the VM and then just do a destroy and a removal of the volume.
Our initial approach to resource reservation will be utilizing the currently available quota extensions on Nova, Cinder, and Neutron. Essentially, the quota limits on a per project/tenant will represent available capacity across each of the infrastructure resource elements configured into a resource pool.
There will not be "pre-allocation" of resources since the reservation system will not be shelving VMs or such but instead applying time based capacity availability models to make decisions regarding future availability of resource capacities.
As to storage, we will be modeling based on gigabytes, snapshots, and volumes. Any additional resource elements will require upstream contribution to Cinder to introduce additional quota elements.
(AK) There could be multiple ways to realize “reserving storage resources for the future”, e.g. overprovisioning which is not the smartest way, but easiest, as the first step. What is important from the requirement point of view is, I receive a particular amount of resources at a particular time. Nevertheless, yes, I would want to avoid it if a smarter, dynamic solution is available.
3) Are you expecting to use file-based volumes? Or are block-based ones good enough?
We are currently sticking with block based but open to consider other models.
I suspect you're going to want to provision RBD (RADOS Block Devices) on the fly due to the previous decision to utilize Ceph for the underlying physical storage. And assuming we've got some type of VNFC image (VM image containing OS and any other required software), I would hope these are sitting on top of LVM volumes on top of these block devices. This will allow us to potentially avoid timely copies of volumes such as via "dd" for a local clone of a volume.
Currently, the actual allocation/provisioning of such resources is out-of-scope of the resource reservation service, the reservation service does not implicitly make or provision or allocate the instances (VMs or volumes, etc) but rather the higher layer NFVO or VNFM would actually perform their needed allocation operations based on a successful reservation ID to begin consuming them according to the start-time defined for the reservation.
Basically, the reservation service informs that reserved resources have been preserved for use (say 100GB between X time and Y time) and the consumer of that reservation will decide how they go about using it (say 3 volumes each 25GB) if and when they decide to use it within the specified reservation validity period.
However, if you're expecting that source images will sit on one system and that these time-sensitive volumes will be created on remote systems, then copying sparse file-based volumes may be a better idea.
I think these are important considerations for the actual provisioner of reserved resources to ensure timely availability operations can be ensured when they need it. We can think of reservation service as providing "check-in" time and "check-out" time (like booking a hotel room) but the person needing to use the actual reserved room should be mindful of how long it will take to get to the room and use it for their needs.
For example:
If the actual volumes need to be created, filled with snapshot data, and brought online for use by a given VM by X time, we can consider the reservation service request to specify the start time as X - 10 mins and the requestor of reservation can start the prep work once the reservation window opens and makes sure things are allocated accordingly before time X.
Anyway, just some things to consider as you begin to dig in deeper.
We really appreciate your inputs. We are currently mapping out the technical specs capturing the implementation models. We'd be happy to share our approach as we refine them to ensure we take into account other considerations we fail to take into account for the community at large.
Best,
Mike
On Fri, Oct 17, 2014 at 3:10 AM, Ashiq Khan <khan@...> wrote:
Dear All,
I have submitted a Project Proposal for the Resource Management requirements for your review. Find it here:
https://wiki.opnfv.org/requirements_projects/resource_management
This has been introduced in the first F2F TSC/Tech community meeting. It is about reserving resources for future use, capacity management of resource pool.
Best regards,
Ashiq
---------------------------------------------------
Ashiq Khan
ICT Network Cloud Research Group
Research Labs, DOCOMO R&D Center
3-6 Hikarino-oka, Yokosuka-shi
Kanagawa 239-8536, JAPAN
TEL: +81 46 840 3131
---------------------------------------------------
_______________________________________________
opnfv-tech-discuss mailing list
opnfv-tech-discuss@...
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
_______________________________________________
opnfv-tech-discuss mailing list
opnfv-tech-discuss@...
https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss