|
Replies:
13
-
Pages:
1
-
Last Post:
Oct 27, 2008 12:46 PM
Last Post By: Shay Hassidim
|
|
|
Posts:
35
Registered:
6/22/08
|
|
|
|
Has anybody used the Amazon EC2?
Posted:
Aug 4, 2008 11:47 AM
|
|
|
|
Has anybody used the Amazon EC2 with XAP?
|
|
Posts:
3
Registered:
12/13/07
|
|
|
|
Re: Has anybody used the Amazon EC2?
Posted:
Aug 4, 2008 12:35 PM
in response to: Francis O.
|
|
|
Yes, we have several customers using us on EC2 for various use-cases.
One of our public use-cases is a company called BazuMedia, they are doing Real time tracking, messaging, and scoring for global athletic events.
They are using GigaSpaces on EC2 to increase and reduce processing/memory requirements as needed during peak/off-peak times.
In addition they leveraging our out-of-the-box self-healing/fail-over capabilities to control their data-intensive SLAs on EC2.
You are welcome to watch a live demo and a presentation of BazuMedia in a joint webinar we did with them and Amazon, recording available here http://www.gigaspaces.com/resource/webcasts.
In addition you are welcome to read more at our EC2 portal - http://www.gigaspaces.com/ec2
Edited by: dekel crownadmin on Aug 4, 2008 12:36 PM |
|
Posts:
53
Registered:
3/8/08
|
|
|
|
Re: Has anybody used the Amazon EC2?
Posted:
Aug 4, 2008 1:34 PM
in response to: Francis O.
|
|
|
|
Absolutely, we are. We manage large amounts of data and processing for athletic events (marathons, triathlons).
Cloud computing resolves infrastructure problems in its own way, but also opens doors to different sort of issues. Traditional applications and middleware is mostly not capable of running in a dynamically configured infrastructure environment, where servers go down and up and configuration changes at runtime. We tried to do this before GigaSpaces and our biggest obstacle was the relational database. Most HA tools for RDBMS are not developed to run in such environments and require a resilient static infrastructure. In such cases, although you can develop a truly scalable application that doesn't rely on static semantics, you're still stuck with a SPOF when it comes to persisting the data. There are other way of accomplishing distributed in-memory data store, but in our search, no one does it quite a good as GigaSpaces yet. We really don't have to worry about nodes going down due to unexpected failures or planned scale-downs or bringing them back up when system load requires. GigaSpaces has a declarative way and easy deployment modes to handle these scenarios. You can still persist data to a relational db behind the scenes, but the traditional RDBMS's lack of scalability/availability will not bring down the application cluster. One way to persist is as a part of a master/worker pattern and though any failures in persistence can be queued until the persistence mechanism comes back up. You're application though, works on real-time/in-memory data structure and has access to a partitioned or replicated distributed object store.
Ilya Sterin
BazuMedia
Edited by: Ilya Sterin on Aug 5, 2008 10:15 AM
|
|
Posts:
35
Registered:
6/22/08
|
|
|
|
Re: Has anybody used the Amazon EC2?
Posted:
Aug 5, 2008 11:52 AM
in response to: Ilya Sterin
|
|
|
|
thank you for your reply - this sounds really good! Am looking forward to experiment this myself.
If you don't mind guys I have a few more questions for the group about EC2 and this particular use case
1/ what sort of update rate does your system generate?
For the system we are building, we are talking about a particular object type that has 15,000 instances in the cache, each of these which could be updated up to twice a second. i.e. 30,000 update per seconds max. On the back of this, we (will) have processing units monitoring these update and taking an action.
Does that sound achievable / realistic firstly for XAP and secondly for the EC2 infrasttructure.
2/ What OS does the Gigaspace Image on EC2 uses (windows?, linux?)
3/ How reliable have you found the Amazon infrastructure is?
Regards,
Francis
Edited by: Francis O. on Aug 5, 2008 11:55 AM
Edited by: Francis O. on Aug 6, 2008 6:25 AM
|
|
Posts:
2,174
Registered:
12/13/07
|
|
|
|
Re: Has anybody used the Amazon EC2?
Posted:
Aug 5, 2008 1:57 PM
in response to: Francis O.
|
|
|
|
For all Gigaspaces EC2 users:
We are working on our next generation EC2 integration.
This will be available soon. It will include transparent EC2 deployment flow and "desktop on the cloud" user experience.
This will be ready in few weeks.
Shay
|
|
Posts:
2,174
Registered:
12/13/07
|
|
|
|
Re: Has anybody used the Amazon EC2?
Posted:
Aug 5, 2008 2:57 PM
in response to: Francis O.
|
|
|
|
Francis,
For 30K updates/sec u will need few spaces. In average a space running with a backup will be able to perform 2K-5K updates/sec for a single client. This scales until CPU is fully utilized. So you might need 6-15 partitions to handle such load - depends with the amount of concurrent users and object size. Read operations are much faster.
If u need more details about the space capacity let me know. I can send u our benchmark report.
The Gigaspaces AMI using linux (there is no windows based AMI). For the next AMI release , we plan to provide one with debian and another with RH.
Shay
|
|
Posts:
35
Registered:
6/22/08
|
|
|
|
Re: Has anybody used the Amazon EC2?
Posted:
Aug 6, 2008 6:34 AM
in response to: Shay Hassidim
|
|
|
|
Hi Shay - please could you send me the benchmark report?
Also, is this benchmark valid for the Amazon EC2?
Francis
Edited by: Francis O. on Aug 6, 2008 6:34 AM
|
|
Posts:
35
Registered:
6/22/08
|
|
|
|
Re: Has anybody used the Amazon EC2?
Posted:
Aug 6, 2008 6:37 AM
in response to: Ilya Sterin
|
|
|
|
Hi Ilya - In your EC2 use case where is your RDBMS hosted?
Thanks
Francis
Edited by: Francis O. on Aug 6, 2008 6:38 AM
|
|
Posts:
2,174
Registered:
12/13/07
|
|
|
|
Re: Has anybody used the Amazon EC2?
Posted:
Aug 6, 2008 8:23 AM
in response to: Francis O.
|
|
|
|
Sure. I will contact you off line.
The benchmark is very relevant for EC2. In fact we will have soon dedicated benchmark report for EC2 based applications. This will use our new EC2 tools.
Shay
|
|
Posts:
53
Registered:
3/8/08
|
|
|
|
Re: Has anybody used the Amazon EC2?
Posted:
Aug 7, 2008 2:18 PM
in response to: Francis O.
|
|
|
|
Francis, our database was initially hosted on one of our own collocated boxes (very low throughput and memory capacity), we then moved it to a large ec2 instance (just one instance) with backups to s3. In our case, we didn't much care about database performance, since our data was no access through the database in real time. All the data access is happening through the space layer. There is a service provider that populates the space with persistent data during startup and that data is used for reads. We opted, and stupidly so, not to use read/write through for that, but you should definitely use it. It will basically preload and cache persistent data as you specify. The data that we write/update in the space stays there. Any writes that we want to perform to the db, get their own persistent objects written into the space and we have a persistence worker (service) that picks them up and persists them. Because our application's functionality doesn't rely on the performance of the db, we don't really care much about any bottlenecks, since we don't have a requirements of persisting any changes right away. You're use case may vary and you might have to scale the db more than we had to, but if you can architect your application to work through space objects as its sole source of reading/writing information, then you can worry less about your database scalability/performance.
GigaSpaces and Space-based architectures in general are very flexible and there is truly no single way of doing things. The biggest goal is to reduce your dependence on disk based persistence, which is the biggest bottleneck in most high throughput applications, even as you horizontally scale your data processing.
Ilya
|
|
Posts:
1
Registered:
8/7/08
|
|
|
|
Re: Has anybody used the Amazon EC2?
Posted:
Aug 7, 2008 10:22 PM
in response to: Francis O.
|
|
|
|
Actually, we at Miwok Airways are another customer that have been using GigaSpaces with Amazon EC2 for quite a while, developing our Online Reservation system that allows our future customers to book on-demand air-travel at economy class prices plus additional travel services, such as rentals cars, cabs or hotels and conference rooms. We will launch soon, so we can provide more in-depth details on our implementation at that time.
Veit
|
|
Posts:
24
Registered:
2/27/08
|
|
|
Posts:
2,174
Registered:
12/13/07
|
|
|
Posts:
2,174
Registered:
12/13/07
|
|
|
|
Re: Has anybody used the Amazon EC2?
Posted:
Oct 27, 2008 12:46 PM
in response to: Francis O.
|
|
|
See:
http://snipurl.com/4qxks
Miwok Airways Selects GigaSpaces for Its On-Demand Flight System in the "Clouds"
Combined With the Amazon Elastic Compute Cloud, GigaSpaces Provides Scalable, High-Performance Platform for Company's Online Booking System
Shay |
|
|
Legend
|
|
GigaMaster: 100
- 999
pts
|
|
Advanced: 11
- 99
pts
|
|
Beginner: 1
- 10
pts
|
|
Just Visiting: 0
- 0
pts
|
|
Helpful Answer
|
|
Correct Answer
|
|
GigaSpaces.com | Help | Search 
