Forum Activity for @dannya

s3 and conversion server

Jamroom Developers

Also, as far as storage, it is far easier to support the API's of multiple storage providers. Even if you just support AWS and Google storage, they can be used by anybody on any server on any host.

I've worked for 4 of the top ten media platforms and CDNs. Right now the competition between AWS, Google, Rackspace, and Akamai is making it very hard for anyone else to compete on hosting; especially storage and BW. And the compute competition is between Google and Amazon is heating up. Nobody can reach their economies of scale.

s3 and conversion server

Jamroom Developers

A couple of things:
- A 2GB reserved instance on AWS is only about $13.00/month.
- Even if I deployed, 1 app server, 1 rds server, I'd still be paying less per month. (which i currently do). This is enough for an MVP
- Granted, VPS does give you a bunch of free bandwidth initially, however that is just bait that they use to lure you in. After that the pricing does not scale and you will quickly be eaten up in bw and storage costs.
- Beyond the 9 TB transfer, you are stuck at a $100/TB. While AWS can go as low as $10/TB (once you are at massive scale). VPS is 10x more expensive at scale. Bandwidth is by far the biggest cost and the biggest impact on margin.
- Storage is even worse. VPS gives you 40 GB to start. But from there they charge a whopping $.40/GB. AWS starts at $.03 and goes down. That's 13X times more expensive. As soon as you hit those 40GB, you're screwed.


I understand where you are coming from with a simple entry level hosting provider. It keeps things simple and works well for many of your customers.

However, I am building FOR scale. I am not trying to deploy an app but building a PLATFORM; I am providing a service, not a store. My customers are high volume users. Once the API's are deployed, I need to be able to scale. Migrating to a different provider when you NEED to scale is tremendously difficult and expensive. I would rather pay a little bit more now than have to deal with that later.

That being said, I DO agree with your scaling plan. However, as you so clearly laid out, it is dependent on your cloud modules, and eventually, the FS. I am ready to deploy separate servers for conversion, logging, and storage. S3 makes more sense for me because I'm on aws, but I understand why you would want to allow your users other options.

Storage and conversion are my top priority, because those 2 things force me to scale up my application server more quickly. If I can separate those 2 things, a small app server can handle many more users. With s3 I would never have to scale the server for storage. And with the conversion server, if I can set it up to autoscale and spin up addtitional servers in a cluster as demand dictates, I will only pay for what I use as well.
updated by @dannya: 12/02/14 02:14:52PM

s3 and conversion server

Jamroom Developers

Open to suggestions. But haven't found anything with the same breadth of services and scale. Storage, CDN, Transcoding, RDS, all on one service. Compute might be expensive, but storage and delivery is very competitive.

If you release the conversion server, it might be cheaper to do the transcoding somewhere else. And maybe with your file system implementation I could find cheaper storage. But add delivery and cdn and things get more expensive; not to mention perofmance impact making requests to multiple service providers.

Like I said. Open to suggestions, but the numbers need to make sense
updated by @dannya: 12/02/14 10:31:38AM

s3 and conversion server

Jamroom Developers

I'm more confused than ever.
#1- "
I'm not in the office this week so really cannot get it into a state where it can be shared. I'm also hesitant to "release" something that I can't support, but I'll see what I can do when I get back. "
I assume you are referring to conversion server.

#2- My immediate concern for using s3 are unrelated to HA, scalability or file system selection.

I am already using EC2 for core application and my data is being stored in EBS. This forces me to pay for more expensinve EBS and larger instances than i need. It also does not make sense to use another vendor for storage as it will be more expensive; I would have to pay more for transfer and there would probably be a performance hit to staying in the amazon cloud.

I guess maybe i don't understand where s3 fuse fits in rather than using the s2 api's directly.

s3 and conversion server

Jamroom Developers

Can you provide any update on the expected release of the conversion server discussed here:
https://www.jamroom.net/the-jamroom-network/forum/my_posts/14788/conversion-server-details

Also, you mentioned you had an s3 module partially developed for images that i might be able to use for audio in this thread:
https://www.jamroom.net/the-jamroom-network/forum/my_posts/14728/feature-updates-s3-ha

Can you share that?
updated by @dannya: 02/09/15 08:19:17PM

Disable social sharing

Installation and Configuration

Oneall module- Is there a way to disable social sharing and only use social login?
updated by @dannya: 12/27/14 04:31:33PM

Are notifications unique to a profile or an account?

Jamroom Developers

So is there a way to have the notify_user event call a custom PROFILE_notify function? Basically i would like to have my own profile notify function so I can store all my notification preferences at the profile level. I'm happy to write our own module for this.

My question is how we make sure the existing modules use my custom notifications? How can we modify the esiting notify_user event without breaking our module every time we update jamroom or any modules with notifications?


updated by @dannya: 11/18/14 09:25:49PM

Are notifications unique to a profile or an account?

Jamroom Developers

So Brian, is there an event we can call to modify the notification functionality to our needs without breaking notifications for other modules?

Installing the Proxima Bundle

Proxima

"There is no documentation at this time since there's been very little interest in it (although we have no advertised it at all). "

FWIW, I am very interested in it but would need to know how I can add api's for my own modules or it would be a non starter. On the bright side, I don't think I'll be able to get to it until Janurary. If you plan on creating any documentation my 2 top priorities would be:

-How to add CRUD operations to tables in custom modules
-How to use the file management service to ingest media and, more importantly, metadata packages which trigger media ingest.
updated by @dannya: 12/29/14 09:23:55AM

Are notifications unique to a profile or an account?

Jamroom Developers

Agree to disagree. However, curious as to how many users are using the power user functionality effectively.