Automatic Cross-Server File Storage

**Wistow** · 02-06-2005, 09:52

Hi

I am currently creating a custom image hosting website and would appreciate your input regarding cross-server file storage. I know these types of sites eat bandwidth and take up lots of storage space, so I was looking at implementing a feature where the site could be run over a few servers instead of just one.

If I decided to go with this option, what would be the easiest way to implement it using php? How would I be able to build it into the admin panel where when a new server is needed, I can just add it into the admin panel and set it up there, and images/files are automatically shared between the servers available so as not to overcrowd any of the servers?

Thanks in advance,

Craig

**robertall** · 02-06-2005, 09:55

http://celerondude.com/index.php?a=s&id=1

I recommend the above is you do not yet have a script for the image hosting, i would recommend contacting lewisbeech as he has a free hosting, and i am currently hosting my site on it.

**Wistow** · 02-06-2005, 10:13

Hi

I am creating a custom script, that means I am starting from scratch and coding the script myself.

This is why I need input regarding the cross-server file storage problem.

Craig

**robertall** · 02-06-2005, 10:21

My site is planning to hold images, and i know what you mean by the space, it used up too much bandwidth on robertall.com, so i redirected the site tempory during this time. I would personally not bother to be honest, too much effort, and people take advantage of it as well. That is what happened to 30x30.org in the past...

**Wistow** · 02-06-2005, 10:47

Yeah but as I am creating the script from scratch, I can add features that can curb abuse, such as a BW quota for each member, and when a members pic is shown it uses some of their BW quota, then when their BW quota is used up their images will not show, but a message will instead. The user will then have the chance to upgrade their membership.

Craig

**robertall** · 02-06-2005, 10:48

Yes, but what i am trying to explain is that there are loads of free image hosts out there, and why will they pay for image hosting when they can get it free?

**Wistow** · 02-06-2005, 10:56

They can have it free with my site, but once their free quota runs out they can choose to upgrade, or just wait until 'next month' when their quota renews.

I will also be integrating features into the site that are very useful and very convenient, but more on that later

Craig

**monaghan** · 02-06-2005, 11:25

Assuming you have the servers in the same DC, then why not NFS mount disks from other servers. You can often share bandwidth allocation between servers, alternatively round-robin the DNS and have the script on all the servers.

Depending on where you have the servers, the DC will probably allow a private network using your own hub and 2nd network ports in the server, so any server to server traffic would be "free".

Feel free to shout if you need consultancy

SirJinX · 02-06-2005, 11:40

Not sure if it's good or not,
but what about using ftp to upload files to a server. and then it randomly uploads to one?
or first file goes to server one, 2nd file server 2, 3rd file server, then 4th file back to the first server... or as many servers as you have.

**Wistow** · 02-06-2005, 11:50

Thanks for the replies.
I was thinking of ftp but is it secure?

Craig

02-06-2005, 09:52	#1 (permalink)
Wistow Moderator Join Date: Mar 2005 Location: Barnsley, UK Posts: 1,001 iTrader: 0 / 0%	Automatic Cross-Server File Storage Hi I am currently creating a custom image hosting website and would appreciate your input regarding cross-server file storage. I know these types of sites eat bandwidth and take up lots of storage space, so I was looking at implementing a feature where the site could be run over a few servers instead of just one. If I decided to go with this option, what would be the easiest way to implement it using php? How would I be able to build it into the admin panel where when a new server is needed, I can just add it into the admin panel and set it up there, and images/files are automatically shared between the servers available so as not to overcrowd any of the servers? Thanks in advance, Craig __________________ Webmaster Forum - Online Auctions - Free Traffic

02-06-2005, 09:55	#2 (permalink)
robertall Moderator Join Date: Jan 2005 Location: post is there >> Posts: 1,586 iTrader: 0 / 0%	http://celerondude.com/index.php?a=s&id=1 I recommend the above is you do not yet have a script for the image hosting, i would recommend contacting lewisbeech as he has a free hosting, and i am currently hosting my site on it. __________________ Free .org domain - Click for details! Do not pm asking for things. My inbox is full. Add me to MSN!

02-06-2005, 10:13	#3 (permalink)
Wistow Moderator Join Date: Mar 2005 Location: Barnsley, UK Posts: 1,001 iTrader: 0 / 0%	Hi I am creating a custom script, that means I am starting from scratch and coding the script myself. This is why I need input regarding the cross-server file storage problem. Craig __________________ Webmaster Forum - Online Auctions - Free Traffic

02-06-2005, 10:21	#4 (permalink)
robertall Moderator Join Date: Jan 2005 Location: post is there >> Posts: 1,586 iTrader: 0 / 0%	My site is planning to hold images, and i know what you mean by the space, it used up too much bandwidth on robertall.com, so i redirected the site tempory during this time. I would personally not bother to be honest, too much effort, and people take advantage of it as well. That is what happened to 30x30.org in the past... __________________ Free .org domain - Click for details! Do not pm asking for things. My inbox is full. Add me to MSN!

02-06-2005, 10:47	#5 (permalink)
Wistow Moderator Join Date: Mar 2005 Location: Barnsley, UK Posts: 1,001 iTrader: 0 / 0%	Yeah but as I am creating the script from scratch, I can add features that can curb abuse, such as a BW quota for each member, and when a members pic is shown it uses some of their BW quota, then when their BW quota is used up their images will not show, but a message will instead. The user will then have the chance to upgrade their membership. Craig __________________ Webmaster Forum - Online Auctions - Free Traffic

02-06-2005, 10:48	#6 (permalink)
robertall Moderator Join Date: Jan 2005 Location: post is there >> Posts: 1,586 iTrader: 0 / 0%	Yes, but what i am trying to explain is that there are loads of free image hosts out there, and why will they pay for image hosting when they can get it free? __________________ Free .org domain - Click for details! Do not pm asking for things. My inbox is full. Add me to MSN!

02-06-2005, 10:56	#7 (permalink)
Wistow Moderator Join Date: Mar 2005 Location: Barnsley, UK Posts: 1,001 iTrader: 0 / 0%	They can have it free with my site, but once their free quota runs out they can choose to upgrade, or just wait until 'next month' when their quota renews. I will also be integrating features into the site that are very useful and very convenient, but more on that later Craig __________________ Webmaster Forum - Online Auctions - Free Traffic

02-06-2005, 11:25	#8 (permalink)
monaghan Super Moderator Join Date: Mar 2005 Location: Herts, UK Posts: 1,030 iTrader: 1 / 100%	Assuming you have the servers in the same DC, then why not NFS mount disks from other servers. You can often share bandwidth allocation between servers, alternatively round-robin the DNS and have the script on all the servers. Depending on where you have the servers, the DC will probably allow a private network using your own hub and 2nd network ports in the server, so any server to server traffic would be "free". Feel free to shout if you need consultancy __________________ Alex Monaghan - Monaghan Consultants Ltd Web hosting, ADSL, IT & Database consultancy Custom Web hosting on UK or USA servers using Linux (cPanel) or Windows (DotNetPanel) Mobile Phone Ringtones, Logos, Java Games & more

02-06-2005, 11:40	#9 (permalink)
SirJinX WMT Addict Join Date: Apr 2005 Posts: 128 iTrader: 0 / 0%	Not sure if it's good or not, but what about using ftp to upload files to a server. and then it randomly uploads to one? or first file goes to server one, 2nd file server 2, 3rd file server, then 4th file back to the first server... or as many servers as you have.

02-06-2005, 11:50	#10 (permalink)
Wistow Moderator Join Date: Mar 2005 Location: Barnsley, UK Posts: 1,001 iTrader: 0 / 0%	Thanks for the replies. I was thinking of ftp but is it secure? Craig __________________ Webmaster Forum - Online Auctions - Free Traffic

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Considering UK Server - any interest in joining me ?	monaghan	Hosting Forum	4	19-10-2007 07:09
Automatic Links...	thecthulhu	Php and MySQL	0	02-08-2006 02:21
CGI Permissions - 500 Internal Server Error	wwfc_barmy_army	Programming / Scripting / Coding	11	23-05-2006 10:21
Automatic RSS Feeds Submitter	squeege	Ads, Offers & Services	0	30-01-2006 20:15
Anyone running their own server ?	monaghan	Hosting Forum	5	11-09-2005 20:02

Automatic Cross-Server File Storage

Automatic Cross-Server File Storage

Similar Threads