NOTE! This site uses cookies and similar technologies.

If you not change browser settings, you agree to it.

I understand

Welcome, Guest
Username: Password: Remember me

TOPIC: 2014: A stable New Year!

2014: A stable New Year! 3 years 10 months ago #1

  • prae5
  • prae5's Avatar
  • Offline
  • Junior Boarder
  • Posts: 36
  • Thank you received: 6
  • Karma: 1

As most of you will have noticed, the last few months have been a little tough on the OpenELEC.tv site. In particular, towards the end of December we were seeing outages several times a day.

This was incredibly frustrating for us, and not the kind of user experience we aim to provide. So, sorry for any frustration and inconvenience this may have caused you all.

 

There were several reasons for this happening, but ultimately the main reason was we were a victim of our own success and had long since outgrown our current hosting setup.

We have been thinking about making a number of changes and improvements (more about this soon!) to how we do things and this was an ideal opportunity to implement some of these changes and fix the problems we were having. This wasn’t something we just wanted to jump into, so some careful thought and consideration was needed.

In order to resolve the issues we were experiencing, provide capacity for the future and also allow us a little flexibility, it was clear that we were going to need to source some new servers and look at better ways of serving some of our content.

We have been hosted and sponsored by SolNet for sometime, so naturally they were our first port of call to see what they could do to help us. Thankfully they have been amazingly helpful (as always!) and were able to offer us not one, but two new servers.

 

The initial plan was simple, to split the main web services (forum and website) onto one server and then move all downloads to the second server. This should significantly improve the reliability issues we were experiencing, as this was partly caused by us saturating our uplink.

One of the initial improvements we have implemented, is we now use a MirrorBrain system for providing downloads and updates through download mirrors. MirrorBrain allows us to automatically and transparently redirect a users download to a server that is geographically located near to them. This will not only improve users download experience by offering them faster local downloads but also helps take the strain of our main download server. We currently only have a few mirrors, but we hope to add more soon. We will be posting a follow up article on our mirror system in the near future.

If you think you can help by offering a mirror then please get in touch with me atThis email address is being protected from spambots. You need JavaScript enabled to view it.. We don’t need a huge amount of space on our mirrors, but they do require a significant amount of bandwidth. Our requirements for mirrors are that they should be on a minimum 100Mb uplink (unless you are in a region that has poor connectivity). Until we get more mirrors online, it is likely you could be pushing in the region of 100Gb per day, if you are in a region that has a high density of users. If this is something you think you can provide then please get in touch.

Since making these changes we have already noticed a significant improvement in the responsiveness of the forums and main website. Likewise you should find that downloads are significantly quicker than they were previously. Hopefully this will continue and we can revert back to providing a better overall OpenELEC experience.

I would like to take this opportunity to say a huge thank you to everyone who has put work in over the past few weeks to make this possible, in particular seo who has spent a lot of time setting up the new servers.

Once again a special thank you to SolNet for their continued support and sponsorship over the years. Finally a thank you to our current and future download mirrors, 1000mbps.com gets the title of being the first official mirror added to the new system.

To all others, thank you all for your continued interest in OpenELEC!

If you are interested in sponsoring other hardware, providing mirrors or think you might be able to offer another service that will be useful to us, then please drop me an email onThis email address is being protected from spambots. You need JavaScript enabled to view it.

Read article...
The administrator has disabled public write access.

2014: A stable New Year! 3 years 10 months ago #2

  • cityblue2001
  • cityblue2001's Avatar
  • Offline
  • Expert Boarder
  • Posts: 403
  • Thank you received: 77
  • Karma: -186
Have you thought about using a BitTorrent-style download client built in to OpenELEC for the automated download of updates? Get the MD5 from a reliable/known source (which should be a small download) but then download the main payload using the BitTorrent protocol. Verify the payload using the MD5 and if it's good, proceed with the update and then seed the download. Keep seeding for a short period after upgrading (a few hours, maybe a day, limited uplink bandwidth), then delete/stop seeding. If the BT client can't find a suitable download, then hit the download server direct. Might help reduce the bandwidth on your download servers.
Last Edit: 3 years 10 months ago by cityblue2001.
The administrator has disabled public write access.

2014: A stable New Year! 3 years 10 months ago #3

  • klojum
  • klojum's Avatar
We're currently going for multiple mirrors for each continent. Bittorrent to me personally seems a bit overkill, as the download size of OpenELEC is fairly small as is: not a gigabit thing and not even in many hundreds of megabytes. We will have proof of the new mirror setup once the next release of OE comes out.
The administrator has disabled public write access.

2014: A stable New Year! 3 years 9 months ago #4

  • prae5
  • prae5's Avatar
  • Offline
  • Junior Boarder
  • Posts: 36
  • Thank you received: 6
  • Karma: 1
We can integrate bittorrent with the new mirror system, however I don't really see the benefit in it.

I am targeting at least two mirrors for every main region, so between them and our server it should be more than sufficient. So far I have enabled 11 mirrors - these are all on 1Gb+ uplinks, so we already have significantly more capacity than we did previously.
The administrator has disabled public write access.

2014: A stable New Year! 3 years 9 months ago #5

  • fojam
  • fojam's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 1
  • Karma: 0
You guys still need to fix the fc-cache issue. I can't even boot
The administrator has disabled public write access.

2014: A stable New Year! 3 years 9 months ago #6

  • seo
  • seo's Avatar
  • Offline
  • Gold Boarder
  • Posts: 609
  • Thank you received: 168
  • Karma: 39
fojam wrote:
You guys still need to fix the fc-cache issue. I can't even boot

it has been discussed many many times. it is only a WARNING. and your "unable to boot" issue is NOT related
The administrator has disabled public write access.

2014: A stable New Year! 3 years 9 months ago #7

  • costi
  • costi's Avatar
  • Offline
  • Junior Boarder
  • Posts: 28
  • Thank you received: 1
  • Karma: 0
A bit off-topic, but is 3.2.5 planned with Frodo 12.3?
The administrator has disabled public write access.

2014: A stable New Year! 3 years 9 months ago #8

  • chewitt
  • chewitt's Avatar
@costi: OpenELEC v3.2.4 contains 12.2 + a quantity of cherry-picked patches that effectively make it the same as 12.3 - there are only two commits difference (one of which is the version bump in a text file). If we do release v3.2.5 it will be for other things.
The administrator has disabled public write access.

2014: A stable New Year! 3 years 9 months ago #9

  • costi
  • costi's Avatar
  • Offline
  • Junior Boarder
  • Posts: 28
  • Thank you received: 1
  • Karma: 0
Good to know, thanks!
The administrator has disabled public write access.

2014: A stable New Year! 3 years 8 months ago #10

  • sfleck
  • sfleck's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 2
  • Karma: 0
kudos and a big thank-you to SolNet !
The administrator has disabled public write access.

2014: A stable New Year! 3 years 6 months ago #11

  • daytonwindow6
  • daytonwindow6's Avatar
Thanks to Solnet..
Good to know it.. :)
The administrator has disabled public write access.

2014: A stable New Year! 3 years 5 months ago #12

  • directwindow65
  • directwindow65's Avatar
Solnet the best..
Thanks! :laugh: :laugh:
The administrator has disabled public write access.

2014: A stable New Year! 1 year 1 month ago #13

  • MarioHullinger
  • MarioHullinger's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 4
  • Thank you received: 1
  • Karma: 0
2 years have passed by.Time flies :blink:
The administrator has disabled public write access.