Tag: glowblogs

Posted on
by

blogs_glow_v3.3

Yesterday at 4 O’Clock the glow blogs system was upgraded to WordPress 4. The site was down for around 4 minutes.

Glow blog are now running on WordPress 4, not much a a big deal as most other WordPress blogging site are doing the same. But we just upgraded >140000 blog for WordPress 2.9.2 to WordPress 4.0.1 a pretty amazing effort. Setting up from scratch would be simple enough, looking after all of the foibles of a creaky system a bit more complex.

It has been a pleasure working with the Blogs Team for this release, including:

Sonali Nakhate Project Manager; Turnbull and John MacLeod from the technical team at Scottish Government; Grant Hutton and David Orr of the test department at Scottish Government and Code For The People, now part of Automattic who managed to get aquihired by the company behind WordPress.com during the project!

We also got a ton of support in all sorts of ways from the extended glow team at the Scottish Government and Education Scotland and from many in the wider Scottish Education community.

A First Step

Although this is the second phase of the blogs project it is really just the precursor to the next phase. We are starting to discuss the plans for phase three now. This is, I hope, the really exciting bit…

The Glow Help Blog is being updated and I am listing some of the main changes here: Blogs Update Phase 2 WordPress 4 – Glow Blog Help.

Posted on
by

image

On of the real benefits to upgrading glow blogs to WordPress 4 will be its mobile interface. When WordPress 2.9.2 came out in 2010 we were just into the start of the mobile web and the term responsive web design had just been coined.

Now a large percentage of the population have devices in their pockets that are more than capable of posting content online.

. The WordPress  dashboard now  is responsive resizing and rearranging the tools to fit on my screen. Adding an image is simple and a gallery is easy enough.

WordPress now lets me select several images to insert in a post or create a gallery.

This post was started in the train, continued on the tube platform and finished on the couch all using my phone.

Personally I am not the greatest typest on any device. Many folk will be faster. Or I could start a post while mobile, capture images and save that as a draft for later.

I am looking forward to seeing how glow bloggers go mobile next year.

Posted on
by

IMG_0072.JPG

Since WordPress 3.9 the TinyMCE editor now automatically cleans out all but the semantic HTML from Word (or Rich text copied from elsewhere), meaning any fonts, styles, etc. You preserve headings, blockquotes, lists, links, bold, italic.

From: Peek in the SPLOT: TRU Writer

This means WordPress handles text pasted from word a lot better that the current WordPress 2.9.2 does

Even though, like Alan, I don't think writing everything in word is a great idea lots of folks do exactly that. This then should be useful for #glowblogs after the upgrade.

I'll be posting a few things here about the changes in glow blogs coming in January over the next few weeks.

Posted on
by

change

We have just announce the hope that phase 2 of the Glow Blogs project will go live sometime in January next year. This is a wee bit later than our original plans. Personally I am not too disappointed as I can see how hard the team across the Scottish Government and Code For The People (as was)1 are working.

Before I started this business, I could not really see what all the fuss was about, surely all we need to do is upgrade WordPress and all would be well. And that would be fine if it was one blog, dealing with, and sorting out any wee snags and glitches. But width >130000 blogs we need to try and make sure, as much as possible, that the blog owners don’t have much work to do. A major benefit of the newer version of WordPress should be making people’s lives easier it would be a bad start if they need to do a lot of work to keep their blogs looking the same.

Some Details

Here is an example or two of the work that is being carried out.

Anarchy

The Anarchy Media Player plugin was used to display video and audio on Glow Blogs. This plugin is no longer supported or updated. Much of its functionality has been improved on in core WordPress. WorpdPress now lets you upload or add a link to audio or video and choose to link to the media or embed it.
If we just turn off the plugin that would result in existing links to media, that are embedded, just being presented as links. If we leave it in folk may continue to use the features which may not survive any future upgrades. After a bit of though the developers have produced a slimmed down version of the plugin that will continue to change links into embeds. This new version will not however present buttons on the posting tool bar and encourage its continued use.
Hopefully this will smooth the upgrade experience for some people.

Resize

The old glow blogs had an upload file limitation of 8mb, this has been increased to 50mb which should help people to post small videos and reasonable length audio files. There will be extra cost in hosting the files and we want to balance this out a bit. In the old blogs quite a few folk ran out of space just by uploading un-edited image files. A plugin, resize at upload plus was added to the service in the hope that people would turn this on, images would be resized and very large sizes would be remove.
In the new setup this plugin has been updated and will be turned on for all blogs. The images will be resized down to 1200 pixels maximum width. This will ensure that images will still look good but trim some size of the rather large images that come out of digital cameras. This resize can be turned off, just in case someone want to have a photography blog and allow huge images to be stored.

These are just two of many changes that the team are working on. There is also the effect of the upgrade on the themes used on blogs, particularly the > 60 profile/e-portfolio themes. Each change needs a fair bit of discussion and work from the developers, each bit of functionality needs to be tested and all the other functionality need to be tested to see if the change has unforeseen consequences.

The User’s Experience

This is going to improve, WordPress has always been regarded as a good bit of software from an end user perspective. Improvement however means change. I am confident that these changes will make things a lot better, but habits will need to adapt. Hopefully we can explain any points of possible pain before the upgrade. We will be changing centuries in software terms, 2.9.2 was released in 2010 version 4 came out this year.

As usual I am more than happy to discuss any aspect of glow blogs, please get in touch if you need more information.

Footnotes:

1. Code for the people have joined the WordPress.com VIP Team at Automattic! They still are working on the Glow project.

Posted on
by

Last Friday at the same time as the glow authentication changed, the new glow blogs service went live. I posted about this over on Glow Connect.

It was pretty exciting stuff, the developers were really working right up to the last minute and beyond to deliver the service. Even so we have gone live with a few know issues and have already discovered a few more.

At the start of the processes I certainly was not aware of all the complexities involved nor the scale of the job. Turns out it was a big complex job!

Luckily for me I ended up working with an amazing team, not only in the Scottish Government, but in the developers and suppliers. All of them worked long hours with very positive attitudes as I grumbled along. I am tempted to turn this post into a list of these characters and their qualities, but probably enough to say all of the blog team were essential to the process.

What Have We Got

Stray Puppy by p medved
Attribution-NonCommercial-ShareAlike License

At the end of this phase we have a working set of WordPress MU, one for each Local Authority, running the same version of the software as before and we have the known issues linked above.

The main improvement so far is around blog creation. There is no connection to SharePoint/old glow groups. This simplifies the process a great deal. This and other Main Changes are listed in the Glow Blog Help, some of these are not improvements but changes.

One more improvement, not listed, is that you can now upload files of up to 50mb to blogs. This should make it a lot easier to podcast or share small videos without using a third party site or service.

On Wednesday I popped back to North Lanarkshire to watch my colleague Ann McCabe set up a class of e-portfolios, this was much quicker than before, taking away at least half the steps. There is still plenty of room from improvement and I got a great idea to take back to Victoria Quay from the RM help desk who I visited in the afternoon.

Next Up

Given the above, if this was the end point in the process I’d be pretty disappointed. A lot of work for not much in the way of improvement. I am not disappointed due to two things, phase 2 and phase 3.

Phase 2 was looking quite simple, upgrade to a new version of WordPress. This will bring a host of benefits, better user experience especially on mobile being the main gain. More important, in the longer run, is that it gives us a much better base to develop on.
The other aspect of phase 2 will be to backfill in things that were dropped out of phase one or needs that were discovered in phase 1.

It looks like phase 2 will take a bit more work than I expected, but this will start straight off. Already some of the first problems to be discovered has been solved and the developer team are just waiting to decide when to deploy the code. Another potential ongoing problem with server load is now beginning to be understood and the team are working on finding the best solution. The team are keen that the server gets a chance to bed in and are suitably cautious about changing things on the live system, best practises for ongoing change and development are being put in place.

Bright Future

After we get to phase 3 of the project things might speed up a bit. We will be using WordPress 4 which will allow a lot of nice things to happen.

The one I am most excited about is giving a more flexible service. In the old glow blogs it was a constant frustration for myself and many others that our theme and plugin requests were never answered. I am not entirely sure of all the reasons for this, but having peeped behind the curtain I presume some of this was to do with testing.

Watching the new blogs service develop gave me a bit of a shock in the amount of time and effort it needs to deliver a service of this scale. Like many folk who publish stuff on the web I frequently make changes without much of a care and worry. The Technical Architects and developers for glow take a somewhat different view. There first concern is the preservation of users data and stability of the service and given they are taking care of over 100,000 blogs…

The glow blogs system now consists of 4 main servers: integration (where new code is added after code review), explore (for testing), pre-production (more testing) and live. With the older version of WordPress we are using a lot of the development and testing is manual, the testers here and volunteers going through lists of test to test the functionality of the blogs. In addition there is security, load and a many more tests.

Going forward the process should be automated, the newer version of WordPress can have a deal of automatic testing, code going onto the integrate server would be pushed through the different servers being automatically tested on the way, this gives us the possibility of a much more agile service.

On the Way

On Friday last week there was a fair amount of cheering and happy faces around the glow office, since then feedback has been mainly positive. I am not really ready to celebrate yet, there still is a lot to do before we reach the point learners and teachers in Scotland have a world class blogging platform. There so many possibilities out there for doing all sorts of things with WordPress. We would, of course be really interested to hear of any ideas of what you would like from Glow blogs.

Posted on
by

I posted this this afternoon:

The Glow Blogs migration export will start on 19th September 2014

Any new posts or content added to blogs after that date will not be migrated to the new service.

The new service should be up and running by Oct 3rd 2014

The data from the current blog servers will be exported on the 19th of September and migrated to the new service ready for the go live date.

We’re making every effort to achieve the deadline of the new service for 3rd October. If anything changes, we will get in touch immediately.

This is not technically a content freeze as users will be able to add to their blog, rather it should be considered as a procedural content freeze.

We hope to be able to add a message to explain the situation to every blog dashboard but in case that is not technically possible we need as much help as we can get in spreading the word.

from: Glow Blogs Migration News | Glow Connect, Glow Connect is the information portal for Glow – a space for providing updates on the development and enhancement of the service and for sharing how teachers are using Glow.

Joshi by Juan Coloma Attribution-NonCommercial-ShareAlike License

I am sorry that the warning time for the content freeze is only just over two weeks, but it is only now we can give an estimate, timing is tight, it might even slip a wee bit, but we though it best to try and give as much notice as we can.

Back in June we proposed a content freeze over a short period over the summer and possibly another in September or October, as it turned out the summer freeze did not happen as it would not have given us any advantage, we could do a text export without a freeze.

We (especially the coders, technical and test members of the team) are very much working flat out to get the blogs migration in on time, the date is the current best estimate of when we will be ready to export the data from the RM servers and import it into the new one.

Earlier we hoped that the freeze would be a bit shorter that we are now estimating, but it has become apparent that it will take a bit longer. Between the 19th and go live several things need to happen:

  • The database and web server files (images and uploads) need to be encrypted and copied to a secure disk. Before encryption a sort of fingerprint of the files is taken, this will let us know if the files we put on the new server are identical. The size of the database and files meant this will take a while.
  • The disk will be taken to the new hosting and copied onto the server.
  • It is then unencrypted and the md5 fingerprint compared to the original.
  • The files will be put in place and hooked up to WordPress, or rather 33 instances of WordPress one for each Local Authority plus a central one.
  • Lots of testing. Testing of other bits of the process, the new servers has already started.
  • There are several rounds of testing, of different types that I am just beginning to get my head round. This will insure we get the best possible service from the new blog. The final rounds of testing will involve users from across Scotland, first on a ‘test’ environment and then on the new server before it goes live.
  • After everything looks good the new server gets the old blogs.glowscotland.org.uk domain and the blogs will be updatable again.

I’ve not numbered the points above because I have missed out many more steps. The project plan has been worked over repeatedly to make sure the quality of the result is as good as can be and, by doing various things in parallel, we cut time down to the minimum. Extra test engineers have been borrowed from other parts of glow and other members of the team are helping with testing.

After the new service goes live the project will not stop, the blogs will then be upgraded to a current version of WordPress and then the third phase of the project, to enhance the blogs for learning and teaching will start.

Posted on
by

super ruper by nnnnic Attribution-NonCommercial-NoDerivs License

I’ve been trying to post information about the glow blogs migration here when I can, but still getting a few questions, via email, twitter etc. Here is a series of DMs:

Hi John. Been following the progress of GlowBlogs and reading your own blog. Question: Can I go ahead and set up a class blog using…

‘Old Glow’ and get class using it….then it’ll transfer across to ‘New-Glow’ with the bells and whistles in he coming weeks (months) ?

I (and other member of staff) really want to get cracking on this. How would we ensure the old style blog ‘goes accross’? Need to tell..

someone where it is?

Quite a few folk have asked the same sort of thing, can/should I set up a glow blog/e-portfolio now or wait?

The answer is: Yes if you set up a glow blog now it will be migrated to the new service.

Caveats

There will be a procedural content freeze, and the possibility of downtime if we do not make the 3rd of October deadline (we are working very hard to ensure we will).

Content Freeze

The database and files that make up the blogs are currently on RM servers, this need to be moved to new servers. Given the size of the data this will involve copying onto a portable disk. The copy will be encrypted. The disks need to be moved, the encrypted data securely moved to the new setup, unencrypted and verified. The new system then need to be thoroughly tested.

During this time the old blogs will be up and running, but any content added to them will not be migrated and new blogs setup during the content freeze through the old glow Sharepoint portal will not be migrated.

I am not sure how long the content freeze will be but it looks like being a week or so.

We will publicize the content freeze as much as possible, telling Glow Key Contacts in each Local Authority, publishing on Glow Connect and I’ll post here and tweet.

We also hope to be able to add a warning message on the dashboards of all the current glow blogs, but that solution needs to be created and tested.

Posted on
by

I’ve just made my first post on Glow Connect.

Glow Connect is the information portal for Glow – a space for providing updates on the development and enhancement of the service and for sharing how teachers are using Glow. 

This Glow Connect will be a central area for keeping up with glow development.

Here is the contents of the post:

Glow Blogs Update August 2014

I’ve made a few posts over the summer about the Glow Blog migration, which give a bit more detail about what is happening:
Glow Blogs Summer 2014
Blog Migration Notes: Users
Glow Blog Migration Notes: e-Portfolios

This is a further update.

The blog migration project is well underway. There are three or four main chunks of work that need to be completed. The first development, by Code for the People, has been making exceptional progress. The hosting procurement has been completed, removing a bit of worry. Plans for migration of the data from the old servers to the new environment are well under way and some exploratory work is being carried out. Test plans are coming together nicely, and it is great to watch the whole project coming to life.

My role as product owner is making a bit more sense, and it is delightful to work back and forward with the folk building the requirements, developing and getting ready for testing. The attention to detail by the members of the blog team gives me confidence that we are creating a great ‘product’.

There is still a planned content freeze. This will cover the time the data leaves the RM servers and is installed and set running on the new servers. It is expected that this will be around a week. Given that the data being transported is sensitive it will need to be handled with care, encrypted and unencrypted. We are hoping to be able to give plenty of warning around the time of the content freeze. We also hope to have a plugin in place in the existing blogs that will add a message about this to the dashboard of every blog.

The continues to be a risk that the migration will not be complete before the old servers are turned off on the 3rd of October which could result in some downtime, however we are managing this risk very closely.

In summary, we’re making good progress and I will keep you updated on Glow Connect.

I’ve been posting some glow blogs information here, so in the future I’ll probably cross post in the two places.

Posted on
by

Lost Puppy

Lost Puppy flickr image by Tim Shields Creative Commons – CC BY-NC 2.0

Here are some notes around the effect that the glow blog migration will have on e-portfolios hosted on the WordPress instances. There are two main things to consider, users/members of blogs and links to access blogs.

User Management Issues

We are currently migrating the blogs, including e-portfolio blogs, to a new WordPress Server initially running the same version of WordPress 2.9.2

The set up will mirror the existing set up, an instance for each Local Authority. The URLs will stay the same.
The permission on the blogs and their private/glow only/ public setting will stay the same.
Only users who have previously visited the blogs while logged onto glow will have the same access.

Going forward the settings for blogs will be handled in the blog rather than Sharepoint. This is partially because the new Sharepoint is cloud based and cannot be customised in the same way as the old glow portal and partially because of the advantages of having blogs stand on their own two feet (see below for details).

Users who were granted roles on a blog though the old glow group in which the blog was created, but have never visited the blog will have to be added again. (There is no trace of these users in WordPress and therefore no way of migrating them). You can mitigate against this providing problems by asking those users to visit the blogs before the switchover. After migration Admin Users will be able to add these (or any other) users in in the blog admin dashboard.

I’ve covered more about User Management in a previous post: Blog Migration Notes: Users.

Finding your e-Portfolio

If users followed the advice on setting up glow blogs as e-Portfolios they would have created a group in the old glow portal to hold links to groups of e-portfolios. After the switch over to the new authentication in early October (3rd) the old portal will not be there.

There will be a need for teacher and pupils to be able to access blogs there are a few possibilities in the short term.

  • Lists created before the portal was migrated to O365 will still be there in your O365 group.They will be buried in the migrated content but can be resurrected.
  • You could copy and paste the list from old glow and paste into a new glow group.
  • You could recreate the lists. This would be my favoured option as I would distribute the work to pupils.

For the third approach you would need to create a space when pupils could add their e-portfolio URLs. This could be a links list in O365 or a share word document in OneDrive. Pupils would need to have permissions set so that they could add to the links or have edit permission on the document.

As a teacher I would not use links like this, too much work. I would bookmark them in my browser and put all the bookmarks in a folder. I could then log on to glow and open the folder of links in tabs. This would after a wee wait give me a set of tabs that I could quickly go through to visit each portfolio without clicks.

Post Migration Development

After migration it intended to move into phase 2 which will be an upgrade of the blog software from 2.9.2 to 3.9

Phase 3 will include improvements to the service, adding plugins and themes to increase functionality.

In Phase 3 it is the intention to improve the setup of e-portfolio blogs by improving the setup, improving how posts are organised and how the profiles are produced from those posts.
It hoped that this work should be completed by March 2015

WordPress only

The main advantages with moving the set up of blogs and e-portfolios away from Sharepoint to the WordPress server itself will be:

  • We will be able to keep the WordPress install a lot more up to date. This will allow users to benefit from new features as these are added to WordPress. With the old glow blogs it seems that it was to hard to upgrade WordPress.
  • The setup of e-portfolios will be shortened. currently I find it takes around an hour to go through the setup with a class of pupils assuming each pupil has access to a computer/device. Removing the Sharepoint element of the blogs will speed things up in the short term.
  • In the medium term the new blogs should let us develop new functionality which will speed things up even more and reduce the opportunities for making mistakes.
  • We should also be able to develop the portfolio functionality of the blogs though plugins. This could make the organisation of posts and production of the profile snapshot simpler.

Please get in touch if you have any questions about the glow blog migration.

Posted on
by

The Whole Gang, 50 Days old by Dean Searle Attribution-NonCommercial-NoDerivs License

There is some background to this project in a previous post: Glow Blogs Summer 2014.

Before the migration of the glow portal Education Scotland suggested that schools did some pruning and tidying of their glow groups to make migration easier (less data) and so that users had less to sort through and sort out on the other end.

As the date for migration of blog gets nearer a few folk have been asking me about what is going happen to their blogs, if there is anything that they should be doing and what will change. This post will try and address some of the questions.

You should not need to do any pruning and tidying of your blogs. The intention is to migrate everything as is to the new system. I was always surprised to be asked about tidying up and deleting old posts from school and class blogs. for me a blog is for life, it is a positive that I could dive back into the archive and see some of what I was doing years ago.

The blog only knows about users that have visited already

One of the biggest changes will be the decoupling of the blogs from the old glow groups. In the current, old, system the users and permissions of those users are set inside the glow group that the blog was created in. Those groups will go away. After migration you blog will not be able to refer to the old sharepoint group to find out who has permission do do things (view, post, carry out admin tasks) the only users it will know about are ones who have already visited the blog when logged into glow.

For example:

  • Teacher A has set up a blog in the old glow for herself and 2 colleagues, Teacher B and Teacher C (not their real names) to share links about their subject with pupils.
  • Teacher A is the blog admin and The other two are contributors.
  • The blog is a public blog so anyone in the world can view it.
  • Teacher B has already added a couple of links by creating posts on the blog.
  • Teacher C has yet to log on to the blog.
  • After the switch over to the new authentication system and the blog migration Teacher A and B can log on, Teacher A is still an admin and Teacher B can log on and create posts.
  • When Teacher C tries to log on there is no entry in the WordPress database for him as having a role in this blog. If he has never used any glow blog he will not be in the database at all. Teacher C will not be able to log on or create posts.
  • At that point Teacher A will be able to log on to the dashboard, go to the users screen and add Teacher C as a contributor.

To avoid this scenario Teacher C would need to log on to the blog before the migration.

Japenese Spaniel by Muzik Hounds Attribution-NonCommercial License

New User Management

Going forward on the blog service the user management will be in the WordPress dashboard not in glow groups. This will develop over time. We are trying to have a system that is not dependent on other parts of the system, In the old glow the blogs were very much hooked into sharepoint in a way that made it difficult to upgrade. We ended up using a very out of date version of WordPress. In the future we should be able to keep the blog system up to date.

Unfortunately the standard WordPress user management is not really suitable for use in glow. This is based round email messages to add users to a particular blog. If for example 200 second years add their teachers to their e-portfolio blogs to allow them to see them each teacher added would get an email from each blog and have to click the link in the email to finish the process. It also requires you to add one user at a time. This is not sutiable and will not happen.

For the first stage of the new blog service the developers will add functionality so that if I add a user to my blog with a particular role they will be added but the email message will not be sent and the user will not need to confirm the addition. The interface will be changes so that I can add a list of glow usernames rather than just one at a time.

The main problem in this scenario will be finding out usernames. This is being dealt with by another team in the glow program. It may not be ready in time for the switchover. In that case it may be necessary to gather usernames is a manual way (get them sent in an email, find them in O365 or even get them written down on a bit of paper. Then make a list in a document to paste into the blog admin screen, save the doc).

It is planned that the class set functionality that was present in the old glow groups will be redeveloped. The second stage for the blogs will be that the class sets service will be an area where teachers can search for a class and them copy a list of usernames to paste into the user management screen in the dashboard of their blog.

The third development will be to bring the class set functionality into the user management screen directly. This will happen in the third phase of the blog migration and upgrade.

As the functionality is developed we will be able to make user guides for this process.

Please get in touch if you have any questions about the glow blog migration.