What are the barriers to big data analytics in local government?

By: Fola Malomo, Vania Sena and David Sutcliffe, Oxford Internet Institute

The concept of Big Data has become very popular over the last decade, with many large technology companies successfully building their business models around its exploitation. The UK’s public sector has tried to follow suit, with local governments in particular trying to introduce new models of service delivery based on the routine extraction of information from their own big data. These attempts have been hailed as the beginning of a new era for the public sector, with some commentators suggesting that it could help local governments transition toward a model of service delivery where the quantity and quality of commissioned services is underpinned by data intelligence on users and their current and future needs.

In their Policy & Internet article “Data Intelligence for Local Government? Assessing the Benefits and Barriers to Use of Big Data in the Public Sector“, Fola Malomo and Vania Sena examine the extent to which local governments in the UK are indeed using intelligence from big data, in light of the structural barriers they face when trying to exploit it. Their analysis suggests that the ambitions around the development of big data capabilities in local government are not reflected in actual use. Indeed, these methods have mostly been employed to develop new digital channels for service delivery, and even if the financial benefits of these initiatives are documented, very little is known about the benefits generated by them for the local communities.

While this is slowly changing as councils start to develop their big data capability, the overall impression gained from even a cursory overview is that the full potential of big data is yet to be exploited.

We caught up with the authors to discuss their findings:

Ed.: So what actually is “the full potential” that local government is supposed to be aiming for? What exactly is the promise of “big data” in this context?

Fola / Vania: Local governments seek to improve service delivery amongst other things. Big Data helps to increase the number of ways that local service providers can reach out to, and better the lives of, local inhabitants. In addition, the exploitation of Big Data allows to better target the beneficiaries of their services and emphasise early prevention which may result into a reduction of the delivery costs. Commissioners in a Council needed to understand the drivers of the demand for services across different departments and their connections: how the services are connected to each other and how changes in the provision of “upstream” services can affect the “downstream” provision. Many local governments have reams of data (both hard data and soft data) on local inhabitants and local businesses. Big Data can be used to improve services, increase quality of life and make doing business easier.

Ed.: I wonder: can the data available to a local authority even be considered to be “big data” — you mention that local government data tends to be complex, rather than “big and fast”, as in the industry understanding of “big data”. What sorts of data are we talking about?

Fola / Vania: Local governments hold data on individuals, companies, projects and other activities concerning the local community. Health data, including information on children and other at-risk individuals, forms a huge part of the data within local governments. We use the concept of the data-ecosystem to talk about Big Data within local governments. The data ecosystem consists of different types of data on different topics and units which may be used for different purposes.

Complexity within data is driven by the volume of data and the large number of data sources. One must consider the fact that public agencies address needs from communities that cross administrative boundaries of a single administrative body. Also, the choice of data collection methodology and observation unit is driven by reporting requirements which is influenced by central government. Lastly, data storage infrastructure may be designed to comply with reporting requirements rather than linking data across agencies; data is not necessarily produced to be merged The data is not always “big and fast” but requires the use of advanced storage and analytic tools to get useful information that local areas benefit from.

Ed.: Do you think local governments will ever have the capacity (budget, skill) to truly exploit “big data”? What were the three structural barriers you particularly identified?

Fola / Vania: Without funding there is no chance that local governments can fully exploit big data. With funding, Local government can benefit from Big Data in a number of ways. The improved usage of Big Data usually requires collaboration between agents. The three main structural barriers to the fruitful exploitation of big data by local governments are: data access; ethical issues; and organisational changes. In addition, skill gaps; and investment in information technology have proved problematic.

Data access can be a problem if data exists in separate locations with little communication between the housing organisations and no easy way to move the data from one place to another. The main advantage of big data technologies is their ability to merge different types of data; mine them for insights; and combine them for actionable insights. Nevertheless, while the use of big data approaches to data exploitation assumes that organisations can access all the data they need; this is not the case in the public sector. A uniform practice on what data can be shared locally has not yet emerged. Furthermore there is no solution to the fact that data can span across organisations that are not part of the public sector and that may therefore be unwilling to share data with public bodies.

De-identifying personal data is another key requirement to fulfil before personal data can be shared under the terms of the Data Protection Agreement. It is argued that this requirement is relevant when trying to merge small data sets as individuals can be easily re-identified once the data linkage is completed. As a result, the only option left to facilitate the linkage of data sets with personal information is to create a secure environment where data can be safely de-identified and then matched. Safe havens and trusted third parties have been developed exactly for` this purpose. Data warehouses, where data from local governments and from other parts of the public sector can be matched and linked, have been developed as an intermediate solution to the lack of infrastructure for matching sensitive data.

Due to the personal nature of the data, ethical issues arise concerning how to use information about individuals and whether persons should be identifiable. There is a huge debate on ethical challenges posed by the routine extraction of information from Big Data. The extraction and manipulation of personal information cannot be easily reconciled with what is perceived to be ethically acceptable in this area. Additional ethical issues related to the re-use of output from specific predictive models for other purposes within the public sector. This issue is particularly relevant given the fact that most predictive analytics algorithms only provide an estimate of the risk of an event.

Data usage is related to culture; and organisational changes can be a medium to longer term process. As long as key stakeholders in the organisation accept that insights from data will inform service delivery; big data technologies can be used as levers to introduce changes in the way services are provided. Unfortunately, it is commonly believed that the deployment of big data technologies simply implies a change in the way data are interrogated and interpreted and therefore should not have any bearing on the way internal processes are organised.

In addition, data usage can involve investment in information technology and training. It is well known that investment in IT has been very uneven between the private and public sector, and within the private sector as well. Despite the growth in information and communications technology (ICT) budgets across the private sector, the banking sector and the financial services industry spend 8 percent of their total operating expenditure on ICT, among local authorities, ICT spending makes up only 3-6% of the total budget. Furthermore, successful deployment of Big Data technologies needs to be accompanied by the development of internal skills that allow for the analysis and modelling of complex phenomena that is essential to the development of a data-driven approach to decision making within local governments. However, local governments tend to lack these skills and this skills gap may be exacerbated by the high turnover in the sector. All this, in addition to the sector’s fragmentation in terms of IT provision, reinforces the structural silos that prevent local authorities from sharing and exploiting their data.

Ed.: And do you think these big data techniques will just sort-of seep in to local government, or that there will need to be a proper step-change in terms of skills and attitudes?

Fola / Vania: The benefits of data-driven analysis are being increasingly accepted. Whilst the techniques used might seem to be steadily accepted by local governments, in order to make a real and lasting improvement public bodies should ideally have a big data strategy in place to determine how they will use the data they have available to them. Attitudes can take time to change and the provision of information can help people become more willing to use Big Data in their work.

Ed.: I suppose one solution might for local councils to buy in the services of third-party specialist “big data for local government” providers, rather than trying to develop in-house capacity: do these providers exist? I imagine local government might have data that would be attractive to commercial companies, maybe as a profit-sharing data partnership?

Fola / Vania: The truth is that providers do exist and they always charge local governments. What is underestimated is the role that data centres can play in this arena. The authors are members of the economic and social research council funded business and local government data research centre for smart analytics. This centre helps local councils use their big data better by collating data and performing analysis that is of use to local councils. The centre also provides training to public officials, giving them tools to understand and use data better. The centre is a collaboration between the Universities of Essex, Kent, East Anglia and the London School of Economics. Academics work closely with public officials to come up with solutions to problems facing local areas. In addition, commercial companies are interested in working with local government data. Working with third-party organisations is a good method to ease into the process of using Big Data solutions without having to make a huge changes to one’s organisation.

Ed.: Finally — is there anything that central Government can do (assuming it isn’t already 100% occupied with Brexit) to help local governments develop their data analytic capacity?

Fola / Vania: Central governments influence the environment in which local government operate. Despite local councils making decisions over things such as how data is stored, central government can assist by removing some of the previously-mentioned barriers to data usage. For example, government cuts are excessive and are making the sector very volatile so financial help will be useful in this area. Moreover, data access and transfer is made easier with uniformity of data storage protocols. In addition, the public will have more confidence in providing data if there is transparency in the collection, usage and provision of data. Guidelines for the use of sensitive data should be agreed upon and made known in order to improve the quality of the work. Central governments can also help change the general culture of local governments and attitudes towards Big Data. In order for Big Data to work well for all, individuals, companies, local governments and central governments should be well informed about the issues and able to effect change concerning Big Data issues.

Read the full article: Malomo, F. and Sena, V. (2107) Data Intelligence for Local Government? Assessing the Benefits and Barriers to Use of Big Data in the Public Sector. Policy & Internet 9 (1) DOI: 10.1002/poi3.141.

Fola Malomo and Vania Sena were talking to blog editor David Sutcliffe.

Accelerating autonomy: EMBA alumnus and F1 veteran Mark Preston on StreetDrone ONE

By: Saïd Business School, University of Oxford

StreetDrone One

StreetDrone ONE is an autonomous vehicle (AV) platform designed to open up self-driving technology to educational institutions, as well as programmers and developers outside the traditional car industry. CEO and founder Mark Preston is an entrepreneur, Oxford Executive MBA (EMBA) alumnus, and former Formula One technical director.

‘As I began to do more work in this area I realised that, despite the huge pressure on companies to embrace the new technology, there were not enough ways for people to learn how to work with it. Car manufacturers kept telling me they simply couldn’t find graduates who had experience with autonomous systems,’ explained Preston. ‘The problem boils down to this: building a car is extremely expensive, and institutions and programmers won’t have the skills or the finances to do it. So they need a readymade platform on which to try out their ideas.’

Mark Preston

After identifying the gap in the market, Preston and managing director Mike Potts approached Renault to license their Twizy hatchback, which they have modified to include 360 degree cameras, laser sensors, customisable panels and a fully customisable operating system.

The battery powered, lightweight car might be no match in performance to Preston’s race cars, but the process of designing and marketing it has many similarities. ‘The best way to explain motorsports is that it is a prototyping competition,’ said Preston. ‘It’s a low volume, high value and highly innovative industry, and so there are obvious parallels to the world of starts-ups.’

Having enrolled at Oxford Saïd in 2005 to improve his knowledge of fundraising and general business practices, Preston says his Executive MBA has been essential to his fast-paced career: ‘I launched the Formula One team, Super Aguri, at the same time as studying the EMBA. The advice of both the faculty and my cohort was invaluable, and I still seek the counsel of my fellow alumni to this day.’

As to how anyone could build an international motorsport team while completing one of the world’s most rigorous business qualifications, Preston tells us the secret is impeccable time management: ‘let’s just say long haul flights provide a great opportunity to catch up on your coursework,’ he said.

StreetDrone ONE will begin delivery of its self-drive ready platform in August 2017.


This article first appeared on the news pages of the Saïd Business School website on 28th June 2017.

University researchers reach out into the community

By: University of Oxford

A researcher reconstructing lost historical sites, a project transforming lion killers into lion conservationists, activities to help people living with dementia and a department giving schoolchildren a chance to touch a piece of the moon have all been named winners at this year’s Vice-Chancellor’s Public Engagement with Research Awards.

These projects, along with eleven others, were recognised at the University’s Vice-Chancellor’s Public Engagement with Research Awards on 28 June, at the Oxford University Museum of Natural History.

Dr Claire Sexton, of the Department of Psychiatry, won an Early Career Research Award for engaging communities with her research on ageing in the brain. Since 2015 she has delivered Dementia Friends information sessions and public talks about her research. She is also Founding Chair of Dementia Friendly Chipping Norton. The group aims to bring together people living with dementia, caregivers, community organisations and researchers to increase awareness of dementia locally and improve inclusion and quality of life.

The Department of Earth Sciences was recognised in the Building Capacity category, for their work with Oxford primary school groups. Schoolchildren joined researchers in investigating samples of real lunar material brought to earth by the Apollo missions in the 1970s, which are rarely seen and held, even by researchers of lunar science.

Awarded projects engaged those much further afield too. A project led by Dr Amy Dickman from the Department of Zoology worked with communities in Tanzania to transform lion killers into lion conservationists – a major need in an area which holds the world’s second largest lion population, but had previously suffered extremely high rates of lion killing by local people.

The Vice-Chancellor’s prize was also announced at the ceremony – this year’s winner was Dr Alexy Karenowska, Department of Physics, for her work on the documentation, preservation, and restoration of at-risk cultural heritage sites across the world. Dr Karenowska led a team to create a 13 tonne replica of the Triumphal Arch from Syria’s Palmyra site, destroyed in 2015. She managed the installation of the structure on Trafalgar Square in London and has overseen the installation of the same arch in New York, Dubai and Florence.

Professor Louise Richardson, Vice-Chancellor says: ‘I have been deeply impressed by the quality of the public engagement with research projects submitted for this year’s awards. The breadth and diversity of the activities taking place show how seriously the University takes its commitment to public engagement. It is inspiring to see the positive impact these activities have both on research and on the individuals and communities that have been involved, from warriors in Tanzania and young adults in Brazil, to local communities affected by dementia.’

Professor Alison Woollard, the University’s Academic Champion for Public Engagement with Research says: ‘Public engagement enriches both research and society and the University is committed to enabling our researchers to inspire, consult and collaborate with the public. I’m delighted that we are able to recognise and highlight the fantastic work our researchers are doing and hope these awards encourage more colleagues across the University to carry out their own public engagement with research.’

A full list of project winners can be found here.

This article first appeared on the pages of the University of Oxford website on 28th June 2017.

Oxford autonomous vehicle technology trials in self-driving delivery van

By: Oxbotica

delivery van

Greenwich, London, 27 June 2017 – The TRL-led GATEway Project together with Ocado Technology (a division of Ocado, the world’s largest online-only supermarket) has completed the UK’s first trials of an autonomous CargoPod vehicle around the Berkeley Homes, Royal Arsenal Riverside development in the Royal Borough of Greenwich. The real world trials see a self-driving delivery van, called CargoPod, operating in a residential environment, delivering grocery orders to over one hundred customers.

Taking place in the UK Smart Mobility Living Lab, the GATEway Project (Greenwich Automated Transport Environment) is a world-leading research programme, led by TRL and funded by UK government and industry. It aims to demonstrate the use of autonomous vehicles for ‘last mile’ deliveries and mobility, seamlessly connecting existing distribution and transport hubs with residential and commercial areas using zero emission, low noise transport systems.

CargoPod, developed by Oxbotica as part of the GATEway Project, is guided by their state-of-the-art autonomy software system Selenium, which enables real-time, accurate navigation, planning and perception in dynamic environments. The pod is able to carry a total of 128kg of groceries at a time.

Uniquely, the focus of the study is both on the commercial opportunities of self-driving technology and how it functions alongside people in a residential environment. This, the third of four trials with the GATEway Project, is exploring the public’s perceptions and understanding of driverless delivery vehicles. Ocado Technology is using the trials to explore the logistics and practicalities of deploying self-driving vehicles as part of the last mile offering for the Ocado Smart Platform, an end-to-end solution for providing bricks and mortar grocery retailers around the world with a shortcut for moving online.


This article first appeared on the website of Oxbotica on 27th June 2017

Talk : How Oxfordshire is driving the autonomous vehicle revolution

By: Mobox Foundation

Interested in the future of autonomous vehicles and mobility in Oxford?

Come to join us for a fun evening June 29th 6:30pm at Jam Factory.


We have an exciting line-up of speakers representing all relevant fields:

  • Mark Preston : The commercial opportunities and industry developments.

    Mark is already part of the CAEV (connected autonomous electric vehicle) revolution having founded one of the first teams to enter the FIA Formula E series. Whilst still the Team Principal at Techeetah Formula E, Mark is also the CEO of the StreetDrone® project, lowering the barriers to Autonomous vehicle development.

  • Dr Graeme Smith, Chief Executive of Oxbotica, recognized expert in Advanced Vehicle Control systems and Connected Cars

    Dr Smith will talk about the development and future of of AV from industry expert’s perspective.

  • Laura Peacock ,Innovation & Research Manager, Oxfordshire County Council.

    Laura will talk about the smart mobility and infrastructure development from local government’s perspective.

  • Lucy Yu, Head of Innovation and New Mobility Services, Centre for Connected and Autonomous Vehicles

We will also have a panel session where guests can have their questions answered and a poster competition for students working on this area showcasing their work. The event and refreshments are kindly sponsored by StreetDrone® .

The event is free to attend but booking is recommended as places are limited. You are more than welcomed to bring your friends and all you need to do it register.

To register, click :


You can find more information about the event and the Mobility Oxford (MobOx) C.I.C. here:


Looking forwards to seeing you in June 29th

Making the city better through data

By: Smart Oxford

A consortium including our County Council, Oxford Brookes University and the Oxford Internet Institute is working with Google to help find innovative ways to address transport issues for the City and county.

Utilising data collected by Google via android phones and mobile devices, the city partners are analysing mobility data for the city and county (the same data that marks congested areas in amber or red on Google maps).

The Oxford Internet Institute’s TRANSNET (Forecasting and Understanding Transport Network Resilience and Anomalies with Data Science) project aims to use using data science to forecast and understand transport network resilience and anomalies in the city. This two-year project will make use of Google’s anonymised mobile phone trace data to understand more about the flow of traffic around transport networks.

The work is grounded in an ongoing partnership with Oxford County Council, and will make use of several stores of big data to which the Council has access.

These data sources enable the project to work at high spatial and temporal resolution and to overcome many of the problems associated with estimating traffic flows from lower-resolution/sparse data.

As a medieval city with a historic, unplanned centre, Oxford faces a number of infrastructure challenges as its 160,000 residents and nearly 50,000 inward commuters move around the city.

In the last few years Oxford has opened a new rail station (Oxford Parkway), engaged in one of the largest commercial redevelopment currently taking place in Europe (demolition and redevelopment of the Westgate Shopping Centre in Oxford’s city centre at a cost of approximately £400m, producing retail space of over 74,000 sq. metres) and experienced multiple instances of severe flooding.

The historic transport data available will allow the city partners to examine many natural experiments where parts of the road infrastructure were closed either with advanced notice (events/fairs, road works) or suddenly without notice (traffic accidents, “jams”, and flooding).