Empowering Communities with Data Technologies. Big Data can make important contributions to the technical progress in our societal key sectors and help shape business. What is needed are innovative technologies, strategies and competencies for the beneficial use of Big Data to address societal needs and Big Data Europe provides you with it.
On 2nd February 2018, the BigDataEurope (BDE) societal challenge on transport (SC4) hosted its third and final hangout. Entitled “The Way Forward for Big Data in Transport”, the hangout presented the results of the work done in the BDE project and discussed the advancements of big data in the transport sector.
Maxime Flament (ERTICO – ITS Europe) opened the webinar and welcomed participants. He went through the agenda points and opened the first poll of the webinar, in order to identify the background of the participants. It was clear that an equal amount of software engineers, researchers, and transport experts were present, as well as some public and local authorities.
Josep Maria Salanova Grau (CERTH) then introduced the BDE project and explained how it sought to harness big data for transport. His presentation is available below.
This presentation was followed by the second poll, asking participants about their hesitations in using big data. For most participants, it seemed that the financial aspects of acquiring data sets was the primary worry, followed by lack of expertise in data science or related fields and privacy issues.
Then Maxime Flament (ERTICO – ITS Europe) gave a brief overview of the workshop that SC4 organised in September. It was the third, and final, workshop for BDE SC4. In contrast to the first workshop, which aimed to identify user needs and requirements, and the second workshop, which presented the offerings of the BDE platform and explained how it can apply to the transport pilot site in Thessaloniki, the third workshop presented the results of BDE. When the BDE project started out, integrating data into the transport sector was still a novel idea. Now it has become a game-changer with ever-increasing importance. The workshop also highlighted the need to have the right data at the right time and at the right place. More information is available in the presentation below.
Another interesting poll was launched after this presentation, showing that vehicle information is by far the most used data set amongst participants.
After this poll, Luigi Selmi (Fraunhofer IAIS) presented the Big Data Integrator Platform (BDI). The Platform is the key outcome of the BDE project. It provides an integrated stack of tools that allow large-scale data resources to be processed, analysed and published without the need for native installations of additional tools for data processing at scale. As an ecosystem of specifications and reference implementations, the BDI has tremendous potential for deployment across sectors and for a range of players in the data value chain.
The final presentation in the webinar was from the Rajendra Akerkar (Vestlandsforsking) of the LeMO project, with which BDE has already established a good collaboration. The LeMO project participated in the BDE SC4 workshop in September and has contributed a blog entry on the future of big data in transport to the BDE website. Their presentation at the webinar focused on the objectives of the LeMO project. LeMO will carry out a set of case studies and, based on their results, develop recommendations and a roadmap, which policy makers will be able to use to make better-informed decisions. You can find out more about the LeMO project in the presentation below.
After the LeMO presentation, webinar participants were asked to cast their vote in the last poll, this time concerning the LeMO case studies. As could have been expected, most of the BDE followers present at the webinar would like to learn more about the open data and transport case study that LeMO will undertake.
Finally, the webinar also left room for a question and answer session. Participants wanted to know how they could get involved in BDE and get help from BDE for their big data projects. Since the BDE project officially concluded in December 2017, this is a very pertinent question. Interested participants can contact the BDE consortium, which will continue to be available to assist in training people to use the framework.
Another interesting question was raised about whether or not EU funded projects such as BDE can have a real impact and compete with technology giants like Google or Apple. According to the BDE consortium, Google and Apple will always be competitors and, with the coming General Data Protection Regulation (GDPR), there will be more limitations. Nonetheless, it is important to continue competing and pushing for advancements and results, even though the competition might be fierce.
On 13 December, 2017 we hosted the third workshop in the domain of Societal Challenge 1 (Health, Demographic Change and Wellbeing). This was also the final workshop of the Big Data Europe project, and our aim was to look back over everything we’d achieved not only in SC1, but in the BDE project as a whole.
16 people from a variety of backgrounds attended the workshop, including many participants from the European Commission, and three invited speakers who presented other ongoing and upcoming projects related to big data in the domain of health.
Following an introduction to Big Data Europe from Simon Scerri, Jonathan Langens presented a live demo of the BDE project’s Big Data Integrator. He showed participants the fundamentals of how the BDI makes it easier for big data users to build, set up, deploy and monitor projects, using the Stack Builder, Workflow Builder, and Swarm UI. Many resources such as manuals, webinars, screencasts, and template containers are also available to help reduce barriers to entry in big data across all domains and Societal Challenges.
Kiera McNeice then presented the SC1 pilot, which has replicated the functionality of the Open PHACTS Discovery Platform with open components in the BDE infrastructure. The Open PHACTS Discovery Platform provides an API for users to query multiple linked life science data sources, and answer real research questions more efficiently and cost-effectively, as well as making entirely new kinds of queries possible.
Our invited speakers then demonstrated three other European big data projects in the health domain.
Michaela Black presented MIDAS (Meaningful Integration of Data Analytics and Services), which aims to connect big data in health and present it to public health policy makers in accessible and useful ways; this will help inform better policy-making decisions at all levels across Europe. (slides)
Supriyo Chatterjea presented BigMedilytics, a broad consortium which aims to take a holistic view of healthcare in order to improve productivity in the healthcare sector by 20% by addressing the major themes of chronic disease, oncology, and industrialisation of healthcare. (slides)
Guillermo Palma presented iASiS, a project focussing on personalised medicine. The project aims to develop pilots in lung cancer and Alzheimer’s disease by connecting electronic health records, genomic data, bibliographic data, and public pharmacological databases, and is based on the BDE framework. (slides)
In the discussion that followed, several key questions and challenges were raised regarding big data in healthcare. In particular issues of privacy, ethics and consent wherever patients’ personal data are concerned came up repeatedly in the context of improving and personalising healthcare. The importance of linking data across different domains will also be crucial to improving health outcomes, as health depends on many factors beyond the individual, across many different Societal Challenges – for example infrastructure, food, environment, and more.
Building up trust among all stakeholders was thought to be crucial to addressing these concerns, as was finding win-win scenarios where all parties benefit from sharing data with each other. The need for “future-proofing” was also discussed – that is, ensuring users can be certain of ongoing support for any big data infrastructure.
As the Big Data Europe infrastructure and BDI are fully open and available for anyone to use, we hope that big data communities both in the health sector and across all the Societal Challenges will continue to use and adapt it to their own needs, building on the success of the BDE project. Big Data Europe has now come to a close, but we encourage everyone to learn more about the platform and start planning your big data project today!
The BigDataEurope (BDE) project came to a close at the end of 2017 with a number of technical results to show after three years of development and pilot testing. A key outcome of the project was the Big Data Integrator Platform(BDI), which provides an integrated stack of tools that allow large-scale data resources to be processed, analysed and published without the need for native installations of additional tools for data processing at scale.
As an ecosystem of specifications and reference implementations, BDI has tremendoius potential for deployment across sectors and for a range of players in the data value chain.
During the course of the project, BDE’s Thessaloniki-based transport pilot, which represents the EU’s fourth societal challenge (SC4), carried out important development and testing of the BDI Platform.
In our final webinar entitled The Way Forward for Big Data in Transport we will present:
results from the transport pilot’s use of the BDI Platform
conclusions from BDE’s SC4 workshop: BigDataEurope and the Societal Challenge on Transport. (The workshop, held in September 2017 collected feedback from stakeholders requiring transport solutions on how the platform can be extended to increase its value and facilitate further applications.)
next steps for big data in transport (in cooperation with LeMO – another EU project focussing on big data in the transport sector)
Agenda: The Way Forward for Big Data in Transport
Introduction to the BigDataEurope project
Josep Maria Salanova – CERTH (10:00 – 10:05)
Summary and conclusions from BDE SC4 Workshop: BigDataEurope and the Societal Challenge on Transport
Maxime Flament – ERTICO-ITS Europe (10:05 – 10:15)
Final Report on the Transport Pilot Using the Big Data Europe Integrator Platform
Luigi Selmi – Fraunhofer IAIS(10:15-10:25)
Big Data in Transport: Next Steps with LeMO project
The EU SatCen organised on Wednesday 13th of December 2017 (15.00-16.00 CET) a Hangout session on “Big Data for Secure Societies” in the framework of the BigDataEurope project and with regard to the “Secure Societies” Horizon 2020 Societal Challenge. The Hangout was the fifth of a scheduled series in the BigDataEurope project for the Secure Societies domain and it has been followed by attendees coming from EC, EU entities, ESA, private companies, universities and other public entities from a variety of domains in Secure Societies.
The opening presentation was delivered by Sergio Albani (EU SatCen, Secure Societies Domain Leader).
The presentation made a recap of the BigDataEurope project, highlighting the role of the EU SatCen and reviewed the related community building activities addressing the “Secure Societies” challenge (the series of “Big Data in Secure Societies” workshops, the “Big Data for Secure Societies” webinars and hangouts, and the participation at international events).
The second presentation was delivered by Giorgos Argyriou (University of Athens, Secure Societies Technical Leader), who made an overarching picture of implementation aspects of the Secure Societies pilot, reviewing the architecture, data sources, and implemented workflows, focusing on the Change Detection Workflow. The presentation ended with a demo of the Secure Societies pilot.
The Hangout continued with the presentation of George Giannakopoulous and Nikiforos Pittaras (NSCR “Demokritos”, Secure Societies Technical Support), who illustrated the Event Detection workflow with respect to its components, the algorithm and its scalability and how the Location Extraction, Entity Extraction and the Image Extractor have been implemented.
The Hangout was concluded by the presentation of Michele Lazzarini (EU SatCen, Project Officer), who illustrates others H2020 projects where SatCen is involved (e.g. EVER-EST, NextGEOSS and BETTER) and the possible scenarios where the activities started with BigDataEurope will continue in the future.
We are happy to announce SANSA 0.3 – the third release of the Scalable Semantic Analytics Stack. SANSA employs distributed computing via Apache Spark and Flink in order to allow scalable machine learning, inference and querying capabilities for large knowledge graphs.
[BigDataEurope (BDE) SC4 and the LeMO project have established a cooperation, as both focus on big data in the transport sector. LeMO project representatives Arnaud Burgess and Maria Rodrigues (Panteia) already participated in the workshop, organised by BDE SC4, in September to present their project. Now, Tharsis Teoh (Panteia) has kindly contributed a blog entry.]
By Tharsis Teoh (written on 15th December 2017)
At a recent convention on urban logistics, I had the opportunity to meet some of the most innovative start-ups in the field. The products on offer ranged from an ultra-fast laundry delivery service to clothing e-retailers. One consistent theme in each of their presentations was the obsessive need for collecting data about their customers, their partners, the traffic system, their fleet, the weather, and about everything else they could get their hands on. Were they talking about big data or just a lot of data? In some cases, the line was blurred. In most cases, regardless of whether they currently used it, they definitely spoke as if they needed BIG data.
Similar discussions are had all across the transport industry: from providers of transport services, integrators, transport infrastructure providers, up to the regulators. On one hand, it is clear that there are significant benefits that big data promises; the enthusiasm and running business models of the start-ups made that clear. One clear example of how big data enhances business models (or in this case, cooperative business models) is in the sharing of public transport fare revenue among different transport operators for subscription holders. Previous models had to be recalibrated by extensive surveys, but can now instead be done via big data techniques and boatloads of transit card data. But on the other hand, it is still early days on how significant, we can expect these benefits to be. The sceptics always ask the same question: “Is the hype real?” Regardless of our opinions on this, the industry is moving in this direction; and entrepreneurs and businesses need to keep up.
The interest in the promise of big data by regulators and public bodies overlap somewhat with the industry, i.e. to achieve sustainability objectives by using the technology. But, more importantly regulators need to protect the privacy of their citizens (see the soon-to-be-formally binding General Data Protection Regulation (GDPR) or similar regulations at the national level), and guard their institutions, systems, and businesses from cyber-attacks or manipulation (a bigly theme in 2016 and 2017). Ethical questions also hover over the regulation (that is, the question of jurisdiction) and ownership of the data (by the harvester, collector, or the source). In other words, big questions still remain on this big data thing.
With that in mind, we are very excited to announce our recently launched research project Leveraging Big Data to Manage Transport Operations (LeMO) that aims to address these issues (among many others). One of the main outputs, which we will ultimately develop is a research and policy roadmap for the European Union. The aim is provide a sustainable, ethical, efficient, and effective approach to tackle the difficulties that lie in the use of big data. The main project partners are leaders and major stakeholders in the field: Western Norway Research Institute, Goethe University of Frankfurt, Confederation of Organisations in Road Transport Enforcement, Bird & Bird, and PANTEIA. Our key focus will be the analysis of state-of-the-art applications in the transport industry itself (see our list of case studies), where we examine the institutional, regulatory, and technical barriers and facilitators of using big data, as experienced by the industry.
In many ways, this takes over, where BigDataEurope leaves off. While the focus in the Transport Pilots focused on developing Big Data techniques and current applications, the LeMO project looks across the horizon to build a strategic roadmap. Many of the insights into the opportunities and challenges will feed into the development of the right research and policy roadmaps. Certainly, BigDataEurope’s mark will be present in defining the big data transport strategy of Europe in the coming decades.
We’ll continue to update our project page, with our findings during the coming months, so please follow our updates via twitter and get in touch with us.
The 3rd edition of the Big Data from Space Conference (jointly organised by ESA, SatCen and JRC, and hosted by CNES) brought together in Toulouse around 500 participants interested in exploiting massive spatio-temporal Earth and Space observation data.
The Conference was co-chaired by Sergio Albani (SatCen), Jean-Pierre Gleyzes (CNES), Pier Giorgio Marchetti (ESA) and Pierre Soille (JRC).
The main challenges and issues in the Space and Security domain, pointing out the added value coming from Big Data and related technologies as well as the need of operational solutions tailored to user needs, were introduced during one of the opening talk given by SatCen Deputy Director Giuseppe D’Amico.
The key role that cooperation activities and international projects participation play in the Space and Security domain, and the efforts made by the SatCen RTDI Unit to increase R&I capacities in support to operations, were highlighted by Sergio Albani, Responsible for the RTDI Unit and BDE SC7 “Secure Societies” Domain Leader. The presentation emphasized the internal and external initiatives that are taking place (e.g. the participation in H2020 projects such as BigDataEurope) to collect user requirements from key stakeholders in the Space and Security domain and evaluate new trending technologies.
[BigDataEurope (BDE) SC4 and the Transforming Transport project have established a cooperation, as both focus on big data in the transport sector. Transforming Transport project coordinator Rodrigo Castiñeira González (INDRA) already participated in the workshop, organised by BDE SC4, in September to present their project. Now, he has kindly contributed a blog entry.]
By Rodrigo Castiñeira González (written on 10th December 2017)
As the BigDataEurope project identified in their analysis of the status of big data technologies in different sectors of society, transport and logistics is one of the main domains where big data technologies can provide a significant impact at European level. In the transport sector, big data is expected to lead to 500 billion USD in value worldwide in the form of time and fuel savings, and savings of 380 megatons of CO2. With freight transport activities projected to increase by 40% in 2030, transforming the current mobility and logistics processes to become significantly more efficient, will have a profound impact. A 10% efficiency improvement may lead to EU cost savings of 100 billion EUR.
Despite these estimations, interestingly only 19 % of EU mobility and logistics companies employ Big Data solutions as part of value creation and business processes. This fact was the underlying reason for building Transforming Transport, an innovation project that brings together 48 organisations within the transport sector that believe big data can provide a significant impact on transport efficiency.
During the final BigDataEurope workshop on the transport societal challenge, the results of a pilot in Thessaloniki related to connected vehicles were presented to show the impact of big data technologies. Transforming Transport, as a lighthouse project, also includes the idea of piloting but at a bigger scale. During the project, 13 pilots will be deployed across Europe and in different domains: Smart Highways, Connected Vehicles, Rail Infrastructure, Ports, E-Commerce, Airports and urban mobility. These pilots do not work in isolation but collaborate and cross-fertilize each other. Starting from common requirements of the pilot domains, experience in applying big data technologies and data assets is starting to be shared among pilots.
Each of these pilots will employ dedicated data analytics solutions best suited for the specific pilot needs and datasets, allowing the pilots to define their specialized data analytics solutions. In addition, each pilot will exploit big data infrastructures, which are best suited and closely linked with the data sources of the pilot.
With all these pilots, Transforming Transport expects to deliver a profound economic and societal impact in the transport sector demonstrating the technical and economic viability of big data to reshape transport processes and services. In addition, the project will contribute to the needed paradigm shift in order for transport data owners to realize the potential of their data assets and for transport and logistics companies to start employing Big Data solutions in the near future.
From the project coordination team, we thank the BigDataEurope consortium for the invitation to the workshop, as well as all our colleagues from the Transforming Transport project for their contributions, inspiring discussions and fruitful collaborations. We would also like to thank ERTICO – ITS Europe, the leader of the transport societal challenge in the BigDataEurope project, for their active participation in the Transforming Transport Advisory Board.
As the BigDataEurope project comes to an end, we are pleased to have one last opportunity as a consortium to demonstrate the value of the primary technical result (support) of the 3-year Coordination and Support Action. No doubt, after the project’s end we are still committed to extend these efforts, and the platform is already being used in a number of different initiatives and new projects.
The Big Data Integrator (BDI) platform will be demonstrated by one of our core technical project members at the Health-focussed Workshop in the last round of Societal Challenge Workshops held in 2017. Participants will be able to learn about the platform, abut how to deploy it for their own needs, and will have the opportunity to ask questions and clarify concerns.
The session is scheduled for late morning (includes lunch) and registration for the workshop remains FREE! For those interested to attend in Brussels, please Register Here.
On 23rd of November the 6th and final webinar / hangout of the Big Data Europe SC6 team (Europe in a changing world – inclusive, innovative and reflective societies) took place with a presentation by Fernando Reis, member of the Big Data Task Force at Eurostat. Fernando gave interesting insights into the field of big data and smart data and how these new principles and technologies can be used in / applied to the domain of statistics. The title of the webinar was: From Big Data to trusted Smart Statistics.
The following material is available from this webinar:
Big Data Europe / Cessda introduction by Ivana Versic (Cessda)