Empowering Communities with Data Technologies. Big Data can make important contributions to the technical progress in our societal key sectors and help shape business. What is needed are innovative technologies, strategies and competencies for the beneficial use of Big Data to address societal needs and Big Data Europe provides you with it.
We are happy to announce SANSA 0.5 – the fifth release of the Scalable Semantic Analytics Stack. SANSA employs distributed computing via Apache Spark and Flink in order to allow scalable machine learning, inference and querying capabilities for large knowledge graphs.
Boost 4.0 is the largest European initiative in Big Data for Industry 4.0. Boost 4.0, has a budget of 20M euros, a private investment of 100M euros and a 50 companies consortium from 16 countries, all of them coordinated by Innovalia Group. This initiative will lead the construction of the European Industrial Data Space to improve the competitiveness of the European Automotive Industry and will guide the manufacturing industry in the introduction of Big Data in the factory, providing with the necessary tools to obtain the maximum benefit of the Big Data industrial value.
The Boost 4.0 initiative will establish a group of smart and connected factories in Europe that will serve as a guide for the European industry. Apart from making possible the collaboration between the largest European industrial companies, Boost 4.0 has a €20M funding and will last 36 months. This initiative will try to accelerate the adoption of Big Data and advanced analysis solutions in the European Automotive Industry thanks to global standards, open APIs, secure digital infrastructures, trusted Big Data Middleware and digital manufacturing platforms.
Boost 4.0 is led by the Basque industry and will have a great impact on the automotive industry and in the capital goods, these are strategic sectors in the Basque economy and pillars of the Basque Industry 4.0 strategy. With this initiative, and being driven from the Basque Country, Boost 4.0 will bring very significant improvements with productivity increases close to a 20% and reductions of 50% in unexpected maintenance operations. More specifically Boost 4.0 is led by the Basque industrial group Innovalia. It is a project that has been managed to form a great team with the main European industrial companies including Gestamp, Volvo, Volkswagen, Capvidia, Philips, Siemens, IBM, and Telefónica among many other representative companies of the European Industry.
The BigDataEurope consortium would like to thank all stakeholders for following the project, attending our activities and contributing to the results. Your endorsement and participation contributed to a successful outcome!
Summary of Major Results
One can summarise the results of the project in three categories:
Strengthening the Societal Communities: the large number of project activities provided a platform for stakeholders interest in the seven societal challenges could come together, network, identify common issues and identify common solutions – the latter, at least the ones of a technical nature, largely supported by the project. We augur that a large part of the communities strengthened by the project will continue to work closely together.
BigDataIntegrator Platform: perhaps the most concrete project result, the BDI is a flexible and open-source platform that can be more easily deployed and customised to build Big Data pipelines that address open-ended challenges. Based on the Docker virtualization, the base platform is enriched with a layer of services that support the workflows’ setup, creation and maintenance. Supported by a simple graphical UI, it offers basic building blocks (e.g. Apache Spark, Hadoop HDFS, Apache Flink, etc.) to get started with common Big Data technologies. The BDI continues to be maintained (on Github) beyond the project, and is being used in various external projects and initiatives. Given it’s impact in the big data technical area, it is also being proposed as an Apache Incubator.
Pilot Demonstrations: the value of the BDI has been demonstrated in 7 separate pipelines that target a selected big data problem from each of the 7 societal challenges. These pipelines extend a predefined BDI pipelines designed for each of the societal challenges, based on the requirements identified for each domain. The pilots have been useful to demonstrate the flexibility of the BDI platform and its ability to target big data challenges of a varying from any domain. Some of the final pilots have taken a life of their own, and are being extended in follow-up projects and initiatives.
In addition to the above, the large amount of valuable material generated by the project is available for posterity on the project profiles:
Youtube Channel (50 videos): The recorded technical webinars (e.g. final BDI launch, relevance in the context of activities like the Big Data Value Association) and societal hangouts; demonstrations of BDI and its pilots, and interviews with the developers. SlideShare (237 slides): All project presentations, from a wide variety of physical and online activities (including all workshops, webinars, hangouts and external events). Flickr: Pictures from the physical events (workshops, conferences and other events).
Below is a list of H2020 and other projects that build on the BigDataEurope results, most notably by adapting a BDI pipeline for their needs. The list is valid until early 2018 and might not be updated at a later date.
Big-data Earth observation Technology and Tools Enhancing Research and development is an EU-H2020 research and innovation project, started in November 2017 to the end of October 2020.
The project’s main objective is to implement Big Data solutions (denominated as Data Pipelines) based on the usage of large volumes and heterogeneous Earth Observation datasets. This should help addressing key Societal Challenges, so the users can focus on the analysis of the extraction of the potential knowledge within the data and not on the processing of the data itself.
To achieve that, BETTER is improving the way Big Data service developers interact with end-users. After defining the challenges, the promoters validate the pipelines requirements and co-design the solution with a dedicated development team in a workshop. During the implementation, promoters can continuously test and validate the pipelines. Later, the implemented pipelines will be used by the public in the scope of Hackathons, enabling the use of specific solutions in other areas and the collection of additional user feedback. www.ec-better.eu
We are happy to announce SANSA 0.4 – the fourth release of the Scalable Semantic Analytics Stack. SANSA employs distributed computing via Apache Spark and Flink in order to allow scalable machine learning, inference and querying capabilities for large knowledge graphs.