Skip to main content

Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.

Jump to: navigation, search

Difference between revisions of "AICE OpenLab WG"

(Candidate 2: Massive data ingest and management)
(Redirected page to AICE WG/)
 
(115 intermediate revisions by the same user not shown)
Line 1: Line 1:
[LOGO]
+
#REDIRECT [[AICE_WG/]]
The OpenADx Working Group wants to serve in the field of software tools for the realization of autonomous driving (AD) by defining open interfacing standards for software for use in vehicle based systems and in testing environments, where the second will typically be realized by means of cloud services doing at least software builds, virtual test runs and collecting results. The name OpenADx thus stands for "Open, Autonomous Driving Accelerator". The group is formed by a multitude of parties from various parts of the world and supported by several well-known industry companies. The OpenADx Working Group is set up as a working group under the governance of the Eclipse Foundation.
+
 
+
Please find the home page and the news ticker of the OpenADx Working Group '''[https://openadx.eclipse.org here] (https://openadx.eclipse.org)'''.
+
 
+
= Welcome to AICE =
+
 
+
'''This initiative addresses three areas of interest:'''
+
 
+
1) Artificial Intelligence
+
2) Cloud
+
3) Edge
+
 
+
= Principle foundations of the initiative =
+
* This OpenLab is envisioned to be the platform to conduct AI, Cloud & Edge development, tests and (reference) implementations, based on existing open standards and the standards as set by various EU initiatives (e.g. AI4EU and Gaia-X) with an international reach.
+
* Topics such as governance, collaboration, processes re communication and specification will follow the guiding principles of open source, as promoted by the Eclipse Foundation.
+
* Membership of the initiative is open to all AI industry stakeholders under the premise they adhere to its bylaws.
+
* Specifications, technology and projects brought to and/or developed in the OpenLab will be distributed under the EPL 2.0 license or possibly MIT, Apache or BSD.
+
 
+
 
+
 
+
== Participants ==
+
 
+
{| class="wikitable sortable"
+
! Organisation 
+
|-
+
| ATB
+
|
+
|-
+
|-
+
| Castalia Solutions
+
|
+
|-
+
|-
+
| Continental
+
|
+
|-
+
|-
+
| Engineering Group
+
|
+
|-
+
|-
+
| Eurotech
+
|
+
|-
+
|-
+
| Fraunhofer FOKUS
+
|
+
|-
+
|-
+
| Huawei
+
|
+
|-
+
|-
+
| Itemis
+
|
+
|-
+
|-
+
| Kairos
+
|
+
|-
+
|-
+
| Konduit
+
|
+
|-
+
|-
+
| OpenADx
+
|
+
|-
+
|-
+
| Ortelio
+
|
+
|-
+
|-
+
| SmartClide
+
|
+
|-
+
|-
+
| University of Macedonia
+
|
+
|-
+
|-
+
| University of Skövde
+
|
+
|-
+
|-
+
| Warren.io
+
|
+
|-
+
|-
+
|
+
|-
+
 
+
|}
+
 
+
== Steering Committee 2021/2022 ==
+
{| class="wikitable sortable"
+
! Company  !! Name !! Role
+
|-
+
| TBD
+
 
+
== Related Projects and Project Proposals ==
+
 
+
=== Eclipse iceoryx ===
+
 
+
In domains like automotive, robotics or gaming, a huge amount of data must be transferred between different parts of the system. If these parts are actually different processes on a POSIX based operating system like Linux, this huge amount of data has to be transferred via an inter-process-communication (IPC) mechanism.
+
The mechanisms provided by the operating system, like message queues, normally require to copy the data and are subject to context switches between user and kernel space. In fact, it is often not only one but many copies of the transferred data between the sender and the receiver. If it comes to GBytes/s data exchange rates, avoiding these copies becomes a crucial factor.
+
Eclipse iceoryx is a middleware with a zero-copy shared memory approach which is optimized for the huge data inter-process-communication.
+
 
+
'''Status''': [https://projects.eclipse.org/projects/technology.iceoryx Project Eclipse iceoryx]
+
 
+
'''GitHub repository''': [https://github.com/eclipse/iceoryx Eclipse iceoryx GitHub]
+
 
+
== Challenge ==
+
AD is a complex challenge and therefore requires a multifaceted development process incorporating a variety of software tools. The tools the industry currently uses are very good, but they don’t seamlessly work with one another. This is a result of the tools not being designed to work together. This is an industry-wide issue that slows us down in the race to AD development. By pooling resources, we can remove the “friction” between widely used tools. We can create something of use to all of us: open, compatible and accessible.
+
 
+
[[File:OpenADx Grafiken weiß 72dpi Automated driving is a complex challenge.jpg]]
+
 
+
=== Problem and benefits for OEMs and Tier1s ===
+
 
+
'''User insight:''' ''"Developing automated driving functions is extremely complicated and requires the use of many complex software tools which do not work efficiently with one another. What I need is a set of tools which work with each other seamlessly so that my teams can move through the development process more quickly and efficiently."
+
''
+
 
+
'''Benefit:''' The automated driving tool chain allows your team to work together more efficiently with a suite of highly integrated tools by enabling seamless transfer of data and code through each step of the automated driving development process.
+
 
+
=== Problem and benefits for tool and technology providers ===
+
 
+
'''''User insight:''' "Currently, tools used to create automated driving applications do not work efficiently with one another. If our tool/technology is compatible with other widely used technologies and tools, it will ease the development process for our customers and make our products even more attractive to them."''
+
 
+
'''Benefit:''' The seamless integration of your technology in the automated driving tool chain makes it more attractive to organizations developing automated driving applications by increasing their development efficiency.
+
 
+
 
+
 
+
=== Approach ===
+
 
+
We believe an initiative like this should be inclusive, not exclusive. It’s about removing barriers to efficient development with widely established tools. It’s about bundling industry competencies and sharing development. We plan to demonstrate our ability to work together on joint testbeds in an open source setting. This allows potential partners to engage with a limited initial investment. The testbeds produce demonstrable results and strengthen confidence in the approach.
+
 
+
=== The Idea of Testbeds ===
+
 
+
Testbeds are setup to produce demonstrable results that incubate potential open source projects. To realize a testbed the idea is to prepare a use case/topic in a series of workshops and to execute so called Hack-Fests which assemble developers from the cooperation partners for a defined period of time, e.g. 3-4 days, in which they realize a demonstrator or prototype.
+
 
+
To identify testbed candidates, everybody is invited to propose ideas here to build a starting point for  development of the idea towards the requirements for the execution of a Hack-Fest and for winning further interested parties.
+
 
+
To execute a Hack-Fest, we have identified these minimum requirements to make this a fruitful event:
+
* A minimum of two partners collaborating on the testbed, be it companies, universities or research organizations
+
* A minimum of 5 committed participants
+
 
+
'''Workflow for testbed candidates'''
+
# Verbalization of a task in use case form, which has potential for further work
+
# Contribution of the use cases by interested partners as testbed candidates
+
# Preparation of the testbed candidates in one or a series of workshops to a state that is sufficient for the participants of a HackFest to produce results
+
# Execution of the Hack-Fest
+
# Evaluation of the Hack-Fest results to decide on whether to follow the idea or to stop the effort
+
# Reworking the Hack-Fest results to build a contribution either to an existing project or as an initial contribution of a new open source project
+
 
+
== Who We Are and How to Join ==
+
 
+
As we have a [https://openadx.eclipse.org/ public website] it would be nice to give newcomers an understanding who is involved and how to interact with us. 
+
 
+
=== How to participate in OpenADx? ===
+
 
+
OpenADx is still in an early stage, means, since 25th June 2019 we are an official Eclipse Working Group which consists of more than 10 member companies, who are shaping the Working Group, which is done in the [https://wiki.eclipse.org/OpenADx#Meeting_Minutes Steering Committee.]
+
We are currently in the “Incubation Phase” where we define the future proceeding of the working group.
+
 
+
OpenADx is an open working group so everyone can participate!
+
 
+
Feel free to use our [https://dev.eclipse.org/mailman/listinfo/openadx mailing list] to start a discussion or to be part of one, to get answers to your questions around OpenADx and of course to stay tuned!
+
You can use the solutions we provide in compliance with the open source license of the specific product.
+
 
+
From time to time, there will be also some [https://wiki.eclipse.org/OpenADx#Meeting_Minutes_2 workshops], which will be announced via our [https://openadx.eclipse.org/events/ website], [https://wiki.eclipse.org/OpenADx wiki] and [https://dev.eclipse.org/mailman/listinfo/openadx mailing list]. So feel free to participate!
+
 
+
If you would like to engage more, e.g. to shape the working group together with us, you have to fulfil some prerequisites:
+
* You / your company has to be at least an [https://www.eclipse.org/membership/become_a_member/ Eclipse Solution Member]
+
* You / your company has to sign the [https://www.eclipse.org/org/workinggroups/wpga/openadx_working_group_participation_agreement.pdf OpenADx Working Group Participation Agreement] and to decide your [https://www.eclipse.org/org/workinggroups/openadx_charter.php current membership level (explained in the Working Group Charter)]
+
 
+
Our recommendation is “Participant Member” for the incubation phase and “Driver Member” after the incubation phase to have the biggest possible influence in the working group.
+
 
+
For further questions, you can use our [https://dev.eclipse.org/mailman/listinfo/openadx mailing list]. ;-)
+
 
+
=== Interested Parties ===
+
 
+
Please add the name of your organization if you are interested in AICE or tell us to do it for you.
+
 
+
* ATB
+
* Castalia Solutions
+
* Continental
+
* Engineering Group
+
* Eurotech
+
* Fraunhofer FOKUS
+
* Huawei
+
* Itemis
+
* Kairos
+
* Konduit
+
* OpenADx
+
* Ortelio
+
* SmartClide
+
* University of Macedonia
+
* University of Skövde
+
* Warren.io
+
 
+
=== Communication ===
+
 
+
* We have a mailing list: Subscribe for news and discussions (link 2b changed): [https://dev.eclipse.org/mailman/listinfo/openadx Mailing list]
+
* We have workshops with introduction sessions and have just started to work on concrete testbeds to identify topics that we agree to collaborate on. Currently these workshops are weekly telecons. Please check the mailing list for invitations or ask questions regarding content or participation
+
 
+
==== Presentations ====
+
<a href="https://www.youtube.com/watch?v=7h2DT2Xn0No&list=PLy7t4z5SYNaS5YMnhtOhZyLdMDxsQFNZz" target="new">Google</a>
+
* Towards an open source AI initiative at the Eclipse Foundation: [https://www.youtube.com/watch?v=7h2DT2Xn0No&list=PLy7t4z5SYNaS5YMnhtOhZyLdMDxsQFNZz]
+
* Political challenges and opportunities in making open source AI mainstream: [https://www.youtube.com/watch?v=Isr3diSB30c&list=PLy7t4z5SYNaS5YMnhtOhZyLdMDxsQFNZz&index=2]
+
* Eclipse Deeplearning4j: How to run AI workloads on Jakarta EE compliant servers: [https://www.youtube.com/watch?v=B3a7ceU3API&list=PLy7t4z5SYNaS5YMnhtOhZyLdMDxsQFNZz&index=3]
+
* Meet MindSpore, the new open source AI framework!: [https://www.youtube.com/watch?v=pqgQaVOcVV0&list=PLy7t4z5SYNaS5YMnhtOhZyLdMDxsQFNZz&index=4]
+
* Q & A: [https://www.youtube.com/watch?v=ajhubu-LVBk&list=PLy7t4z5SYNaS5YMnhtOhZyLdMDxsQFNZz&index=5]
+
* Welcome Message | Gaël Blondelle | Open Source AI Workshop S1E2: [https://www.youtube.com/watch?v=cGQJ9BLichk&list=PLy7t4z5SYNaS5YMnhtOhZyLdMDxsQFNZz&index=6]
+
* Trustworthy AI & Open Source | Eclipse Open Source AI Workshop S1E2: [https://www.youtube.com/watch?v=QU-0NvkVxHc&list=PLy7t4z5SYNaS5YMnhtOhZyLdMDxsQFNZz&index=7]
+
* Introduction to Pixano: an Open Source Tool to Assist Annotation of Image Databases | Open Source AI: [https://www.youtube.com/watch?v=8W1l9TOHeu8&list=PLy7t4z5SYNaS5YMnhtOhZyLdMDxsQFNZz&index=8]
+
 
+
==== Upcoming Presentations ====
+
* see also [https://...]
+
 
+
==== Press releases ====
+
* XXX published in Magazine XXX: [https://...]
+
 
+
==== Blog posts ====
+
* [https://...]
+
 
+
==== AICE logo ====
+
A logo design contest is to be scheduled. Please check the mailinglist for further details (hot link!).
+
 
+
 
+
Copyright Eclipse Foundation
+
 
+
== Testbed Candidates ==
+
 
+
=== Candidate 1: Simulation ===
+
 
+
'''Challenge'''
+
 
+
The challenge in the simulation of AD functions is the big amount of test cases which can be easily generated by variation of parameters.
+
This big amount of test cases should be handled with parallel execution of test case in multiple instances of the simulation environment.
+
 
+
==== Use Case Step 1 ====
+
 
+
Target for step 1 of the testbed is the easy integration of simulation tools and function under test allowing to feed a test scenario into the simulation and to get out data for further analysis and visualization.
+
 
+
'''Acceptance Criteria:'''
+
* The simulation can easily be set up, necessary functionality for integrating and coordinating the different components of the simulation is available.
+
* Sinks for simulation data out of the single components but also out of the communication between the components can be attached and the data can be logged and processed during the simulation.
+
* The framework allows to integrate multiple simulation tools and offers a standard communication mechanism. New tools can be integrated by providing a connector between the communication mechanism and the tool.
+
* The simulation execution setup is prepared for containerization in order to support easy setup and execution in parallel on a scalable hardware platform without extensive installation and maintenance efforts.
+
 
+
'''Goal for Step 1:'''
+
Create demonstrators that combine a simple function under test provided by Bosch and the different simulation tools which come with a relevant plant model. For scenarios to demonstrate it is planned to look into Pegasus with the potential addition of a traffic simulated by Eclipse Sumo. The scenario should be based on a closed-loop simulation that uses a model of identified objects as input for the control algorithm.
+
 
+
==== Base Architecture Step 1 ====
+
 
+
The following picture shows the basic idea for the realization of step 1.
+
 
+
[[File:OpenADxTestbed1FuncArch.png]]
+
 
+
The base decision is to use DDS as the central messaging service between the simulation components. The DDS component has to be chosen in a ROS2 compatible way in order to use the ROS2 mechanisms for data access. DDS/ROS2 compliant components are connected directly to the DDS layer, whereas simulation components not compatible with DDS are attached using a dedicated connector between the component and the DDS-API.
+
 
+
The Simulation Framework is basically a conglomeration of support functionality which builds the glue between the participating components. It offers functionality like the above mentioned connectors, but also time management and other functionality needed to smoothly run the simulation. ''This component is the main target for the testbeds step 1'', since it contains the stuff needed but not provided by existing tools.
+
 
+
On top of these base functionalities, there are simulation tools and the function under test which build the core of the simulation, i.e., the representation of the environment and the control algorithms which observe or even act in this environment. Both provide information on the simulation state in addition to ROS2 means which record the communication between the components.
+
 
+
All recorded data is stored in defined measurement data formats that are stored for further processing. This is represented by the Measurement Data component in the picture which is basically an interface to testbed candidate 2, resp., storing and further processing the recorded data in offline analysis.
+
 
+
For online analysis, tools for visualization or introspection can connect to the DDS communication in the same fashion as the simulation components. This connection allows to control the simulation, e.g., for debugging purposes. The mechanisms rely on the possibilities of ROS2 for interacting with the simulation components.
+
 
+
Tools under investigation concerning usage in the demonstrator currently are:
+
* DDS - implementation (tbd)
+
* ROS2/RVIZ
+
* Matlab/Simulink
+
* DYNA4
+
* AirSim
+
* Gazebo
+
* Dymola (Modelica) ?
+
 
+
==== Topics for Step 2 ====
+
 
+
Step 1 creates a simulation environment, that can run "out-of-the-box" with simple configuration. A logical step is to embed this stuff in a management framework that allows to manage scenarios and test cases and on the other hand side supports in gathering the results and evaluate the outcome whether important test criteria have been met or whether test cases have failed while doing that on a large scale in a parallel fashion.
+
 
+
==== Glossary ====
+
 
+
Relevant technologies for this testbed are
+
* Eclipse SUMO (Simulation of Urban Mobility) - [http://www.dlr.de/ts/de/desktopdefault.aspx/tabid-9883/16931_read-41 http://www.dlr.de/ts/de/desktopdefault.aspx/tabid-9883/16931_read-41]
+
* OpenPASS - [https://projects.eclipse.org/proposals/simopenpass https://projects.eclipse.org/proposals/simopenpass]
+
* OpenMDM - [https://www.openmdm.org https://www.openmdm.org]
+
* OpenDrive - [http://www.opendrive.org http://www.opendrive.org]
+
* OpenScenario - [http://www.openscenario.org http://www.openscenario.org]
+
* OpenCRG - [http://www.opencrg.org http://www.opencrg.org]
+
* Open Simulation Interface - [https://github.com/OpenSimulationInterface/open-simulation-interface/wiki https://github.com/OpenSimulationInterface/open-simulation-interface/wiki]
+
* AirSim - [https://www.microsoft.com/en-us/research/project/aerial-informatics-robotics-platform https://www.microsoft.com/en-us/research/project/aerial-informatics-robotics-platform]
+
* Autonomous Driving Cookbook - [https://github.com/Microsoft/AutonomousDrivingCookbook https://github.com/Microsoft/AutonomousDrivingCookbook]
+
* ROS - [http://www.ros.org http://www.ros.org]
+
* Gazebo - [http://wiki.ros.org/gazebo http://wiki.ros.org/gazebo]
+
* Pegasus - [http://www.pegasus-projekt.info/en/home http://www.pegasus-projekt.info/en/home]
+
* Proprietary Tools
+
 
+
== News ==
+
 
+
Please have a look to our latest news on our official [https://openadx.eclipse.org/news/ OpenADx web site]
+
 
+
== Events ==
+
 
+
 
+
 
+
== Meeting Minutes ==
+
 
+
Link to the [https://wiki.eclipse.org/AICE/MeetingMinutes Meeting Minutes]
+
 
+
== Assets ==
+
Pitch deck to be used inside of respective organizations [[File:AICEInformationDeck.zip]]
+
 
+
[[Category:Eclipse IWG]]
+
[[Category:Super Community]]
+

Latest revision as of 11:52, 16 December 2021

Redirect to:

Back to the top