This proposal has been approved and the Eclipse Package Drone project has been created.
Visit the project page for the latest information and development.

Package Drone

Sunday, February 1, 2015 - 09:08 by Jens Reimann
This proposal is in the Project Proposal Phase (as defined in the Eclipse Development Process) and is written to declare its intent and scope. We solicit additional participation and input from the community. Please login and add your feedback in the comments section.
Parent Project
Proposal State
Created
Background

Over time, OSGi has become a very important part of the Eclipse technology stack. For instance, it enables Eclipse SCADA to be configured at runtime as well as providing the possibility to deploy bug-fixes while the SCADA applications are running. During this time we also improved our build process. Nevertheless bridging the worlds between Maven, Tycho, Eclipse PDE and other tools like BND is still a major pain point. A big missing puzzle piece was a software artifact repository where OSGi bundles are first class citizens. Each of the existing repositories have Maven in mind, OSGi is only an afterthought. To solve this, we developed Package Drone, an OSGi first software artifact repository.

Scope

The scope of this project is to create an open source, OSGi based, web enabled repository for software artifacts with special considerations for the necessities of OSGi bundles and its metadata. It is however not limited to the specific use case of OSGi bundles, but also provides extension points to allow for other artifacts and repository formats like DEB/APT and RPM/YUM.

It supports:

  • Storing and serving software artifacts (support for Maven Tycho deployments, manually uploaded OSGi bundles)
  • Extracting metadata and aggregating information of these (e.g. to provide automatically generated features)
  • Providing a local developer workflow (channels can be created for specific releases and made public when they are finished)
  • Allowing extensions to the system to also support other software artifact and repository formats (automatic provision of P2 or R5 repositories)
  • Provide a Web UI and build a foundation to support an OSGi enabled Web UI

The focus is not on recreating every feature which already exists in other repositories, but to focus on flexibility in providing different views on the same existing artifacts. Additional functionality like seraching bundles by exported packages would be a very good extension, but is not planned as part of the core project.

Description

Package Drone is a software artifact repository where OSGi bundles are first class citizens. The basic idea is, that through some process, be it a build or some manual upload, OSGi bundles get deployed to the repository. This can be restricted to specific named channels. In that way it is possible to tweak the code and the build process to a point where the developers are satisfied with the state of the channel and then it can be made public (e.g. a release). That means for a user of such a channel, it will always have a consistent state, and its not only half there because some build broke in the middle. Metadata to the artifacts can be deployed and will be stored alongside the artifacts (e.g. maven checksum files), alternatively they can also be either extracted from the uploaded artifacts (e.g. OSGi bundle name, file size, ...) or created automatically (e.g. checksums) through a so called channel aspect.

On the other side, artifacts can be consumed by other parties. That could be a build process, but it also could be the Eclipse IDE in the shape of a software site. Package Drone provides different views on its stored artifacts. So the same bundles can be provided as repositories of different formats: P2, OSGi R5 or even as apt or rpm repositories. Through its extensible nature it is easily possible to support other formats as well.

Package Drone can for instance jump in the gap in the beginning of a software project, where you might already have some software developed but the whole deployment process is not finished. Lets say you want to provide one or more bundles for testing, then with Package Drone you just throw it into a channel and any interested party can use it as an Eclipse update site.

Or you are a user of bndtools and want to use a P2 site. Thats not possible unless somebody writes a repository adapter for P2. With Package Drone you can just import an existing P2 site (or deploy to it through Maven Tycho) and have it available as a R5 repository which in turn can be used by bndtools out of the box.

Package Drone is intended for use by a local developer team, not as a central instance (like Maven Central).

Why Here?

Eclipse is the best home for OSGi development which also relates to Eclipse PDE, Maven Tycho and Bndtools.

Also is the current core based on Jetty, Equinox, Eclipse Link and a few others.

It could also be used within the Eclipse infrastructure to make it easy for any Eclipse project to provide its software in easy to consume form.

Future Work

The next features would be to:

  • Provide support consumation as Maven 2 repositories (currently it can be used as a Maven 2 deployment target)
  • Provide support for DEB and RPM with APT and YUM as repository format
  • Add method to import and export from various other repository systems
    • Mirror from maven (central)
    • Mirror from P2
    • Export to P2 ZIP file
    • Spool out to file system
  • Add fine grained security
Project Scheduling

The initial contribution would come right now. There are a few alpha releases and ind the next few weeks the 0.1.0 version would arrive which provides a feature set for the basic use cases.

Project Leads
Committers
Jens Reimann
Mentors
Interested Parties
  • David Bosschaert
  • Georg Fichter
  • Aleksandar Toshovski
  • Cédric Brun, OBEO
  • Cornelius Dirmaier, Faktor Zehn AG
Initial Contribution

The initial code set would come from IBH SYSTEMS GmbH, which already is an Eclipse Foundation Member and holds the copyright. The code already is licensed under the EPL and hosted at github.

Besides a list of Eclipse projects and modeles from Eclipse Orbit the software requires the following other libraries:

Name

License

URL

Bootstrap 3

MIT

https://github.com/twbs/bootstrap/blob/master/LICENSE

Hibernate Validator

Apache 2

https://raw.githubusercontent.com/hibernate/hibernate-validator/master/license.txt

JQuery

MIT

https://github.com/jquery/jquery/blob/1.x-master/MIT-LICENSE.txt

Dropzone

MIT

http://www.dropzonejs.com/ (scroll to the bottom of the page)

JBoss Logging

Apache 2

https://github.com/jboss-logging/jboss-logging/blob/master/pom.xml

Classmate

Apache 2

https://github.com/cowtowncoder/java-classmate

Apache Aries Util

Apache 2

http://www.apache.org/licenses/LICENSE-2.0.html

Apache Aries Spifly

Apache 2

http://www.apache.org/licenses/LICENSE-2.0.html

MySQL Connector

GPL

http://dev.mysql.com/downloads/connector/j/

Java Validation API from beanvalidation.org

Apache 2

http://beanvalidation.org/licensing/

 

Need to check the rest!

Source Repository Type