Notice: This Wiki is now read only and edits are no longer possible. Please see: https://gitlab.eclipse.org/eclipsefdn/helpdesk/-/wikis/Wiki-shutdown-plan for the plan.
Difference between revisions of "SMILA/Documentation"
< SMILA
(→Basics) |
m |
||
| Line 1: | Line 1: | ||
== Basics == | == Basics == | ||
* [[SMILA/Documentation/Architecture_Overview|Architecture]] | * [[SMILA/Documentation/Architecture_Overview|Architecture]] | ||
| − | * [[SMILA/Documentation/Default_configuration_workflow_overview|Overview | + | * [[SMILA/Documentation/Default_configuration_workflow_overview|Overview of Default Configuration]] |
* [[SMILA/Documentation/Data_Model_and_Serialization_Formats|Data Model, XML, JSON, BON]] | * [[SMILA/Documentation/Data_Model_and_Serialization_Formats|Data Model, XML, JSON, BON]] | ||
* [[SMILA/Documentation/Using_The_ReST_API|Using the ReST API]] | * [[SMILA/Documentation/Using_The_ReST_API|Using the ReST API]] | ||
* [[SMILA/Documentation/REST_API_Reference|REST API Reference]] | * [[SMILA/Documentation/REST_API_Reference|REST API Reference]] | ||
| − | * [[SMILA/Documentation/Enable Remote Access|Enabling | + | * [[SMILA/Documentation/Enable Remote Access|Enabling Remote Access to SMILA]] |
== The SMILA Development Environment == | == The SMILA Development Environment == | ||
| − | * [[SMILA/Documentation/HowTo/Howto_set_up_dev_environment| | + | * [[SMILA/Documentation/HowTo/Howto_set_up_dev_environment|Setting up your Eclipse IDE for SMILA]] |
| − | * [[SMILA/Documentation/HowTo/Howto_build_a_SMILA-Distribution| | + | * [[SMILA/Documentation/HowTo/Howto_build_a_SMILA-Distribution|Building SMILA]] |
| − | * [[SMILA/Documentation/HowTo/Create_a_bundle_(plug-in)|Creating new | + | * [[SMILA/Documentation/HowTo/Create_a_bundle_(plug-in)|Creating new Components]] |
| − | * [[SMILA/Documentation/HowTo/Create_a_test_bundle_(plug-in)|Testing new | + | * [[SMILA/Documentation/HowTo/Create_a_test_bundle_(plug-in)|Testing new Components]] |
| − | * [[SMILA/Documentation/HowTo/3rd_party_bundle|Adding Third Party | + | * [[SMILA/Documentation/HowTo/3rd_party_bundle|Adding Third Party Libraries to SMILA]] |
* [[SMILA/Documentation/Declarative_Services|Using OSGi Declarative Services]] | * [[SMILA/Documentation/Declarative_Services|Using OSGi Declarative Services]] | ||
* Extending the build process: | * Extending the build process: | ||
| − | ** [[SMILA/Documentation/HowTo/How_to_integrate_new_bundle_into_build_process|Adding a new | + | ** [[SMILA/Documentation/HowTo/How_to_integrate_new_bundle_into_build_process|Adding a new Component Bundle to the Build]] |
| − | ** [[SMILA/Documentation/HowTo/How_to_integrate_test_bundle_into_build_process|Adding a new | + | ** [[SMILA/Documentation/HowTo/How_to_integrate_test_bundle_into_build_process|Adding a new Test Bundle to the Build]] |
== Pipelines and Pipelets: Synchronous Workflows of Java components == | == Pipelines and Pipelets: Synchronous Workflows of Java components == | ||
* [[SMILA/Documentation/Pipelets|What are Pipelines? What are Pipelets?]] | * [[SMILA/Documentation/Pipelets|What are Pipelines? What are Pipelets?]] | ||
| − | * [[SMILA/Documentation/BPEL_Workflow_Processor| | + | * [[SMILA/Documentation/BPEL_Workflow_Processor|Configuring and Creating BPEL Pipelines]] |
** [[SMILA/Documentation/HowTo/How_to_filter_and_access_record_data_in_BPEL|Accessing SMILA records in BPEL activities]] | ** [[SMILA/Documentation/HowTo/How_to_filter_and_access_record_data_in_BPEL|Accessing SMILA records in BPEL activities]] | ||
* [[SMILA/BPEL_Designer|Using the SMILA BPEL Designer]] | * [[SMILA/BPEL_Designer|Using the SMILA BPEL Designer]] | ||
* ReST APIs | * ReST APIs | ||
| − | ** [[SMILA/Documentation/Processing/JSON_REST_API_for_pipelets| | + | ** [[SMILA/Documentation/Processing/JSON_REST_API_for_pipelets|For showing pipelets]] |
| − | ** [[SMILA/Documentation/Processing/JSON_REST_API_for_BPEL_pipelines| | + | ** [[SMILA/Documentation/Processing/JSON_REST_API_for_BPEL_pipelines|For showing, manipulating, and executing pipelines]] |
* Basic Pipelets | * Basic Pipelets | ||
| − | ** [[SMILA/Documentation/Bundle org.eclipse.smila.processing.pipelets|Common | + | ** [[SMILA/Documentation/Bundle org.eclipse.smila.processing.pipelets|Common Pipelets in Bundle org.eclipse.smila.processing.pipelets]] |
| − | ** [[SMILA/Documentation/Bundle org.eclipse.smila.processing.pipelets.xmlprocessing| | + | ** [[SMILA/Documentation/Bundle org.eclipse.smila.processing.pipelets.xmlprocessing|XML Processing Pipelets in Bundle org.eclipse.smila.processing.pipelets.xmlprocessing]] |
| − | ** More special pipelets are provided by components described below. | + | ** More special pipelets are provided by the components described below. |
* Developing Pipelets | * Developing Pipelets | ||
| − | ** [[SMILA/Documentation/HowTo/How_to_write_a_Pipelet|How to | + | ** [[SMILA/Documentation/HowTo/How_to_write_a_Pipelet|How to Write a Pipelet]] |
| − | ** [[SMILA/Documentation/Usage_of_Blackboard_Service| | + | ** [[SMILA/Documentation/Usage_of_Blackboard_Service|Using the Blackboard Service]] |
== Using SMILA for Search == | == Using SMILA for Search == | ||
| Line 41: | Line 41: | ||
== JobManager: Asynchronous Workflows == | == JobManager: Asynchronous Workflows == | ||
* [[SMILA/Documentation/JobManager|Concepts: Jobs and Tasks]] | * [[SMILA/Documentation/JobManager|Concepts: Jobs and Tasks]] | ||
| − | ** [[SMILA/Documentation/JobManagerFirstExample|A | + | ** [[SMILA/Documentation/JobManagerFirstExample|A Simple Example]] |
* Creating Workflows and Jobs | * Creating Workflows and Jobs | ||
** [[SMILA/Documentation/DataObjectTypesAndBuckets|Defining Buckets]] | ** [[SMILA/Documentation/DataObjectTypesAndBuckets|Defining Buckets]] | ||
** [[SMILA/Documentation/WorkerAndWorkflows|Modeling Workflows]] | ** [[SMILA/Documentation/WorkerAndWorkflows|Modeling Workflows]] | ||
** [[SMILA/Documentation/JobDefinitions|Creating Jobs]] | ** [[SMILA/Documentation/JobDefinitions|Creating Jobs]] | ||
| − | ** [[SMILA/Documentation/JobParameters| | + | ** [[SMILA/Documentation/JobParameters|Evaluating of Job Parameters]] |
* [[SMILA/Documentation/JobRuns|Running and Monitoring Jobs]] | * [[SMILA/Documentation/JobRuns|Running and Monitoring Jobs]] | ||
| − | * [[SMILA/Documentation/JobManagerConfiguration| | + | * [[SMILA/Documentation/JobManagerConfiguration|Configuring the Job Manager]] |
| − | * [[SMILA/Documentation/TaskManager|TaskManager: Asynchronous | + | * [[SMILA/Documentation/TaskManager|TaskManager: Asynchronous Scheduling of Tasks]] |
| − | * | + | * Worker Reference |
| − | ** [[SMILA/Documentation/Bulkbuilder|Bulkbuilder]] | + | ** [[SMILA/Documentation/Bulkbuilder|Bulkbuilder worker]] |
| − | ** [[SMILA/Documentation/Worker/PipelineProcessorWorker|PipelineProcesor]] | + | ** [[SMILA/Documentation/Worker/PipelineProcessorWorker|PipelineProcesor Worker]] |
| − | ** [[SMILA/Documentation/Worker/PipeletProcessorWorker|PipeletProcessor]] | + | ** [[SMILA/Documentation/Worker/PipeletProcessorWorker|PipeletProcessor Worker]] |
** See [[SMILA/Manual#Importing|Importing]] below for more workers | ** See [[SMILA/Manual#Importing|Importing]] below for more workers | ||
* Developing Workers | * Developing Workers | ||
| − | ** [[SMILA/Documentation/WorkerManager|WorkerManager: Workers | + | ** [[SMILA/Documentation/WorkerManager|WorkerManager: Workers Made Easy]] |
| − | ** [[SMILA/Documentation/HowTo/How_to_write_a_Worker|How to | + | ** [[SMILA/Documentation/HowTo/How_to_write_a_Worker|How to Write a Worker]] |
** [[SMILA/Documentation/TaskGenerators|Task Generators]] | ** [[SMILA/Documentation/TaskGenerators|Task Generators]] | ||
| Line 63: | Line 63: | ||
* [[SMILA/Documentation/Importing/Concept|Concepts]] | * [[SMILA/Documentation/Importing/Concept|Concepts]] | ||
* Importing Workers reference | * Importing Workers reference | ||
| − | **[[SMILA/Documentation/Importing/Crawler/File | FileCrawler and FileFetcher | + | **[[SMILA/Documentation/Importing/Crawler/File | FileCrawler and FileFetcher Worker]] |
| − | **[[SMILA/Documentation/Importing/Crawler/Web | WebCrawler and WebFetcher | + | **[[SMILA/Documentation/Importing/Crawler/Web | WebCrawler and WebFetcher Worker]] |
| − | **[[SMILA/Documentation/Importing/DeltaCheck | | + | **[[SMILA/Documentation/Importing/DeltaCheck | DeltaChecker Worker]] |
| − | **[[SMILA/Documentation/Importing/UpdatePusher | UpdatePusher | + | **[[SMILA/Documentation/Importing/UpdatePusher | UpdatePusher Worker]] |
* Developing Importing Workers | * Developing Importing Workers | ||
** [[SMILA/Documentation/Importing/VisitedLinks | VisitedLinks service]] | ** [[SMILA/Documentation/Importing/VisitedLinks | VisitedLinks service]] | ||
** [[SMILA/Documentation/Importing/Crawler/Web#Internal_structure|Extending the WebCrawler worker]] | ** [[SMILA/Documentation/Importing/Crawler/Web#Internal_structure|Extending the WebCrawler worker]] | ||
| − | ** [[SMILA/Documentation/HowTo/How to add a new Data Source to the importing framework| | + | ** [[SMILA/Documentation/HowTo/How to add a new Data Source to the importing framework|Adding a Data Source to the SMILA Importing Framework]] |
== The SMILA HTTP Server == | == The SMILA HTTP Server == | ||
| − | * [[SMILA/Documentation/JettyHttpServer| | + | * [[SMILA/Documentation/JettyHttpServer|Configuring Jetty]] |
| − | * [[SMILA/Documentation/JettyHttpServer#JSON_Handlers|Developing JSON ReST | + | * [[SMILA/Documentation/JettyHttpServer#JSON_Handlers|Developing JSON ReST Handlers for SMILA]] |
== Common Services == | == Common Services == | ||
* [[SMILA/Project Concepts/Simple configuration handler|Configuration Helper]] | * [[SMILA/Project Concepts/Simple configuration handler|Configuration Helper]] | ||
* [[SMILA/Documentation/Workspace Handling|Workspace Helper]] | * [[SMILA/Documentation/Workspace Handling|Workspace Helper]] | ||
| − | * [[SMILA/Documentation/Bundle_org.eclipse.smila.clusterconfig|ClusterConfig | + | * [[SMILA/Documentation/Bundle_org.eclipse.smila.clusterconfig|ClusterConfig Service]] |
| − | ** [[SMILA/Documentation/Bundle_org.eclipse.smila.clusterconfig.simple|Simple | + | ** [[SMILA/Documentation/Bundle_org.eclipse.smila.clusterconfig.simple|Simple Implementation]] |
* [[SMILA/Documentation/ObjectStore/Bundle_org.eclipse.smila.objectstore|ObjectStore]] | * [[SMILA/Documentation/ObjectStore/Bundle_org.eclipse.smila.objectstore|ObjectStore]] | ||
| − | ** [[SMILA/Documentation/ObjectStore/Bundle_org.eclipse.smila.objectstore.filesystem|Filesystem Objectstore | + | ** [[SMILA/Documentation/ObjectStore/Bundle_org.eclipse.smila.objectstore.filesystem|Filesystem Objectstore Implementation]] |
* [[SMILA/Documentation/Binary_Storage|BinaryStorage]] | * [[SMILA/Documentation/Binary_Storage|BinaryStorage]] | ||
| − | * [[SMILA/Documentation/Security|Processing | + | * [[SMILA/Documentation/Security|Processing Security Information]] |
** [[SMILA/Documentation/LDAPSecurityResolver|Implementation for using LDAP]] | ** [[SMILA/Documentation/LDAPSecurityResolver|Implementation for using LDAP]] | ||
** [[SMILA/Documentation/SecurityProcessingServices|Example Pipelets]] | ** [[SMILA/Documentation/SecurityProcessingServices|Example Pipelets]] | ||
| − | * [[SMILA/Documentation/SesameOntologyManager|Ontology | + | * [[SMILA/Documentation/SesameOntologyManager|Ontology Processing with Sesame: Configuration and Pipelets]] |
* [[SMILA/Documentation/MimeTypeIdentifier|MimeTypeIdentifier]] | * [[SMILA/Documentation/MimeTypeIdentifier|MimeTypeIdentifier]] | ||
* [[SMILA/Documentation/PublishingJAXWSWebservices|Publishing Web Services]] | * [[SMILA/Documentation/PublishingJAXWSWebservices|Publishing Web Services]] | ||
Revision as of 12:38, 25 January 2012
Contents
Basics
- Architecture
- Overview of Default Configuration
- Data Model, XML, JSON, BON
- Using the ReST API
- REST API Reference
- Enabling Remote Access to SMILA
The SMILA Development Environment
- Setting up your Eclipse IDE for SMILA
- Building SMILA
- Creating new Components
- Testing new Components
- Adding Third Party Libraries to SMILA
- Using OSGi Declarative Services
- Extending the build process:
Pipelines and Pipelets: Synchronous Workflows of Java components
- What are Pipelines? What are Pipelets?
- Configuring and Creating BPEL Pipelines
- Using the SMILA BPEL Designer
- ReST APIs
- Basic Pipelets
- Common Pipelets in Bundle org.eclipse.smila.processing.pipelets
- XML Processing Pipelets in Bundle org.eclipse.smila.processing.pipelets.xmlprocessing
- More special pipelets are provided by the components described below.
- Developing Pipelets
Using SMILA for Search
JobManager: Asynchronous Workflows
- Concepts: Jobs and Tasks
- Creating Workflows and Jobs
- Running and Monitoring Jobs
- Configuring the Job Manager
- TaskManager: Asynchronous Scheduling of Tasks
- Worker Reference
- Bulkbuilder worker
- PipelineProcesor Worker
- PipeletProcessor Worker
- See Importing below for more workers
- Developing Workers
Importing
- Concepts
- Importing Workers reference
- Developing Importing Workers
The SMILA HTTP Server
Common Services
- Configuration Helper
- Workspace Helper
- ClusterConfig Service
- ObjectStore
- BinaryStorage
- Processing Security Information
- Ontology Processing with Sesame: Configuration and Pipelets
- MimeTypeIdentifier
- Publishing Web Services
- General JPA Configuration in SMILA