repository·master·Indexed 27 days ago
https://github.com/pentaho/pentaho-kettleDocumentation for Pentaho Data Integration (PDI), also known as Kettle, an ETL tool for data integration. Includes guides on implementing StepMetaInterface serialization, creating stream consuming steps, and building core plugins such as Palo, Kafka, S3 VFS, and MQTT. Provides detailed instructions for Maven-based builds, JDK requirements, and plugin installation for PDI and BI Server.
kettle-palo-plugin provides integration capabilities for Palo within Pentaho Data Integration (Kettle). It allows users to interact with Palo data structures through various input, output, and management steps.All free documentation for Pentaho Data Integration is hosted on the official Pentaho wiki.
http://wiki.pentaho.com/display/EAI/Pentaho Data Integration includes both unit tests and integration tests (which test cross-module operations).
To run all unit tests in the project and its sub-modules:
mvn testTo debug a single Java unit test on the default port 5005:
cd core
mvn test -Dtest=<<YourTest>> -Dmaven.surefire.debugTo run integration tests:
mvn verify -DrunITsTo run a specific integration test:
mvn verify -DrunITs -Dit.test=<<YourIT>>To run a specific integration test in debug mode on port 5005:
mvn verify -DrunITs -Dit.test=<<YourIT>> -Dmaven.failsafe.debugTo run a Carte server with specific authentication and settings, create a configuration XML file (e.g., carte-config.xml) and pass it to the startup script. Authentication is configured within the <slaveserver> block using <username> and <password> tags.
<?xml version="1.0" encoding="UTF-8"?>
<slave_config>
<slaveserver>
<name>Carte-Server</name>
<hostname>localhost</hostname>
<port>8080</port>
<username>admin</username>
<password>password</password>
<master>N</master>
</slaveserver>
<max_log_lines>10000</max_log_lines>
<max_log_timeout_minutes>1440</max_log_timeout_minutes>
<object_timeout_minutes>1440</object_timeout_minutes>
</slave_config>./carte.sh carte-config.xmlFor CentOS 6 Desktop, ensure the libwebkitgtk package is installed using yum.
yum install libwebkitgtkWhen using IntelliJ IDEA, do not use the built-in Maven version. Instead, configure IntelliJ to use your local command-line Maven installation to ensure consistency.
Path: Project Preferences -> Build, Execution, Deployment -> Build Tools -> Maven -> Set Maven home directory.
You can verify if the Carte server is running properly by performing a simple health check against the /kettle/status endpoint. A 200 OK status code indicates the server is healthy.
curl "http://localhost:8080/kettle/status"-Dmaven.surefire.debug flag. The default debug port is 5005.README.txt file and double-click the Data Integration application icon.If changes are made to the plugin's REST services, you must regenerate the org.pentaho.di.services.PentahoDiPlugin class. This is done by fetching the updated WADL and XSD files from a running platform server and running the wadl2java Ant task via Maven.
Follow these steps:
Fetch the updated WADL: Request the WADL file from your running platform server and save it to wadl2java/wadl-resource/application.wadl.xml.
http://localhost:8080/pentaho/plugin/pur-repository-plugin/api/application.wadlFetch the updated XSD: Request the WADL sub-resource XSD file from your running platform server and save it to wadl2java/wadl-resource/application.wadl/xsd0.xsd.
http://localhost:8080/pentaho/plugin/pur-repository-plugin/api/application.wadl/xsd0.xsdRun the generation task: Execute the Maven command to trigger the wadl2java target, which uses the build-wadl2java.xml Ant task to create the org.pentaho.di.services.PentahoDiPlugin class.
mvn antrun:run@wadl2javaTo build the plugin, run the Maven install command from the main project folder.
mvn clean install