Add support for Spark in data processing UI
For Juno, Spark jobs will be supported in the Sahara data processing engine. Given that, the data processing dashboard will need some changes to support the new job type.
The corresponding Sahara-api spec can be found at: https:/
The anticipated changes are as follows:
* add a new job type for Spark jobs (job creation)
* job launch config screen may have spark-specific fields included or non-applicable fields excluded (tbd)
* help text updated to include spark-specific notes as needed
Update from service side of things: Similar to Java job type. Main is required, but libs are optional. Only used configs (currently) is edp.java.
Blueprint information
- Status:
- Complete
- Approver:
- David Lyle
- Priority:
- Medium
- Drafter:
- Chad Roberts
- Direction:
- Approved
- Assignee:
- Chad Roberts
- Definition:
- Approved
- Series goal:
- Accepted for juno
- Implementation:
- Implemented
- Milestone target:
- 2014.2
- Started by
- David Lyle
- Completed by
- David Lyle
Related branches
Related bugs
Sprints
Whiteboard
Gerrit topic: https:/
Addressed by: https:/
Data Processing post-bootstrap 3 UI fixes
Addressed by: https:/
Data Processing Adding support for Spark jobs