Enable Spark jobs to access Swift URLs
Registered by
Trevor McKay
Allow Spark jobs to reference Swift input and output paths without any source code modification. This requires that the Hadoop configuration for the job be updated transparently to allow Swift access.
Blueprint information
- Status:
- Complete
- Approver:
- Sergey Lukjanov
- Priority:
- High
- Drafter:
- Trevor McKay
- Direction:
- Approved
- Assignee:
- Trevor McKay
- Definition:
- Approved
- Series goal:
- Accepted for kilo
- Implementation:
-
Implemented
- Milestone target:
-
2015.1.0
- Started by
- Sergey Lukjanov
- Completed by
- Thierry Carrez
Related branches
Related bugs
Sprints
Whiteboard
Gerrit topic: https:/
Addressed by: https:/
Enable Spark jobs to access Swift URLs
Addressed by: https:/
Add a SparkWrapper class
Addressed by: https:/
Add the hadoop-swift element to Spark images
Addressed by: https:/
Add Swift integration with Spark
(?)
