[Sahara] Spark plugin doesn't work with swift

Bug #1520630 reported by Andrey Pavlov
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Mirantis OpenStack
Fix Released
High
MOS Sahara
7.0.x
Won't Fix
Medium
MOS Sahara
8.0.x
Fix Released
High
MOS Sahara

Bug Description

Execution of Spark jobs on Spark plugin with swift inputs/outputs ends in "Done with Error" state even if swift username and password are provided.

Error from job execution logs:

Exception in thread "main" org.apache.hadoop.fs.swift.exceptions.SwiftConfigurationException: Missing mandatory configuration option: fs.swift.service.sahara.username

This problem has a workaround - ":" symbol can be added to spark.executor.extraClassPath config parameter during cluster template creation. it fixes reading from swift, but not writing.

Tags: sahara
Changed in mos:
milestone: none → 7.0-updates
status: New → Triaged
importance: Undecided → High
assignee: nobody → MOS Sahara (mos-sahara)
Revision history for this message
Vitaly Sedelnik (vsedelnik) wrote :

Set to Medium because of no data corruption and there is a workaround. Won't Fix.

Revision history for this message
Vitalii Gridnev (vgridnev) wrote :

This bugs consists of two and one is the serve and don't have a workaround

description: updated
tags: added: sahara
Revision history for this message
Sergey Reshetnyak (sreshetniak) wrote :

Fixed in stable/liberty

Revision history for this message
Evgeny Sikachev (esikachev) wrote :

verified on iso 462

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.