Pull Plasma from Apache Arrow and remove Plasma store from Ray. by pcmoritz · Pull Request #692 · ray-project/ray

pcmoritz · 2017-06-23T00:28:42Z

This PR replaces the version of plasma that is in Ray with the one that was merged into the Apache Arrow project.

This completes #611.

AmplabJenkins · 2017-06-23T00:34:13Z

Merged build finished. Test FAILed.

AmplabJenkins · 2017-06-23T00:34:13Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/1104/
Test FAILed.

AmplabJenkins · 2017-06-23T00:39:28Z

Merged build finished. Test FAILed.

AmplabJenkins · 2017-06-23T00:39:28Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/1105/
Test FAILed.

AmplabJenkins · 2017-06-23T01:14:35Z

Merged build finished. Test FAILed.

AmplabJenkins · 2017-06-23T01:14:36Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/1107/
Test FAILed.

AmplabJenkins · 2017-06-23T04:20:01Z

Merged build finished. Test FAILed.

AmplabJenkins · 2017-06-23T04:20:01Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/1108/
Test FAILed.

AmplabJenkins · 2017-06-23T17:50:26Z

Merged build finished. Test FAILed.

AmplabJenkins · 2017-06-23T17:50:27Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/1114/
Test FAILed.

AmplabJenkins · 2017-06-23T22:40:43Z

Merged build finished. Test FAILed.

AmplabJenkins · 2017-06-23T22:40:44Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/1121/
Test FAILed.

AmplabJenkins · 2017-06-23T22:59:59Z

Merged build finished. Test FAILed.

AmplabJenkins · 2017-06-23T22:59:59Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/1122/
Test FAILed.

AmplabJenkins · 2017-06-25T18:54:56Z

Merged build finished. Test FAILed.

AmplabJenkins · 2017-06-25T18:54:56Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/1125/
Test FAILed.

AmplabJenkins · 2017-06-25T19:29:57Z

Merged build finished. Test FAILed.

AmplabJenkins · 2017-06-25T19:29:57Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/1126/
Test FAILed.

AmplabJenkins · 2017-06-25T20:40:59Z

Merged build finished. Test FAILed.

AmplabJenkins · 2017-06-25T20:40:59Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/1127/
Test FAILed.

AmplabJenkins · 2017-06-30T19:44:53Z

Build finished. Test FAILed.

AmplabJenkins · 2017-06-30T19:44:53Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/1155/
Test FAILed.

AmplabJenkins · 2017-06-30T23:54:25Z

Build finished. Test FAILed.

AmplabJenkins · 2017-06-30T23:54:26Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/1156/
Test FAILed.

AmplabJenkins · 2017-07-15T17:14:09Z

Build finished. Test FAILed.

AmplabJenkins · 2017-07-15T17:14:09Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/1300/
Test FAILed.

AmplabJenkins · 2017-07-15T17:24:15Z

Merged build finished. Test FAILed.

AmplabJenkins · 2017-07-15T17:24:16Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/1301/
Test FAILed.

AmplabJenkins · 2017-07-16T00:44:36Z

Merged build finished. Test FAILed.

…reliably.

AmplabJenkins · 2017-08-01T05:29:38Z

Merged build finished. Test FAILed.

AmplabJenkins · 2017-08-01T05:29:38Z

Merged build finished. Test FAILed.

AmplabJenkins · 2017-08-01T05:29:39Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/1466/
Test FAILed.

AmplabJenkins · 2017-08-01T05:29:39Z

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/1465/
Test FAILed.

pcmoritz force-pushed the arrow-plasma branch from c6799e9 to a96d9d8 Compare July 15, 2017 17:18

pcmoritz and others added 19 commits July 31, 2017 18:06

fix python 3 bytes vs string

3842709

fix manager tests valgrind

cbde6a2

fix documentation building

6fa0296

fix linting

82a41fb

fix c++ linting

3b89389

fix linting

ba8d4ba

add tests back in

c6b590d

Install without sudo.

c25793d

Set PKG_CONFIG_PATH in build.sh so that Ray can find plasma.

de172ed

Install pkg-config

94e8286

Link -lpthread, note that find_package(Threads) doesn't seem to work …

2de4b5f

…reliably.

Comment in testGPUIDs in runtest.py.

3f5bc2c

Set PKG_CONFIG_PATH when building pyarrow.

a487e85

Fix installation in docker image.

1c5871b

Pull apache/arrow and not pcmoritz/arrow.

4e66972

adapt to changes of the plasma api

3623e39

Fix installation of pyarrow module.

bf88c4c

Fix linting.

1e8a24c

Use correct python executable to build pyarrow.

7c96a75

robertnishihara force-pushed the arrow-plasma branch from 5f08bef to 7c96a75 Compare August 1, 2017 01:06

robertnishihara merged commit c3b39b4 into ray-project:master Aug 1, 2017

robertnishihara deleted the arrow-plasma branch August 1, 2017 04:04

This was referenced Aug 1, 2017

Move plasma object store into Arrow. #611

Closed

ArrowIOError: IOError: Broken pipe in stress tests. #794

Closed

This was referenced Aug 3, 2017

Cannot find redis module when initialize ray #778

Closed

Need to package pyarrow along with our wheels. #810

Closed

Conversation

pcmoritz commented Jun 23, 2017 • edited by robertnishihara Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

AmplabJenkins commented Jun 23, 2017

Uh oh!

AmplabJenkins commented Jun 23, 2017

Uh oh!

AmplabJenkins commented Jun 23, 2017

Uh oh!

AmplabJenkins commented Jun 23, 2017

Uh oh!

AmplabJenkins commented Jun 23, 2017

Uh oh!

AmplabJenkins commented Jun 23, 2017

Uh oh!

AmplabJenkins commented Jun 23, 2017

Uh oh!

AmplabJenkins commented Jun 23, 2017

Uh oh!

AmplabJenkins commented Jun 23, 2017

Uh oh!

AmplabJenkins commented Jun 23, 2017

Uh oh!

AmplabJenkins commented Jun 23, 2017

Uh oh!

AmplabJenkins commented Jun 23, 2017

Uh oh!

AmplabJenkins commented Jun 23, 2017

Uh oh!

AmplabJenkins commented Jun 23, 2017

Uh oh!

AmplabJenkins commented Jun 25, 2017

Uh oh!

AmplabJenkins commented Jun 25, 2017

Uh oh!

AmplabJenkins commented Jun 25, 2017

Uh oh!

AmplabJenkins commented Jun 25, 2017

Uh oh!

AmplabJenkins commented Jun 25, 2017

Uh oh!

AmplabJenkins commented Jun 25, 2017

Uh oh!

AmplabJenkins commented Jun 30, 2017

Uh oh!

AmplabJenkins commented Jun 30, 2017

Uh oh!

AmplabJenkins commented Jun 30, 2017

Uh oh!

AmplabJenkins commented Jun 30, 2017

Uh oh!

AmplabJenkins commented Jul 15, 2017

Uh oh!

AmplabJenkins commented Jul 15, 2017

Uh oh!

AmplabJenkins commented Jul 15, 2017

Uh oh!

AmplabJenkins commented Jul 15, 2017

Uh oh!

AmplabJenkins commented Jul 16, 2017

Uh oh!

AmplabJenkins commented Aug 1, 2017

Uh oh!

AmplabJenkins commented Aug 1, 2017

Uh oh!

AmplabJenkins commented Aug 1, 2017

Uh oh!

AmplabJenkins commented Aug 1, 2017

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

pcmoritz commented Jun 23, 2017 •

edited by robertnishihara

Loading