{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":541641841,"defaultBranch":"master","name":"ray","ownerLogin":"WeichenXu123","currentUserCanPush":false,"isFork":true,"isEmpty":false,"createdAt":"2022-09-26T14:57:42.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/19235986?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1726466972.0","currentOid":""},"activityList":{"items":[{"before":"1c80db59b131d3cd87ad36665105d4fa9f24e7f0","after":"d8edb77898f2eaf217ab43fd87988b06ab9e5f13","ref":"refs/heads/refine-comment","pushedAt":"2024-09-16T06:11:18.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":null,"after":"1c80db59b131d3cd87ad36665105d4fa9f24e7f0","ref":"refs/heads/refine-comment","pushedAt":"2024-09-16T06:09:32.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"[Data] Add `partitioning` parameter to `read_parquet` (#47553)\n\nTo extract path partition information with `read_parquet`, you pass a\r\nPyArrow `partitioning` object to `dataset_kwargs`. For example:\r\n```\r\nschema = pa.schema([(\"one\", pa.int32()), (\"two\", pa.string())])\r\npartitioning = pa.dataset.partitioning(schema, flavor=\"hive\")\r\nds = ray.data.read_parquet(... dataset_kwargs=dict(partitioning=partitioning))\r\n```\r\n\r\nThis is problematic for two reasons:\r\n1. It tightly couples the interface with the implementation;\r\npartitioning only works if we use `pyarrow.Dataset` in a specific way in\r\nthe implementation.\r\n2. It's inconsistent with all of the other file-based API. All other\r\nAPIs use expose a top-level `partitioning` parameter (rather than\r\n`dataset_kwargs`) where you pass a Ray Data `Partitioning` object\r\n(rather than a PyArrow partitioning object).\r\n\r\n---------\r\n\r\nSigned-off-by: Balaji Veeramani <bveeramani@berkeley.edu>","shortMessageHtmlLink":"[Data] Add <code>partitioning</code> parameter to <code>read_parquet</code> (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2511566529\" data-permission-text=\"Title is private\" data-url=\"https://github.com/ray-project/ray/issues/47553\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/ray-project/ray/pull/47553/hovercard\" href=\"https://github.com/ray-project/ray/pull/47553\">ray-project#47553</a>"}},{"before":"d0609356c9c0532d56d2937f08d6c92c54abf15a","after":"57865c6c4276490a955d43cf8851fb214d27e82c","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-12T04:15:34.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"75f5c494a689f9e0fbb26e3218a13ecba1bda252","after":"d0609356c9c0532d56d2937f08d6c92c54abf15a","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-12T02:28:55.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"737e08f0255639e6062b422ffad693a2cc79ccfb","after":"75f5c494a689f9e0fbb26e3218a13ecba1bda252","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-12T02:08:49.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"format\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"format"}},{"before":"d3a59f4f5e6362ee02bd9db1868041be62281f6f","after":"737e08f0255639e6062b422ffad693a2cc79ccfb","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-12T01:58:52.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"abd55fb289fcc168f6a71f8c32c31d64d3df536a","after":"d3a59f4f5e6362ee02bd9db1868041be62281f6f","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-11T14:11:26.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"a5f2e1fbdaadaf9f539520b39b8f0be57fd72f64","after":"abd55fb289fcc168f6a71f8c32c31d64d3df536a","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-11T11:16:41.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"clean\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"clean"}},{"before":"25bf37421bbd7bfde3b47552440eb2628227011f","after":"a5f2e1fbdaadaf9f539520b39b8f0be57fd72f64","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-11T10:49:19.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"035683a2867d2628a72f3420f46894a4a7c52f7e","after":"25bf37421bbd7bfde3b47552440eb2628227011f","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-11T09:37:32.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"20195bd397a3392e6e4b50558fc6a174b6976006","after":"035683a2867d2628a72f3420f46894a4a7c52f7e","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-11T03:59:22.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"0b62166d8392c511d8fe33e7002c472cc7830af0","after":"20195bd397a3392e6e4b50558fc6a174b6976006","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-11T01:17:36.000Z","pushType":"push","commitsCount":213,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"Merge branch 'master' into spark-improvements","shortMessageHtmlLink":"Merge branch 'master' into spark-improvements"}},{"before":"7430d396669a02e2d6d306d6f11d89aed353fd57","after":"0b62166d8392c511d8fe33e7002c472cc7830af0","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-10T13:06:28.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"e5953d155ff55d352e7bc09b70b02da266d09fa1","after":"7430d396669a02e2d6d306d6f11d89aed353fd57","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-10T12:35:37.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"7f1420e513c2fc1278c0b54923e9d2126bc18ac6","after":"e5953d155ff55d352e7bc09b70b02da266d09fa1","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-10T09:26:43.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"comment\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"comment"}},{"before":"1b8c1a7d88d04302f04fc1af7def74238ace2334","after":"7f1420e513c2fc1278c0b54923e9d2126bc18ac6","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-10T09:24:02.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"b58d2fba3f06f3436621535345edb749701d2b49","after":"1b8c1a7d88d04302f04fc1af7def74238ace2334","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-10T06:55:24.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"fb8a4917633e46dfa4b6634656af4789e542a08a","after":"b58d2fba3f06f3436621535345edb749701d2b49","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-09T14:58:33.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"b6bd4892dcf9f638dedb66d2e30c27ae6e86cc95","after":"fb8a4917633e46dfa4b6634656af4789e542a08a","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-09T14:47:07.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"clean\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"clean"}},{"before":"4286d30f5379289b111bd752c2b5e287ceed12ad","after":"b6bd4892dcf9f638dedb66d2e30c27ae6e86cc95","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-06T08:01:12.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"fix tests\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"fix tests"}},{"before":"0f3d8484a92cc1b5fadd918fb6099c65c58d266e","after":"4286d30f5379289b111bd752c2b5e287ceed12ad","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-06T02:54:28.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"9bc786e8ab5bb6ce76f0ab64c7d54cbaf2609c98","after":"0f3d8484a92cc1b5fadd918fb6099c65c58d266e","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-06T02:48:41.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"81d3062691cafa43896f4e01529c1e3a05ef08a7","after":"9bc786e8ab5bb6ce76f0ab64c7d54cbaf2609c98","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-06T02:43:41.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"b9b5e170c5d3b8d5ab74c05c3958bb1ce10d9817","after":"81d3062691cafa43896f4e01529c1e3a05ef08a7","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-06T02:37:24.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"ef522b814338643eba9e1ded45d7ba973c9dabb9","after":"b9b5e170c5d3b8d5ab74c05c3958bb1ce10d9817","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-06T02:21:29.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"92eefc81d897540855d1bf28490cee058ecc2614","after":"ef522b814338643eba9e1ded45d7ba973c9dabb9","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-06T02:06:49.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"feebb3197e90bbccae436ba00f98e0732f1d8c85","after":"92eefc81d897540855d1bf28490cee058ecc2614","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-05T11:34:21.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"43949097affa793714bef5a3dd9efe0d41cce75a","after":"feebb3197e90bbccae436ba00f98e0732f1d8c85","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-05T10:48:15.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"7ef8e4c666e44adcf9d16e765ccde6d37ca1bc8a","after":"43949097affa793714bef5a3dd9efe0d41cce75a","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-05T10:00:22.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"update\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"update"}},{"before":"6bcd288711da2968c8a414133abc70f83df9e105","after":"7ef8e4c666e44adcf9d16e765ccde6d37ca1bc8a","ref":"refs/heads/spark-improvements","pushedAt":"2024-09-05T04:21:15.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"WeichenXu123","name":"WeichenXu","path":"/WeichenXu123","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/19235986?s=80&v=4"},"commit":{"message":"format\n\nSigned-off-by: Weichen Xu <weichen.xu@databricks.com>","shortMessageHtmlLink":"format"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0xNlQwNjoxMToxOC4wMDAwMDBazwAAAAS3FE2d","startCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0xNlQwNjoxMToxOC4wMDAwMDBazwAAAAS3FE2d","endCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0wNVQwNDoyMToxNS4wMDAwMDBazwAAAAStZIob"}},"title":"Activity · WeichenXu123/ray"}