Repository navigation
Conversation
flink-python's .pyx/.pxd files cimport compiled apache-beam internals (apache_beam.coders.coder_impl, .runners.worker.operations, .utils.windowed_value), size-checked Cython type imports that fail at wheel-import time, not build time, on an ABI mismatch. Blocked until a riscv64 apache-beam/pyarrow/grpcio/pemja land inside flink's declared windows (apache-beam>=2.54.0,<=2.61.0, pemja>=0.5.7,<0.5.8) - tracked separately. No native deps, no JVM at build time: apache-flink-libraries (the 329MB jar bundle) is a separate py2.py3-none-any wheel. Mirrors upstream's own build_python_wheels job (nightly.yml): plain cibuildwheel over the flink-python subdirectory of a full checkout, riscv64 substituted for its hardcoded x86_64 archs. The glibc_version_fix.h CFLAGS shim upstream adds for manylinux2014 x86_64 is dropped - the GLIBC_2.2.5 symbol version it force-links doesn't exist in riscv64's glibc symbol history.
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
apache-flink2.3.0Cythonizes 7 small extension modules under
pyflink/{fn_execution,table}that cimport compiled apache-beam internals. Upstream publishes no riscv64 wheel.Mirrors upstream's
build_python_wheelsjob innightly.yml(plain cibuildwheel overflink-python, no separate sdist step).Differs from upstream
CIBW_ARCHS: riscv64overrides the hardcodedx86_64inflink-python/pyproject.toml.glibc_version_fix.hCFLAGS shim - it force-links a GLIBC_2.2.5 symbol version that doesn't exist in riscv64's glibc symbol history.Matrix: cp312 only - flink's own
apache-beam<=2.61.0pin tops out at cp312, as does everything in that dependency chain.Testing
License: OK
Draft: blocked on riscv64 builds of apache-beam==2.61.0, pyarrow==16.1.0, grpcio==1.65.5 and pemja==0.5.7 (apache-flink's declared dependency windows), tracked in #3320, #3318, #3319 and #3321.