Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cuda-modules: fixed output derivations and new modules #306172

Draft
wants to merge 71 commits into
base: master
Choose a base branch
from

Commits on Sep 13, 2024

  1. wip

    cudaPackages.cudatoolkit: 12.3.0 -> 12.3.2; init 12.4.1
    
    cudaPackages.cudnn: update for 9.x
    
    cudaPackages.cuda_cudart: remove stubs workaround
    
    python3Packages.openai-triton: update substituteInPlace and cudaPackages outputs
    
    individual allowFHSReferences, don't use getOutput, refactor setupCudaHook
    
    fixups
    
    fixup
    
    fixup
    
    switch back to cudaFlags; various simplifications
    
    fixup eval errors
    
    remove extra whitespace
    
    fixups
    
    fixup
    
    fixup
    
    fixups
    
    fixups
    
    fixups
    
    fixups
    
    fixups
    
    fixups
    
    fixups
    
    fixups
    
    fixups
    
    fixups
    
    fixups
    
    fixups
    
    fixup
    
    fixup
    
    fixup
    
    mapAttrs mkOption to avoid forgetting to apply it to an argument
    
    alphabetize
    
    Add latest from cuda-redist-find-features; must update to reflect nesting of index in data.indices
    
    update for data.indices and file shuffle
    
    wip
    
    wip
    
    brain hurt ;(
    
    CUDA packages should be visible on all platforms, but not necessarily buildable
    
    switch to utils.mkMissingPackagesBrokenConditions pattern to avoid missing attribute errors
    
    cudaPackages now evaluates deeply
    
    wip
    
    wip
    
    wip
    
    use lazyAttrsOf to avoid strictly evaluating during checks
    
    wip
    
    overrideAttrs doesn't deeply merge attribute sets
    
    fix missing src for cudnn_samples
    
    cudnn_samples: mark as broken for now
    
    cudaPackages: add major versions to avoid need sort and filter packages
    
    cudaPackages.cudnn: fix selection logic (was not using result of filterAttrs)
    
    cudaPackages.cuquantum: fixup
    
    cudaPackages.nccl: broken on CUDA pre-11.4 due to API changes
    
    cudaPackages: add note about recurseIntoAttrs and nixpkgs-review
    
    cudaPackages: temporarily add recurseIntoAttrs on all package sets
    
    cudaPackages.utils: fix usages of mkMissingPackagesBrokenConditions
    
    cudaPackages.tensorrt: use cudatoolkit prior to CUDA 11.4
    
    cudaPackages: set name expressly to make clear where packages originate
    
    cudaPackages.cudnn: requires CUDA 10.1 or later
    
    cudaPackages.libnvvm_samples: allow FHS references
    
    cudaPackages.nsight_compute: fix
    
    cudaPackages.libcal: correct dependency on ucc
    
    cudaPackages.libcublasmp: correct selection logic
    
    cudaPackages: deep overriding of pkgs
    
    cudaPackages: re-add reference to self to fix package selection
    
    Prior to this change, packages like CUDNN would take the newest version of packages like cudatoolkit (which is to say
    packages created through packagesFromDirectoryRecursive). That is, cudaPackages_11_0.cudnn_8_5.buildInputs would
    reference cudaPackages.cudatoolkit rather than cudatoolkit from the same cudaPackages.
    
    !fixup 3724a77
    
    wip
    
    cudaPackages.setupCudaHook: wip
    
    cudaPackages_12_5: fixes
    
    cudaPackages.cudnn_samples: require cudnn be available
    
    cudaPackages: guard invalid eval behind badPlatforms
    
    cudaPackages.tensorrt: don't rely on passthru for buildInputs
    
    While this may complicate overriding the package, it does resolve an infinite recursion error.
    
    cudaPackages: create dummy outputs to avoid missing attribute errors
    
    cudaPackages.libcusparse_lt: add overrides and constraints
    
    cudaPackages.tensorrt: handle constraints for unsupported architectures
    
    cudaPackages.cuda_compat: allow FHS references
    
    cudaPackages: fix src selection logic
    
    TODO: update
    
    cudaPackages: enable override and implement per-output overrides
    
    cudaPackages: add setup hook for cuda_cudart.stubs to add to NIX_LDFLAGS
    
    cudaPackages.cuda_cudart.stubs: set LD_LIBRARY_PATH in setup hook
    
    cudaPackages: move setup-cuda-stubs-hook to manifest-builder
    
    wip
    
    fixup after rebase on 2024-07-10
    
    regen JSON as of cuda-redist-find-features@239ee25f2ed08a27e24762be384361d17b8911b8
    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    edbab0a View commit details
    Browse the repository at this point in the history
  2. cuda-redist-lib: init at 0.1.0

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    f3cbcbe View commit details
    Browse the repository at this point in the history
  3. cuda-redist-feature-detector: init at 0.1.0

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    6324a9c View commit details
    Browse the repository at this point in the history
  4. cuda-redist-index: init at 0.1.0

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    9685e79 View commit details
    Browse the repository at this point in the history
  5. cuda-modules: move cuda-redist-* scripts in-tree

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    e9fd1f0 View commit details
    Browse the repository at this point in the history
  6. cudaPackages: NOTE ON OUTPUTS

    Thanks to the work of SomeoneSerge, the lib.get* family of output selectors now work!
    
    In order to keep closure sizes small, the `dev` output propagates only `bin`, `include`, and
    `lib` outputs. The `include` output is new -- it is the `include` directory, and was separated
    out from the `dev` output to allow for more granular dependencies between derivations. As an example,
    cuda_cudart.include depends on cuda_nvcc.include and cuda_cccl.include, but adding a dependency on
    the dev output of either would greatly increase the size of the closure relative to the tiny header files.
    
    Since `dev` is the default output selected by `make-derivation.nix`, in general the `lib.get*` family of
    functions should only be necessary for retrieving an output which contains a specific directory. This happens
    frequently when trying to slim down a closure (retrieving only the `include` output) or because you need the
    full path to a directory (e.g., `(lib.getLib cuda_cudart) + "/lib"`).
    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    b1491ee View commit details
    Browse the repository at this point in the history
  7. cudaPackages.nsight_compute: incorporate NixOS#291471

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    a8c4f83 View commit details
    Browse the repository at this point in the history
  8. caffe: remove

    Caffe is unmaintained in and out of Nixpkgs.
    ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    de425e3 View commit details
    Browse the repository at this point in the history
  9. python3Packages.gpuctypes: fixup CUDA output attributes

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    e005a4a View commit details
    Browse the repository at this point in the history
  10. ucx: switch to CUDA stubs outputs

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    2f3121a View commit details
    Browse the repository at this point in the history
  11. ucc: switch to CUDA stubs outputs

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    6827d97 View commit details
    Browse the repository at this point in the history
  12. python3Packages.jaxlib-bin: pin the most recent supported CUDA

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    629cfa8 View commit details
    Browse the repository at this point in the history
  13. python3Packages.cupy: CUDA 12.4 support

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    12c2947 View commit details
    Browse the repository at this point in the history
  14. python3Packages.tensorrt: fixup

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    950c598 View commit details
    Browse the repository at this point in the history
  15. ctranslate2: switch from rec to finalAttrs

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    06e79ad View commit details
    Browse the repository at this point in the history
  16. ctranslate2: use lib.strings.cmake* functionality

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    d382732 View commit details
    Browse the repository at this point in the history
  17. ctranslate2: fixup CUDA support

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    9aa1551 View commit details
    Browse the repository at this point in the history
  18. faiss: switch to finalAttrs to express dependencies and ease use of o…

    …verrideAttrs
    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    8ed2db1 View commit details
    Browse the repository at this point in the history
  19. faiss: update cuda handling

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    42176a0 View commit details
    Browse the repository at this point in the history
  20. onnxruntime: move from rec to finalAttrs

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    2a9003c View commit details
    Browse the repository at this point in the history
  21. onnxruntime: make more use of lib.strings.cmake*

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    4edf375 View commit details
    Browse the repository at this point in the history
  22. onnxruntime: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    8e92310 View commit details
    Browse the repository at this point in the history
  23. opencv4: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    bca49ec View commit details
    Browse the repository at this point in the history
  24. opencv4: add cudaPackages to passthru for dependents to use

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    69920b6 View commit details
    Browse the repository at this point in the history
  25. dlib: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    ff6bbe8 View commit details
    Browse the repository at this point in the history
  26. katago: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    fd76175 View commit details
    Browse the repository at this point in the history
  27. frei0r: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    4156506 View commit details
    Browse the repository at this point in the history
  28. suitesparse: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    8dc3b4d View commit details
    Browse the repository at this point in the history
  29. digikam: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    9a7363d View commit details
    Browse the repository at this point in the history
  30. maa-assistant-arknights: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    ba603ab View commit details
    Browse the repository at this point in the history
  31. llama-cpp: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    1a3e6a5 View commit details
    Browse the repository at this point in the history
  32. koboldcpp: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    190f814 View commit details
    Browse the repository at this point in the history
  33. local-ai: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    1edc98f View commit details
    Browse the repository at this point in the history
  34. libsForQt5.mauikit-imagetools: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    3318a6d View commit details
    Browse the repository at this point in the history
  35. mlt: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    5a04920 View commit details
    Browse the repository at this point in the history
  36. obs-studio-plugins.advanced-scene-switcher: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    da21148 View commit details
    Browse the repository at this point in the history
  37. obs-studio-plugins.obs-backgroundremoval: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    8ec18ac View commit details
    Browse the repository at this point in the history
  38. openmvs: boost comes with ZSTD from 1.69

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    8213595 View commit details
    Browse the repository at this point in the history
  39. openmvs: switch from rec to finalAttrs

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    5cc9c4f View commit details
    Browse the repository at this point in the history
  40. openmvs: switch from sha256 to hash when using sri hashes

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    4c50a6a View commit details
    Browse the repository at this point in the history
  41. openmvs: use lib.strings.cmake* functionality

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    cf8b1c1 View commit details
    Browse the repository at this point in the history
  42. openmvs: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    e489a8f View commit details
    Browse the repository at this point in the history
  43. lightgbm: mark as broken when cudaSupport is true

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    cd0ba5b View commit details
    Browse the repository at this point in the history
  44. python3Packages.torchaudio: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    255347e View commit details
    Browse the repository at this point in the history
  45. monado: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    a1b6078 View commit details
    Browse the repository at this point in the history
  46. python3Packages.torch: take autoAddDriverRunpath from pkgs

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    26f4838 View commit details
    Browse the repository at this point in the history
  47. openai-whisper-cpp: CUDA fixups

    `cuda_cccl.dev` is now propagated by `cuda_cudart.dev`, which is provided by `cuda_cudart`.
    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    671992f View commit details
    Browse the repository at this point in the history
  48. xpano: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    e994eeb View commit details
    Browse the repository at this point in the history
  49. waifu2x-converter-cpp: CUDA fixups

    `opencv.cxxdev` provides all necessary CUDA utilities for this package.
    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    4ae3fec View commit details
    Browse the repository at this point in the history
  50. ueberzugpp: mark as broken when cudaSupport is enabled

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    5489190 View commit details
    Browse the repository at this point in the history
  51. python3Packages.onnxruntime: CUDA fixups

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    c4fd6d0 View commit details
    Browse the repository at this point in the history
  52. python3Packages.xformers: fixup

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    e2382f7 View commit details
    Browse the repository at this point in the history
  53. opentrack: fixup

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    c0296b5 View commit details
    Browse the repository at this point in the history
  54. osm2pgsql: fixup

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    144e2b5 View commit details
    Browse the repository at this point in the history
  55. petsc: fixup

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    a87278a View commit details
    Browse the repository at this point in the history
  56. python3Packages.bitsandbytes: 0.42.0 -> 0.43.1; fixup

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    26d4073 View commit details
    Browse the repository at this point in the history
  57. cp2k: fixup

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    a002044 View commit details
    Browse the repository at this point in the history
  58. openmpi: cuda_cudart has headers in include output

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    e750f6a View commit details
    Browse the repository at this point in the history
  59. python3Packages.chainer: fixup

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    3d91912 View commit details
    Browse the repository at this point in the history
  60. blender: switch from addOpenGLRunpath to autoAddDriverRunpath

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    1ecf02a View commit details
    Browse the repository at this point in the history
  61. firestarter: switch from rec to finalAttrs

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    0afd714 View commit details
    Browse the repository at this point in the history
  62. Configuration menu
    Copy the full SHA
    7b2ee44 View commit details
    Browse the repository at this point in the history
  63. firestarter: refactor to make better use of lib

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    4d6eb2f View commit details
    Browse the repository at this point in the history
  64. firestarter: switch to cuda-redist

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    1016b95 View commit details
    Browse the repository at this point in the history
  65. firestarter: use nixpkgs-provided hwloc

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    560dd49 View commit details
    Browse the repository at this point in the history
  66. firestarter: 2.0 -> 2.1

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    a731888 View commit details
    Browse the repository at this point in the history
  67. rapids-cmake: init at 24.06.00

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    ad7e17f View commit details
    Browse the repository at this point in the history
  68. cudaPackages.nvbench: init at 0-unstable-2024-05-31

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    da17174 View commit details
    Browse the repository at this point in the history
  69. wip

    Connor Baker authored and ConnorBaker committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    fed9d55 View commit details
    Browse the repository at this point in the history
  70. Configuration menu
    Copy the full SHA
    62796e8 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. wip

    ConnorBaker committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    71ebe67 View commit details
    Browse the repository at this point in the history