Commit Graph

  • f93f87c802 nccl dep + default for cuda (#2526) Awni Hannun 2025-08-21 17:57:49 -07:00
  • 9392fc3f88 NCCL backend (#2476) Anastasiia Filippova 2025-08-21 20:56:15 +02:00
  • e843c4d8d5 fix power (#2523) Awni Hannun 2025-08-21 06:46:01 -07:00
  • 0c5fc63a36 Fix docs omission (#2524) Angelos Katharopoulos 2025-08-20 17:56:06 -07:00
  • e397177f6e Custom cuda kernel (#2517) Angelos Katharopoulos 2025-08-20 17:20:22 -07:00
  • f4c8888cbe [CUDA] Fix stride of singleton dims before passing to cuDNN (#2521) Cheng 2025-08-21 08:55:26 +09:00
  • 25c1e03205 Fix overflow in large filter small channels (#2520) Angelos Katharopoulos 2025-08-20 08:03:29 -07:00
  • 512281781c Remove state return from function example in compile documentation (#2518) russellizadi 2025-08-20 03:45:05 -04:00
  • ac85ddfdb7 [CUDA] Add GEMM-based fallback convolution kernels (#2511) Cheng 2025-08-20 10:06:22 +09:00
  • 65d0d40232 Split cuDNN helpers into a separate header (#2491) Cheng 2025-08-20 09:29:28 +09:00
  • cea9369610 fix lapack svd (#2515) Awni Hannun 2025-08-18 15:07:59 -07:00
  • e7c6e1db82 no segfault with uninitialized array.at (#2514) Awni Hannun 2025-08-18 08:33:38 -07:00
  • c5fcd5b61b fix custom kernel test (#2510) Awni Hannun 2025-08-18 06:45:59 -07:00
  • 1df9887998 Ensure no oob read in gemv_masked (#2508) Angelos Katharopoulos 2025-08-17 08:42:33 -07:00
  • 73f22d6226 Ensure small sort doesn't use indices if not argsort (#2506) Angelos Katharopoulos 2025-08-17 08:42:20 -07:00
  • c422050ca7 Update cuDNN Frontend to v1.14 (#2505) Cheng 2025-08-17 19:13:01 +09:00
  • 1ba18ff7d9 [CUDA] Fix conv grads with groups (#2495) Cheng 2025-08-16 10:09:18 +09:00
  • 37b440faa8 Clean up code handling both std::vector and SmallVector (#2493) Cheng 2025-08-16 09:01:10 +09:00
  • 888b13ed63 Remove the hack around SmallVector in cpu compile (#2494) Cheng 2025-08-16 08:17:24 +09:00
  • 4abb218d21 The naive_conv_2d is no longer used (#2496) Cheng 2025-08-16 07:57:30 +09:00
  • 6441c21a94 Faster general unary op (#2472) Awni Hannun 2025-08-15 15:04:12 -07:00
  • dfb5022eab Rename cu::Matmul to CublasGemm (#2488) Cheng 2025-08-13 09:37:40 +09:00
  • ac207ce7aa make code blocks copyable (#2480) Daniel Yeh 2025-08-12 21:29:02 +02:00
  • fce53b61d6 Fix reduce sum/prod overflow (#2477) Abe Leininger 2025-08-12 02:05:33 -05:00
  • 8ae4a76308 Use CMake <4.1 to avoid the nvpl error (#2489) Angelos Katharopoulos 2025-08-12 00:03:42 -07:00
  • 7fde1b6a1e Fix logsumexp/softmax not fused for some cases (#2474) Cheng 2025-08-09 06:07:17 +09:00
  • aa7b47481a [CUDA] Optimize set_mm_device_pointers for small ndim (#2473) Cheng 2025-08-08 15:23:30 +09:00
  • 56be773610 version (#2470) v0.28.0 Awni Hannun 2025-08-07 00:36:04 -07:00
  • a9bdd67baa Add CUDA sdpa vector (#2468) Jagrit Digani 2025-08-06 21:40:26 -07:00
  • a22d0bf273 Add stricter condition to matrix sdpa sdpav-backup Angelos Katharopoulos 2025-08-06 19:51:14 -07:00
  • f2adb5638d Fix typo in metal command encoder (#2471) Angelos Katharopoulos 2025-08-06 16:58:23 -07:00
  • 728d4db582 Support destination arg in tree flatten/unflatten (#2450) Luca Vivona 2025-08-06 18:34:59 -04:00
  • 99d8de8445 Fix cudnn routing Jagrit Digani 2025-08-06 15:05:58 -07:00
  • c66b76a8c8 Update routing Jagrit Digani 2025-08-06 15:01:15 -07:00
  • f81edd184f Complete 2 pass sdpav Jagrit Digani 2025-08-06 13:57:40 -07:00
  • 7f8ba2a003 [WIP] 2 pass sdpav Jagrit Digani 2025-08-06 09:54:41 -07:00
  • c28249b81a Add more nvtx range for debug Jagrit Digani 2025-08-01 12:49:24 -07:00
  • e74bcdc5e3 Add sdpa file Jagrit Digani 2025-07-25 12:30:50 -07:00
  • d8ed6c1aa3 Add base cudnn attention support Jagrit Digani 2025-07-25 12:30:22 -07:00
  • db5c7efcf6 revert default cuda install (#2465) Awni Hannun 2025-08-06 06:19:12 -07:00
  • 7bb96e4249 fix cublas on h100 (#2466) Awni Hannun 2025-08-06 06:18:58 -07:00
  • fa89f0b150 faster gather qmm sorted test (#2463) Awni Hannun 2025-08-05 06:27:40 -07:00
  • ca973d1e83 fix install tags (#2464) Awni Hannun 2025-08-04 20:01:23 -07:00
  • 828c5f1137 Use SmallVector for shapes and strides (#2454) Cheng 2025-08-05 09:41:03 +09:00
  • 7d86a5c108 Feat: add USE_SYSTEM_FMT CMake option (#2219) Gaétan Lepage 2025-08-05 01:36:11 +02:00
  • 0b807893a7 fix wraps compile (#2461) Awni Hannun 2025-08-04 16:14:18 -07:00
  • 6ad0889c8a default install cuda on linux (#2462) Awni Hannun 2025-08-04 15:33:05 -07:00
  • 737dd6d1ac Add missing <algorithm> header to jit_compiler.cpp (#2460) Zamderax 2025-08-04 14:00:46 -07:00
  • aaf78f4c6b Use LRU cache for cuda graph (#2448) Cheng 2025-08-02 21:28:57 +09:00
  • 8831064493 Fix arctan2 grads (#2453) Angelos Katharopoulos 2025-08-01 21:06:04 -07:00
  • be9bc96da4 [CUDA] Matmul utils initial commit (#2441) Angelos Katharopoulos 2025-08-01 14:22:25 -07:00
  • 86258f292f [CUDA] Vectorize generated kernels (#2444) Angelos Katharopoulos 2025-07-31 18:18:57 -07:00
  • b26d88591c [CUDA] Save primitive inputs faster (#2449) Cheng 2025-08-01 10:16:06 +09:00
  • 86c6a15571 [CUDA] Backward convolution (#2431) Cheng 2025-08-01 09:54:05 +09:00
  • 8b25ce62d5 Add tests for export including control flow models and quantized models (#2430) junpeiz 2025-07-31 11:06:26 -07:00
  • da5912e4f2 fix custom metal extension (#2446) Awni Hannun 2025-07-31 06:25:36 -07:00
  • daafee676f Fix wrong graph key when using concurrent context (#2447) Cheng 2025-07-31 22:01:05 +09:00
  • d32519c8ee fix gemv regression (#2445) Awni Hannun 2025-07-30 14:23:01 -07:00
  • b405591249 fix circular reference (#2443) Awni Hannun 2025-07-30 09:37:44 -07:00
  • 3bf81ed1bd [CUDA] Quantized refactoring (#2442) Angelos Katharopoulos 2025-07-30 08:27:20 -07:00
  • 2204182bba Make CI faster (#2440) Cheng 2025-07-30 18:26:36 +09:00
  • 3628e5d497 Use load_vector in arg_reduce (#2439) Cheng 2025-07-30 17:40:26 +09:00
  • a0ae49d397 Move arange to its own file (#2438) Cheng 2025-07-30 13:05:51 +09:00
  • 254476718b Remove the kernel arg from get_launch_args (#2437) Cheng 2025-07-30 11:43:02 +09:00
  • 3adba92ebe Cuda faster softmax (#2435) Awni Hannun 2025-07-29 17:18:12 -07:00
  • ef631d63af faster rms norm (#2433) Awni Hannun 2025-07-29 13:12:00 -07:00
  • 970dbe8e25 Use ccache in CI (#2414) Cheng 2025-07-29 08:43:22 +09:00
  • 641be9463b Add more CUDA architectures for PyPi package (#2427) Awni Hannun 2025-07-28 12:35:15 -07:00
  • ab0e608862 [CUDA] More sizes for gemv (#2429) Awni Hannun 2025-07-28 12:35:01 -07:00
  • 1588659062 no occupancy query for launch params (#2426) Awni Hannun 2025-07-28 09:09:41 -07:00
  • b9e88fb976 [CUDA] Fix segfault on exit (#2424) Awni Hannun 2025-07-27 08:08:13 -07:00
  • 4ad53414dd fix cuda pypi package (#2423) v0.27.1 Awni Hannun 2025-07-25 15:20:29 -07:00
  • d1165b215e version (#2420) Awni Hannun 2025-07-25 13:29:28 -07:00
  • dcb8319f3d update install docs and requirements (#2419) Awni Hannun 2025-07-25 12:13:19 -07:00
  • 5597fa089c Fix qvm splitk (#2415) Awni Hannun 2025-07-25 11:50:24 -07:00
  • 9acec364c2 [CUDA] Always use batched matmul (#2404) Awni Hannun 2025-07-24 20:46:02 -07:00
  • 7d9d6ef456 docs: fix adam and adamw eps placement (#2416) Skonor 2025-07-24 16:40:45 -07:00
  • 6f5874a2f2 [CUDA] Initial implementation of Convolution with cuDNN (#2385) Cheng 2025-07-25 08:12:10 +09:00
  • 70dc336785 Test on cuda 12.2 and 12.9 (#2413) Awni Hannun 2025-07-24 06:06:15 -07:00
  • 4e504039f5 [Metal] Release metal events (#2412) Awni Hannun 2025-07-23 19:53:42 -07:00
  • d1f4d291e8 Fix uv install and add dev release (#2411) Awni Hannun 2025-07-23 16:54:19 -07:00
  • e1840853ce full row mask in sdpa consistently gives nan (#2406) Awni Hannun 2025-07-23 16:37:03 -07:00
  • 0f5ce173da [CUDA] --compress-mode requires CUDA 12.8 (#2407) Cheng 2025-07-23 22:11:11 +09:00
  • 588854195f Remove unused code in Convolution::vjp (#2408) Cheng 2025-07-23 22:11:00 +09:00
  • 28d068bce6 Fix an error in the comment for mx.dequantize (#2409) Fangjun Kuang 2025-07-23 21:10:50 +08:00
  • 8269c9d02d Support unaligned M qmm Angelos Katharopoulos 2025-07-23 00:40:27 -07:00
  • 903b40627c Add dynamic shared memory and improve qmm Angelos Katharopoulos 2025-07-22 23:36:53 -07:00
  • d107d8d495 add cuda gemv (#2400) Awni Hannun 2025-07-22 08:24:13 -07:00
  • 1e496ddb82 [CUDA] Simplify allocator (#2392) Awni Hannun 2025-07-22 08:24:01 -07:00
  • 74eccbf3fa use size option in binary (#2399) Awni Hannun 2025-07-22 07:00:53 -07:00
  • 08638223ca Fix including stubs in wheel (#2398) Awni Hannun 2025-07-22 06:30:17 -07:00
  • 700f7dcf01 Refactor the matmul a bit Angelos Katharopoulos 2025-07-21 23:38:21 -07:00
  • 56cc858af9 Add contiguous_copy_cpu util for copying array (#2397) Cheng 2025-07-21 23:30:35 +09:00
  • f55c4ed1d6 Remove thrust iterators (#2396) Cheng 2025-07-21 23:30:27 +09:00
  • 6c60bd1cbf Fixed mma and working dequant Angelos Katharopoulos 2025-07-21 04:39:27 -07:00
  • a64cc02a0c Somewhat working matmul primitives Angelos Katharopoulos 2025-07-21 02:22:25 -07:00
  • 346ae5fdb5 Refactor quantized Angelos Katharopoulos 2025-07-16 16:22:25 -07:00
  • 93d70419e7 [CUDA] speedup handling scalars (#2389) Awni Hannun 2025-07-18 21:47:31 -07:00
  • 63f663d9c6 fix cuda manylinux version to match others (#2388) Awni Hannun 2025-07-18 21:02:16 -07:00
  • 84b4d96efa fix release build + patch bump (#2387) v0.26.5 Awni Hannun 2025-07-18 14:47:37 -07:00