AssertionError: Could not find libtransformer_engine.so when using wheel.

I built + installed a wheel for transformer engine using the following commands:
git clone https://github.com/NVIDIA/TransformerEngine.git
cd Transformer Engine
git checkout stable
git submodule update --init --recursive
env CUDACXX=/usr/local/cuda/bin/nvcc python setup.py bdist_wheel
pip install dist/transformer_engine-1.8.0+3ec998e-cp310-cp310-linux_x86_64.whl

But, when I do import transformer_engine. I get the error:
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/ved/TransformerEngine/transformer_engine/__init__.py", line 10, in <module>
    import transformer_engine.common
  File "/home/ved/TransformerEngine/transformer_engine/common/__init__.py", line 46, in <module>
    _TE_LIB_CTYPES = _load_library()
  File "/home/ved/TransformerEngine/transformer_engine/common/__init__.py", line 40, in _load_library
    assert so_path.exists(), f"Could not find libtransformer_engine.{_get_sys_extension()}"
AssertionError: Could not find libtransformer_engine.so

How can I solve this?

Are you able to find libtransformer_engine.so under /home/ved/TransformerEngine/transformer_engine/?
Could you also share the result of pip show transformer-engine?

I re-installed transformer engine using:
env CUDACXX=/usr/local/cuda/bin/nvcc pip install git+https://github.com/NVIDIA/TransformerEngine.git@stable

but I'm still getting the error.
Result of pip show transformer_engine:
(env) my-compute-node:~/TransformerEngine$ pip show transformer_engine
Name: transformer_engine
Version: 1.8.0+3ec998e
Summary: Transformer acceleration library
Home-page:
Author:
Author-email:
License:
Location: /tmp/env/lib/python3.10/site-packages
Requires: packaging, pydantic
Required-by:

Also, I don't see libtransformer_engine.so:
(env) my-compute-node:~/TransformerEngine$ ls transformer_engine
__init__.py  __pycache__  common  jax  paddle  pytorch
(env) ved@slurm-compute-node-38:~/TransformerEngine$

But ... I'm installing straight from git now, so I don't know if that changes things.

@ksivaman, Do you think the issue has to do with the following warning:
CMake Warning:
  Manually-specified variables were not used by the project:

    pybind11_DIR

This could be an issue of a path mismatch since TE is installed in a separate location, and so the shared object should be under /tmp/env/lib/python3.10/site-packages/transformer_engine/. Could you confirm that? And could you go back to your original method of installation and try import TE from a directory other than /home/ved/TransformerEngine/?

Here's my build log, it indicates the .so file is being built:
running bdist_wheel
running build
running build_py
creating build/lib.linux-x86_64-cpython-310
creating build/lib.linux-x86_64-cpython-310/transformer_engine
copying transformer_engine/__init__.py -> build/lib.linux-x86_64-cpython-310/transformer_engine
creating build/lib.linux-x86_64-cpython-310/transformer_engine/jax
copying transformer_engine/jax/setup.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax
copying transformer_engine/jax/attention.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax
copying transformer_engine/jax/layernorm.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax
copying transformer_engine/jax/dot.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax
copying transformer_engine/jax/fp8.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax
copying transformer_engine/jax/layernorm_mlp.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax
copying transformer_engine/jax/__init__.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax
copying transformer_engine/jax/softmax.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax
copying transformer_engine/jax/sharding.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax
creating build/lib.linux-x86_64-cpython-310/transformer_engine/common
copying transformer_engine/common/__init__.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/common
copying transformer_engine/common/utils.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/common
creating build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch
copying transformer_engine/pytorch/setup.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch
copying transformer_engine/pytorch/cpu_offload.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch
copying transformer_engine/pytorch/transformer.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch
copying transformer_engine/pytorch/attention.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch
copying transformer_engine/pytorch/numerics_debug.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch
copying transformer_engine/pytorch/jit.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch
copying transformer_engine/pytorch/fp8.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch
copying transformer_engine/pytorch/te_onnx_extensions.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch
copying transformer_engine/pytorch/__init__.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch
copying transformer_engine/pytorch/export.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch
copying transformer_engine/pytorch/float8_tensor.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch
copying transformer_engine/pytorch/softmax.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch
copying transformer_engine/pytorch/graph.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch
copying transformer_engine/pytorch/distributed.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch
copying transformer_engine/pytorch/utils.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch
copying transformer_engine/pytorch/constants.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch
creating build/lib.linux-x86_64-cpython-310/transformer_engine/paddle
copying transformer_engine/paddle/setup.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle
copying transformer_engine/paddle/fp8.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle
copying transformer_engine/paddle/__init__.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle
copying transformer_engine/paddle/recompute.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle
copying transformer_engine/paddle/fp8_buffer.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle
copying transformer_engine/paddle/profile.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle
copying transformer_engine/paddle/distributed.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle
copying transformer_engine/paddle/cpp_extensions.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle
copying transformer_engine/paddle/utils.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle
copying transformer_engine/paddle/constants.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle
creating build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions
copying transformer_engine/jax/cpp_extensions/misc.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions
copying transformer_engine/jax/cpp_extensions/attention.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions
copying transformer_engine/jax/cpp_extensions/activation.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions
copying transformer_engine/jax/cpp_extensions/quantization.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions
copying transformer_engine/jax/cpp_extensions/normalization.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions
copying transformer_engine/jax/cpp_extensions/transpose.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions
copying transformer_engine/jax/cpp_extensions/base.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions
copying transformer_engine/jax/cpp_extensions/__init__.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions
copying transformer_engine/jax/cpp_extensions/custom_call.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions
copying transformer_engine/jax/cpp_extensions/softmax.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions
creating build/lib.linux-x86_64-cpython-310/transformer_engine/jax/praxis
copying transformer_engine/jax/praxis/module.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax/praxis
copying transformer_engine/jax/praxis/transformer.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax/praxis
copying transformer_engine/jax/praxis/__init__.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax/praxis
creating build/lib.linux-x86_64-cpython-310/transformer_engine/jax/flax
copying transformer_engine/jax/flax/module.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax/flax
copying transformer_engine/jax/flax/transformer.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax/flax
copying transformer_engine/jax/flax/__init__.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/jax/flax
creating build/lib.linux-x86_64-cpython-310/transformer_engine/common/recipe
copying transformer_engine/common/recipe/__init__.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/common/recipe
creating build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/cpp_extensions
copying transformer_engine/pytorch/cpp_extensions/cast.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/cpp_extensions
copying transformer_engine/pytorch/cpp_extensions/activation.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/cpp_extensions
copying transformer_engine/pytorch/cpp_extensions/gemm.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/cpp_extensions
copying transformer_engine/pytorch/cpp_extensions/normalization.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/cpp_extensions
copying transformer_engine/pytorch/cpp_extensions/transpose.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/cpp_extensions
copying transformer_engine/pytorch/cpp_extensions/__init__.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/cpp_extensions
copying transformer_engine/pytorch/cpp_extensions/fused_attn.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/cpp_extensions
creating build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/module
copying transformer_engine/pytorch/module/linear.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/module
copying transformer_engine/pytorch/module/layernorm.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/module
copying transformer_engine/pytorch/module/base.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/module
copying transformer_engine/pytorch/module/layernorm_mlp.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/module
copying transformer_engine/pytorch/module/__init__.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/module
copying transformer_engine/pytorch/module/layernorm_linear.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/module
copying transformer_engine/pytorch/module/_common.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/module
copying transformer_engine/pytorch/module/rmsnorm.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/module
creating build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/optimizers
copying transformer_engine/pytorch/optimizers/fused_sgd.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/optimizers
copying transformer_engine/pytorch/optimizers/multi_tensor_apply.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/optimizers
copying transformer_engine/pytorch/optimizers/__init__.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/optimizers
copying transformer_engine/pytorch/optimizers/fused_adam.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/optimizers
creating build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer
copying transformer_engine/paddle/layer/linear.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer
copying transformer_engine/paddle/layer/transformer.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer
copying transformer_engine/paddle/layer/attention.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer
copying transformer_engine/paddle/layer/layernorm.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer
copying transformer_engine/paddle/layer/base.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer
copying transformer_engine/paddle/layer/layernorm_mlp.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer
copying transformer_engine/paddle/layer/__init__.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer
copying transformer_engine/paddle/layer/softmax.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer
copying transformer_engine/paddle/layer/layernorm_linear.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer
copying transformer_engine/paddle/layer/rmsnorm.py -> build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer
running egg_info
creating transformer_engine.egg-info
writing transformer_engine.egg-info/PKG-INFO
writing dependency_links to transformer_engine.egg-info/dependency_links.txt
writing requirements to transformer_engine.egg-info/requires.txt
writing top-level names to transformer_engine.egg-info/top_level.txt
writing manifest file 'transformer_engine.egg-info/SOURCES.txt'
reading manifest file 'transformer_engine.egg-info/SOURCES.txt'
adding license file 'LICENSE'
writing manifest file 'transformer_engine.egg-info/SOURCES.txt'
creating build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc
copying transformer_engine/pytorch/csrc/common.cu -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc
copying transformer_engine/pytorch/csrc/ts_fp8_op.cpp -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc
creating build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions
copying transformer_engine/pytorch/csrc/extensions/activation.cu -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions
copying transformer_engine/pytorch/csrc/extensions/apply_rope.cu -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions
copying transformer_engine/pytorch/csrc/extensions/attention.cu -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions
copying transformer_engine/pytorch/csrc/extensions/cast.cu -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions
copying transformer_engine/pytorch/csrc/extensions/gemm.cu -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions
copying transformer_engine/pytorch/csrc/extensions/misc.cu -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions
copying transformer_engine/pytorch/csrc/extensions/normalization.cu -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions
copying transformer_engine/pytorch/csrc/extensions/pybind.cpp -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions
copying transformer_engine/pytorch/csrc/extensions/recipe.cu -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions
copying transformer_engine/pytorch/csrc/extensions/softmax.cu -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions
copying transformer_engine/pytorch/csrc/extensions/transpose.cu -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions
creating build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor
copying transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_adam.cu -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor
copying transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_l2norm_kernel.cu -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor
copying transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_scale_kernel.cu -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor
copying transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_sgd_kernel.cu -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor
creating build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/userbuffers
copying transformer_engine/pytorch/csrc/userbuffers/ipcsocket.cc -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/userbuffers
copying transformer_engine/pytorch/csrc/userbuffers/userbuffers-host.cpp -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/userbuffers
copying transformer_engine/pytorch/csrc/userbuffers/userbuffers.cu -> build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/userbuffers
running build_ext
-- The CUDA compiler identification is NVIDIA 12.2.140
-- The CXX compiler identification is GNU 11.4.0
-- Detecting CUDA compiler ABI info
-- Detecting CUDA compiler ABI info - done
-- Check for working CUDA compiler: /usr/local/cuda/bin/nvcc - skipped
-- Detecting CUDA compile features
-- Detecting CUDA compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Found CUDAToolkit: /usr/local/cuda/targets/x86_64-linux/include (found version "12.2.140")
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
-- Found Threads: TRUE
-- cudnn found at /usr/lib/x86_64-linux-gnu/libcudnn.so.
-- Found LIBRARY: /usr/include
-- cuDNN: /usr/lib/x86_64-linux-gnu/libcudnn.so
-- cuDNN: /usr/include
-- cudnn_cnn found at /usr/lib/x86_64-linux-gnu/libcudnn_cnn.so.
-- cudnn_adv found at /usr/lib/x86_64-linux-gnu/libcudnn_adv.so.
-- cudnn_graph found at /usr/lib/x86_64-linux-gnu/libcudnn_graph.so.
-- cudnn_ops found at /usr/lib/x86_64-linux-gnu/libcudnn_ops.so.
-- cudnn_engines_runtime_compiled found at /usr/lib/x86_64-linux-gnu/libcudnn_engines_runtime_compiled.so.
-- cudnn_engines_precompiled found at /usr/lib/x86_64-linux-gnu/libcudnn_engines_precompiled.so.
-- cudnn_heuristic found at /usr/lib/x86_64-linux-gnu/libcudnn_heuristic.so.
-- Found Python: /tmp/env/bin/python (found version "3.10.12") found components: Interpreter Development.Module
-- Configuring done (3.6s)
-- Generating done (0.1s)
-- Build files have been written to: /home/ved/TransformerEngine/build/cmake
[1/32] Building CXX object CMakeFiles/transformer_engine.dir/util/cuda_driver.cpp.o
[2/32] Building CXX object CMakeFiles/transformer_engine.dir/transformer_engine.cpp.o
[3/32] Building CXX object CMakeFiles/transformer_engine.dir/util/cuda_runtime.cpp.o
[4/32] Building CXX object CMakeFiles/transformer_engine.dir/util/system.cpp.o
[5/32] Building CXX object CMakeFiles/transformer_engine.dir/util/rtc.cpp.o
[6/32] Building CXX object CMakeFiles/transformer_engine.dir/layer_norm/ln_api.cpp.o
[7/32] Building CXX object CMakeFiles/transformer_engine.dir/rmsnorm/rmsnorm_api.cpp.o
[8/32] Building CUDA object CMakeFiles/transformer_engine.dir/gemm/cublaslt_gemm.cu.o
[9/32] Building CUDA object CMakeFiles/transformer_engine.dir/recipe/delayed_scaling.cu.o
[10/32] Building CUDA object CMakeFiles/transformer_engine.dir/fused_rope/fused_rope.cu.o
[11/32] Building CUDA object CMakeFiles/transformer_engine.dir/util/cast.cu.o
[12/32] Building CUDA object CMakeFiles/transformer_engine.dir/transpose/transpose.cu.o
[13/32] Building CXX object CMakeFiles/transformer_engine.dir/fused_attn/fused_attn.cpp.o
[14/32] Building CUDA object CMakeFiles/transformer_engine.dir/rmsnorm/rmsnorm_bwd_semi_cuda_kernel.cu.o
[15/32] Building CUDA object CMakeFiles/transformer_engine.dir/transpose/cast_transpose.cu.o
[16/32] Building CUDA object CMakeFiles/transformer_engine.dir/transpose/transpose_fusion.cu.o
[17/32] Building CUDA object CMakeFiles/transformer_engine.dir/activation/swiglu.cu.o
[18/32] Building CUDA object CMakeFiles/transformer_engine.dir/fused_softmax/scaled_aligned_causal_masked_softmax.cu.o
[19/32] Building CUDA object CMakeFiles/transformer_engine.dir/fused_softmax/scaled_masked_softmax.cu.o
[20/32] Building CUDA object CMakeFiles/transformer_engine.dir/fused_softmax/scaled_upper_triang_masked_softmax.cu.o
[21/32] Building CUDA object CMakeFiles/transformer_engine.dir/activation/relu.cu.o
[22/32] Building CUDA object CMakeFiles/transformer_engine.dir/layer_norm/ln_bwd_semi_cuda_kernel.cu.o
[23/32] Building CUDA object CMakeFiles/transformer_engine.dir/activation/gelu.cu.o
[24/32] Building CUDA object CMakeFiles/transformer_engine.dir/rmsnorm/rmsnorm_fwd_cuda_kernel.cu.o
[25/32] Building CUDA object CMakeFiles/transformer_engine.dir/transpose/multi_cast_transpose.cu.o
[26/32] Building CUDA object CMakeFiles/transformer_engine.dir/fused_attn/utils.cu.o
[27/32] Building CUDA object CMakeFiles/transformer_engine.dir/fused_attn/fused_attn_f16_max512_seqlen.cu.o
[28/32] Building CUDA object CMakeFiles/transformer_engine.dir/fused_attn/fused_attn_f16_arbitrary_seqlen.cu.o
[29/32] Building CUDA object CMakeFiles/transformer_engine.dir/fused_attn/fused_attn_fp8.cu.o
[30/32] Building CUDA object CMakeFiles/transformer_engine.dir/transpose/cast_transpose_fusion.cu.o
[31/32] Building CUDA object CMakeFiles/transformer_engine.dir/layer_norm/ln_fwd_cuda_kernel.cu.o
[32/32] Linking CXX shared library libtransformer_engine.so
-- Install configuration: "Release"
-- Installing: /home/ved/TransformerEngine/build/lib.linux-x86_64-cpython-310/./libtransformer_engine.so
-- Set non-toolchain portion of runtime path of "/home/ved/TransformerEngine/build/lib.linux-x86_64-cpython-310/./libtransformer_engine.so" to ""
Building CMake extension transformer_engine
Running command /home/ved/TransformerEngine/.eggs/cmake-3.30.2-py3.10-linux-x86_64.egg/cmake/data/bin/cmake -S /home/ved/TransformerEngine/transformer_engine/common -B /home/ved/TransformerEngine/build/cmake -DPython_EXECUTABLE=/tmp/env/bin/python -DPython_INCLUDE_DIR=/usr/include/python3.10 -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX=/home/ved/TransformerEngine/build/lib.linux-x86_64-cpython-310 -GNinja -Dpybind11_DIR=/home/ved/TransformerEngine/.eggs/pybind11-2.13.4-py3.10.egg/pybind11/share/cmake/pybind11
Running command /home/ved/TransformerEngine/.eggs/cmake-3.30.2-py3.10-linux-x86_64.egg/cmake/data/bin/cmake --build /home/ved/TransformerEngine/build/cmake
Running command /home/ved/TransformerEngine/.eggs/cmake-3.30.2-py3.10-linux-x86_64.egg/cmake/data/bin/cmake --install /home/ved/TransformerEngine/build/cmake
building 'transformer_engine_torch' extension
creating /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310
creating /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine
creating /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch
creating /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc
creating /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions
creating /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor
creating /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/userbuffers
[1/20] c++ -MMD -MF /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/userbuffers/ipcsocket.o.d -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/userbuffers/ipcsocket.cc -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/userbuffers/ipcsocket.o -O3 -fvisibility=hidden -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[2/20] c++ -MMD -MF /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/userbuffers/userbuffers-host.o.d -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/userbuffers/userbuffers-host.cpp -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/userbuffers/userbuffers-host.o -O3 -fvisibility=hidden -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[3/20] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/userbuffers/userbuffers.o.d -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/userbuffers/userbuffers.cu -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/userbuffers/userbuffers.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -gencode arch=compute_70,code=sm_70 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_BFLOAT16_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ -U__CUDA_NO_BFLOAT162_OPERATORS__ -U__CUDA_NO_BFLOAT162_CONVERSIONS__ --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math --threads 4 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[4/20] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_sgd_kernel.o.d -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_sgd_kernel.cu -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_sgd_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -gencode arch=compute_70,code=sm_70 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_BFLOAT16_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ -U__CUDA_NO_BFLOAT162_OPERATORS__ -U__CUDA_NO_BFLOAT162_CONVERSIONS__ --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math --threads 4 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[5/20] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_scale_kernel.o.d -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_scale_kernel.cu -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_scale_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -gencode arch=compute_70,code=sm_70 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_BFLOAT16_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ -U__CUDA_NO_BFLOAT162_OPERATORS__ -U__CUDA_NO_BFLOAT162_CONVERSIONS__ --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math --threads 4 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[6/20] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_l2norm_kernel.o.d -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_l2norm_kernel.cu -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_l2norm_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -gencode arch=compute_70,code=sm_70 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_BFLOAT16_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ -U__CUDA_NO_BFLOAT162_OPERATORS__ -U__CUDA_NO_BFLOAT162_CONVERSIONS__ --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math --threads 4 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[7/20] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_adam.o.d -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_adam.cu -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_adam.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -gencode arch=compute_70,code=sm_70 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_BFLOAT16_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ -U__CUDA_NO_BFLOAT162_OPERATORS__ -U__CUDA_NO_BFLOAT162_CONVERSIONS__ --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math --threads 4 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[8/20] c++ -MMD -MF /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/ts_fp8_op.o.d -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/ts_fp8_op.cpp -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/ts_fp8_op.o -O3 -fvisibility=hidden -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[9/20] c++ -MMD -MF /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/pybind.o.d -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/extensions/pybind.cpp -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/pybind.o -O3 -fvisibility=hidden -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[10/20] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/recipe.o.d -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/extensions/recipe.cu -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/recipe.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -gencode arch=compute_70,code=sm_70 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_BFLOAT16_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ -U__CUDA_NO_BFLOAT162_OPERATORS__ -U__CUDA_NO_BFLOAT162_CONVERSIONS__ --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math --threads 4 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[11/20] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/gemm.o.d -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/extensions/gemm.cu -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/gemm.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -gencode arch=compute_70,code=sm_70 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_BFLOAT16_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ -U__CUDA_NO_BFLOAT162_OPERATORS__ -U__CUDA_NO_BFLOAT162_CONVERSIONS__ --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math --threads 4 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[12/20] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/common.o.d -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/common.cu -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/common.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -gencode arch=compute_70,code=sm_70 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_BFLOAT16_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ -U__CUDA_NO_BFLOAT162_OPERATORS__ -U__CUDA_NO_BFLOAT162_CONVERSIONS__ --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math --threads 4 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[13/20] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/misc.o.d -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/extensions/misc.cu -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/misc.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -gencode arch=compute_70,code=sm_70 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_BFLOAT16_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ -U__CUDA_NO_BFLOAT162_OPERATORS__ -U__CUDA_NO_BFLOAT162_CONVERSIONS__ --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math --threads 4 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[14/20] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/normalization.o.d -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/extensions/normalization.cu -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/normalization.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -gencode arch=compute_70,code=sm_70 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_BFLOAT16_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ -U__CUDA_NO_BFLOAT162_OPERATORS__ -U__CUDA_NO_BFLOAT162_CONVERSIONS__ --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math --threads 4 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[15/20] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/activation.o.d -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/extensions/activation.cu -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/activation.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -gencode arch=compute_70,code=sm_70 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_BFLOAT16_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ -U__CUDA_NO_BFLOAT162_OPERATORS__ -U__CUDA_NO_BFLOAT162_CONVERSIONS__ --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math --threads 4 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[16/20] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/transpose.o.d -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/extensions/transpose.cu -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/transpose.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -gencode arch=compute_70,code=sm_70 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_BFLOAT16_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ -U__CUDA_NO_BFLOAT162_OPERATORS__ -U__CUDA_NO_BFLOAT162_CONVERSIONS__ --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math --threads 4 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[17/20] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/cast.o.d -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/extensions/cast.cu -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/cast.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -gencode arch=compute_70,code=sm_70 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_BFLOAT16_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ -U__CUDA_NO_BFLOAT162_OPERATORS__ -U__CUDA_NO_BFLOAT162_CONVERSIONS__ --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math --threads 4 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[18/20] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/softmax.o.d -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/extensions/softmax.cu -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/softmax.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -gencode arch=compute_70,code=sm_70 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_BFLOAT16_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ -U__CUDA_NO_BFLOAT162_OPERATORS__ -U__CUDA_NO_BFLOAT162_CONVERSIONS__ --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math --threads 4 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[19/20] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/apply_rope.o.d -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/extensions/apply_rope.cu -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/apply_rope.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -gencode arch=compute_70,code=sm_70 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_BFLOAT16_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ -U__CUDA_NO_BFLOAT162_OPERATORS__ -U__CUDA_NO_BFLOAT162_CONVERSIONS__ --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math --threads 4 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[20/20] /usr/local/cuda/bin/nvcc --generate-dependencies-with-compile --dependency-output /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/attention.o.d -I/home/ved/TransformerEngine/transformer_engine -I/home/ved/TransformerEngine/transformer_engine/common -I/home/ved/TransformerEngine/transformer_engine/common/include -I/home/ved/TransformerEngine/transformer_engine/pytorch/csrc -I/tmp/env/lib/python3.10/site-packages/torch/include -I/tmp/env/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -I/tmp/env/lib/python3.10/site-packages/torch/include/TH -I/tmp/env/lib/python3.10/site-packages/torch/include/THC -I/usr/local/cuda/include -I/tmp/env/include -I/usr/include/python3.10 -c -c /home/ved/TransformerEngine/transformer_engine/pytorch/csrc/extensions/attention.cu -o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/attention.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -gencode arch=compute_70,code=sm_70 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_BFLOAT16_OPERATORS__ -U__CUDA_NO_BFLOAT16_CONVERSIONS__ -U__CUDA_NO_BFLOAT162_OPERATORS__ -U__CUDA_NO_BFLOAT162_CONVERSIONS__ --expt-relaxed-constexpr --expt-extended-lambda --use_fast_math --threads 4 -gencode arch=compute_80,code=sm_80 -gencode arch=compute_90,code=sm_90 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=transformer_engine_torch -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
x86_64-linux-gnu-g++ -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -g -fwrapv -O2 /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/common.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/activation.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/apply_rope.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/attention.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/cast.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/gemm.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/misc.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_adam.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_l2norm_kernel.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_scale_kernel.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_sgd_kernel.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/normalization.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/pybind.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/recipe.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/softmax.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/transpose.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/ts_fp8_op.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/userbuffers/ipcsocket.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/userbuffers/userbuffers-host.o /home/ved/TransformerEngine/build/temp.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/userbuffers/userbuffers.o -L/tmp/env/lib/python3.10/site-packages/torch/lib -L/usr/local/cuda/lib64 -L/usr/lib/x86_64-linux-gnu -lc10 -ltorch -ltorch_cpu -ltorch_python -lcudart -lc10_cuda -ltorch_cuda -o build/lib.linux-x86_64-cpython-310/transformer_engine_torch.cpython-310-x86_64-linux-gnu.so
copying build/lib.linux-x86_64-cpython-310/transformer_engine_torch.cpython-310-x86_64-linux-gnu.so -> /home/ved/TransformerEngine/build/lib.linux-x86_64-cpython-310/transformer_engine
copying build/lib.linux-x86_64-cpython-310/libtransformer_engine.so -> /home/ved/TransformerEngine/build/lib.linux-x86_64-cpython-310/transformer_engine
installing to build/bdist.linux-x86_64/wheel
running install
running install_lib
creating build/bdist.linux-x86_64
creating build/bdist.linux-x86_64/wheel
creating build/bdist.linux-x86_64/wheel/transformer_engine
creating build/bdist.linux-x86_64/wheel/transformer_engine/jax
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/setup.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/attention.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/layernorm.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/dot.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/fp8.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/layernorm_mlp.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/__init__.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax
creating build/bdist.linux-x86_64/wheel/transformer_engine/jax/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions/misc.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions/attention.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions/activation.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions/quantization.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions/normalization.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions/transpose.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions/base.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions/__init__.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions/custom_call.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/cpp_extensions/softmax.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/softmax.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/sharding.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax
creating build/bdist.linux-x86_64/wheel/transformer_engine/jax/praxis
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/praxis/module.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax/praxis
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/praxis/transformer.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax/praxis
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/praxis/__init__.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax/praxis
creating build/bdist.linux-x86_64/wheel/transformer_engine/jax/flax
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/flax/module.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax/flax
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/flax/transformer.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax/flax
copying build/lib.linux-x86_64-cpython-310/transformer_engine/jax/flax/__init__.py -> build/bdist.linux-x86_64/wheel/transformer_engine/jax/flax
copying build/lib.linux-x86_64-cpython-310/transformer_engine/__init__.py -> build/bdist.linux-x86_64/wheel/transformer_engine
copying build/lib.linux-x86_64-cpython-310/transformer_engine/transformer_engine_torch.cpython-310-x86_64-linux-gnu.so -> build/bdist.linux-x86_64/wheel/transformer_engine
copying build/lib.linux-x86_64-cpython-310/transformer_engine/libtransformer_engine.so -> build/bdist.linux-x86_64/wheel/transformer_engine
creating build/bdist.linux-x86_64/wheel/transformer_engine/common
creating build/bdist.linux-x86_64/wheel/transformer_engine/common/recipe
copying build/lib.linux-x86_64-cpython-310/transformer_engine/common/recipe/__init__.py -> build/bdist.linux-x86_64/wheel/transformer_engine/common/recipe
copying build/lib.linux-x86_64-cpython-310/transformer_engine/common/__init__.py -> build/bdist.linux-x86_64/wheel/transformer_engine/common
copying build/lib.linux-x86_64-cpython-310/transformer_engine/common/utils.py -> build/bdist.linux-x86_64/wheel/transformer_engine/common
creating build/bdist.linux-x86_64/wheel/transformer_engine/pytorch
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/setup.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/cpu_offload.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/transformer.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/attention.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/numerics_debug.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/jit.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/fp8.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/te_onnx_extensions.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/__init__.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/export.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch
creating build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/cpp_extensions/cast.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/cpp_extensions/activation.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/cpp_extensions/gemm.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/cpp_extensions/normalization.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/cpp_extensions/transpose.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/cpp_extensions/__init__.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/cpp_extensions/fused_attn.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/cpp_extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/float8_tensor.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch
creating build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/module
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/module/linear.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/module
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/module/layernorm.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/module
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/module/base.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/module
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/module/layernorm_mlp.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/module
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/module/__init__.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/module
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/module/layernorm_linear.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/module
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/module/_common.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/module
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/module/rmsnorm.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/module
creating build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/optimizers
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/optimizers/fused_sgd.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/optimizers
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/optimizers/multi_tensor_apply.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/optimizers
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/optimizers/__init__.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/optimizers
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/optimizers/fused_adam.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/optimizers
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/softmax.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/graph.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/distributed.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/utils.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/constants.py -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch
creating build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/common.cu -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/ts_fp8_op.cpp -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc
creating build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/misc.cu -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/extensions
creating build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/extensions/multi_tensor
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_sgd_kernel.cu -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/extensions/multi_tensor
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_l2norm_kernel.cu -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/extensions/multi_tensor
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_adam.cu -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/extensions/multi_tensor
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_scale_kernel.cu -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/extensions/multi_tensor
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/normalization.cu -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/apply_rope.cu -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/gemm.cu -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/activation.cu -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/softmax.cu -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/cast.cu -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/recipe.cu -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/pybind.cpp -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/attention.cu -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/extensions
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/extensions/transpose.cu -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/extensions
creating build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/userbuffers
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/userbuffers/userbuffers.cu -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/userbuffers
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/userbuffers/ipcsocket.cc -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/userbuffers
copying build/lib.linux-x86_64-cpython-310/transformer_engine/pytorch/csrc/userbuffers/userbuffers-host.cpp -> build/bdist.linux-x86_64/wheel/transformer_engine/pytorch/csrc/userbuffers
creating build/bdist.linux-x86_64/wheel/transformer_engine/paddle
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/setup.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle
creating build/bdist.linux-x86_64/wheel/transformer_engine/paddle/layer
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer/linear.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle/layer
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer/transformer.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle/layer
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer/attention.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle/layer
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer/layernorm.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle/layer
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer/base.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle/layer
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer/layernorm_mlp.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle/layer
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer/__init__.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle/layer
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer/softmax.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle/layer
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer/layernorm_linear.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle/layer
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/layer/rmsnorm.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle/layer
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/fp8.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/__init__.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/recompute.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/fp8_buffer.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/profile.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/distributed.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/cpp_extensions.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/utils.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle
copying build/lib.linux-x86_64-cpython-310/transformer_engine/paddle/constants.py -> build/bdist.linux-x86_64/wheel/transformer_engine/paddle
running install_egg_info
Copying transformer_engine.egg-info to build/bdist.linux-x86_64/wheel/transformer_engine-1.8.0+3ec998e-py3.10.egg-info
running install_scripts
creating build/bdist.linux-x86_64/wheel/transformer_engine-1.8.0+3ec998e.dist-info/WHEEL
creating 'dist/transformer_engine-1.8.0+3ec998e-cp310-cp310-linux_x86_64.whl' and adding 'build/bdist.linux-x86_64/wheel' to it
adding 'transformer_engine/__init__.py'
adding 'transformer_engine/libtransformer_engine.so'
adding 'transformer_engine/transformer_engine_torch.cpython-310-x86_64-linux-gnu.so'
adding 'transformer_engine/common/__init__.py'
adding 'transformer_engine/common/utils.py'
adding 'transformer_engine/common/recipe/__init__.py'
adding 'transformer_engine/jax/__init__.py'
adding 'transformer_engine/jax/attention.py'
adding 'transformer_engine/jax/dot.py'
adding 'transformer_engine/jax/fp8.py'
adding 'transformer_engine/jax/layernorm.py'
adding 'transformer_engine/jax/layernorm_mlp.py'
adding 'transformer_engine/jax/setup.py'
adding 'transformer_engine/jax/sharding.py'
adding 'transformer_engine/jax/softmax.py'
adding 'transformer_engine/jax/cpp_extensions/__init__.py'
adding 'transformer_engine/jax/cpp_extensions/activation.py'
adding 'transformer_engine/jax/cpp_extensions/attention.py'
adding 'transformer_engine/jax/cpp_extensions/base.py'
adding 'transformer_engine/jax/cpp_extensions/custom_call.py'
adding 'transformer_engine/jax/cpp_extensions/misc.py'
adding 'transformer_engine/jax/cpp_extensions/normalization.py'
adding 'transformer_engine/jax/cpp_extensions/quantization.py'
adding 'transformer_engine/jax/cpp_extensions/softmax.py'
adding 'transformer_engine/jax/cpp_extensions/transpose.py'
adding 'transformer_engine/jax/flax/__init__.py'
adding 'transformer_engine/jax/flax/module.py'
adding 'transformer_engine/jax/flax/transformer.py'
adding 'transformer_engine/jax/praxis/__init__.py'
adding 'transformer_engine/jax/praxis/module.py'
adding 'transformer_engine/jax/praxis/transformer.py'
adding 'transformer_engine/paddle/__init__.py'
adding 'transformer_engine/paddle/constants.py'
adding 'transformer_engine/paddle/cpp_extensions.py'
adding 'transformer_engine/paddle/distributed.py'
adding 'transformer_engine/paddle/fp8.py'
adding 'transformer_engine/paddle/fp8_buffer.py'
adding 'transformer_engine/paddle/profile.py'
adding 'transformer_engine/paddle/recompute.py'
adding 'transformer_engine/paddle/setup.py'
adding 'transformer_engine/paddle/utils.py'
adding 'transformer_engine/paddle/layer/__init__.py'
adding 'transformer_engine/paddle/layer/attention.py'
adding 'transformer_engine/paddle/layer/base.py'
adding 'transformer_engine/paddle/layer/layernorm.py'
adding 'transformer_engine/paddle/layer/layernorm_linear.py'
adding 'transformer_engine/paddle/layer/layernorm_mlp.py'
adding 'transformer_engine/paddle/layer/linear.py'
adding 'transformer_engine/paddle/layer/rmsnorm.py'
adding 'transformer_engine/paddle/layer/softmax.py'
adding 'transformer_engine/paddle/layer/transformer.py'
adding 'transformer_engine/pytorch/__init__.py'
adding 'transformer_engine/pytorch/attention.py'
adding 'transformer_engine/pytorch/constants.py'
adding 'transformer_engine/pytorch/cpu_offload.py'
adding 'transformer_engine/pytorch/distributed.py'
adding 'transformer_engine/pytorch/export.py'
adding 'transformer_engine/pytorch/float8_tensor.py'
adding 'transformer_engine/pytorch/fp8.py'
adding 'transformer_engine/pytorch/graph.py'
adding 'transformer_engine/pytorch/jit.py'
adding 'transformer_engine/pytorch/numerics_debug.py'
adding 'transformer_engine/pytorch/setup.py'
adding 'transformer_engine/pytorch/softmax.py'
adding 'transformer_engine/pytorch/te_onnx_extensions.py'
adding 'transformer_engine/pytorch/transformer.py'
adding 'transformer_engine/pytorch/utils.py'
adding 'transformer_engine/pytorch/cpp_extensions/__init__.py'
adding 'transformer_engine/pytorch/cpp_extensions/activation.py'
adding 'transformer_engine/pytorch/cpp_extensions/cast.py'
adding 'transformer_engine/pytorch/cpp_extensions/fused_attn.py'
adding 'transformer_engine/pytorch/cpp_extensions/gemm.py'
adding 'transformer_engine/pytorch/cpp_extensions/normalization.py'
adding 'transformer_engine/pytorch/cpp_extensions/transpose.py'
adding 'transformer_engine/pytorch/csrc/common.cu'
adding 'transformer_engine/pytorch/csrc/ts_fp8_op.cpp'
adding 'transformer_engine/pytorch/csrc/extensions/activation.cu'
adding 'transformer_engine/pytorch/csrc/extensions/apply_rope.cu'
adding 'transformer_engine/pytorch/csrc/extensions/attention.cu'
adding 'transformer_engine/pytorch/csrc/extensions/cast.cu'
adding 'transformer_engine/pytorch/csrc/extensions/gemm.cu'
adding 'transformer_engine/pytorch/csrc/extensions/misc.cu'
adding 'transformer_engine/pytorch/csrc/extensions/normalization.cu'
adding 'transformer_engine/pytorch/csrc/extensions/pybind.cpp'
adding 'transformer_engine/pytorch/csrc/extensions/recipe.cu'
adding 'transformer_engine/pytorch/csrc/extensions/softmax.cu'
adding 'transformer_engine/pytorch/csrc/extensions/transpose.cu'
adding 'transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_adam.cu'
adding 'transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_l2norm_kernel.cu'
adding 'transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_scale_kernel.cu'
adding 'transformer_engine/pytorch/csrc/extensions/multi_tensor/multi_tensor_sgd_kernel.cu'
adding 'transformer_engine/pytorch/csrc/userbuffers/ipcsocket.cc'
adding 'transformer_engine/pytorch/csrc/userbuffers/userbuffers-host.cpp'
adding 'transformer_engine/pytorch/csrc/userbuffers/userbuffers.cu'
adding 'transformer_engine/pytorch/module/__init__.py'
adding 'transformer_engine/pytorch/module/_common.py'
adding 'transformer_engine/pytorch/module/base.py'
adding 'transformer_engine/pytorch/module/layernorm.py'
adding 'transformer_engine/pytorch/module/layernorm_linear.py'
adding 'transformer_engine/pytorch/module/layernorm_mlp.py'
adding 'transformer_engine/pytorch/module/linear.py'
adding 'transformer_engine/pytorch/module/rmsnorm.py'
adding 'transformer_engine/pytorch/optimizers/__init__.py'
adding 'transformer_engine/pytorch/optimizers/fused_adam.py'
adding 'transformer_engine/pytorch/optimizers/fused_sgd.py'
adding 'transformer_engine/pytorch/optimizers/multi_tensor_apply.py'
adding 'transformer_engine-1.8.0+3ec998e.dist-info/LICENSE'
adding 'transformer_engine-1.8.0+3ec998e.dist-info/METADATA'
adding 'transformer_engine-1.8.0+3ec998e.dist-info/WHEEL'
adding 'transformer_engine-1.8.0+3ec998e.dist-info/top_level.txt'
adding 'transformer_engine-1.8.0+3ec998e.dist-info/RECORD'
removing build/bdist.linux-x86_64/wheel

Ok that worked. I'm silly, I think the issue was trying to import transformer_engine from inside /home/ved/TransformerEngine.


[Streaming] more dependency cleanup

Cleaning up

commons-io
fluent-hc
fastjson

@timmolter

@timmolter wanted to follow up on this


Playground: Unable to run code - TypeError: window.i is not a function

Page URL: https://www.typescriptlang.org/play
Issue: Clicking 'Run' errors with
localizeWithFallback.ts:4 Uncaught TypeError: window.i is not a function
    at localize (localizeWithFallback.ts:4:26)
    at Object.willMount (runtime.ts:92:39)
    at activatePlugin (createElements.ts:250:32)
    at runButton.onclick (index.ts:449:21)

I can't reproduce:

Other user (in closed issue):
https://github.com/microsoft/TypeScript-Website/issues/411#issuecomment-1686621141
Also saw repro comments in Discord:
https://discord.com/channels/508357248330760243/1142137314924048395/1142137314924048395

Even in an incognito window, things work for me, but I can run window.i and it is indeed a string.

Finally did get it to crash, somehow.

Perhaps the ms cookie banner script is introducing it's own window.i? __ms$mod__ is a strange identifier/string
The code booting up the playground has window.i setting up before it pretty unambiguously
https://github.com/microsoft/TypeScript-Website/blob/4f7eb6497e8f1e3cbaec8e2919950ae37d08ee3d/packages/typescriptlang-org/src/templates/play.tsx#L58-L183

Could be application insights? https://github.com/microsoft/ApplicationInsights-JS/blob/45b91f72c8e4b451ecf4c7e44a35f945b4371881/rollup.base.config.js#L76

Yeah, I agree - that's probably it.
Could have the run button re-assign window.i

I encountered the same problem on Windows 11 and Google Chrome.
In the secret mode, it doesn't often occurs but almost always when devtools is open.
https://github.com/microsoft/TypeScript-Website/assets/9500018/1a512a52-941c-40c5-abb4-be6b2b5574e8

Yeah, I agree - that's probably it.
Could have the run button re-assign window.i

Possibly, though that wouldn't help plugins or anyone trying to look it up without the Run button.
I was going to suggest changing the code to use another less-conflict-y name like __tsLocalize but we'd have to leave window.i behind for plugins, yet that will still be broken.
We could make the prop dynamic and have a setter just ignore writes, but...


Request handling is a bit... broken

In the process of building out #153, I've found that request handling is a tad broken. Below are some problems I have found.

Headers do not appear to be set.
The request body is not set and is currently typed as an array, which should probably be a string.
The http application is what is building up the request. This is fine, but does create a little extra work for setting up a testing request. Laravel/Symfony pass the request to the http kernel. Maybe worth discussing?

Headers do not appear to be set.

That's now fixed

The request body is not set and is currently typed as an array, which should probably be a string.

Also fixed now, although why should it be a string? $_GET and $_POST are already arrays, I'd keep it that way.

The http application is what is building up the request. This is fine, but does create a little extra work for setting up a testing request. Laravel/Symfony pass the request to the http kernel. Maybe worth discussing?

I think we discussed this as well in one or two PRs and believe we've found a solution for it 👍
I'm gonna close this one, but feel free to reopen if I've missed anything


add provisioning node to .kitchen.ssh.yml

Would be nice to provide the recommended provisioning node configuration and add a provisioning node to the .kitchen.ssh.yml to build a provision node if the user does not want to provision from their local workstation.
This node when provisioned with have the following:
Install build-essential on linux or developer tools on mac
Install Git
Install ChefDK
Install 'knife push': chef gem install knife-push
Install Delivery CLI
It will also have a fresh delivery-cluster master check out in /home/vagrant plus the ssh keys to communicate to other vagrant nodes for the delivery-cluster ssh build.

Is it a cookbook dependency really needed for this use case? It couldn't be just a single recipe? I like the idea to have a way to create a provisioning node but I am not so sure about creating this essentially to be use by kitchen/vagrant. I rather want this more generic so people can use it with any provider they want.

@afiune I include a cookbook called 'chef-provisioning-node' which can be to configure a provisioning node with any provider. I just include a recipe in the cookbook to demonstrate that it can be used locally with kitchen too. If a user wants to build an AWS node, they would just use the chef-provisioning-node cookbook in it's runlist or the recipe that is included in this PR.

Uhmmm .. I am just trying to understand from what you are saying, which makes sense, and what I see on the code.. For example: Why there is vagrant everywhere?

https://github.com/stephenlauck/delivery-cluster/blob/include_provisioning_node/recipes/provisioning_node.rb#L15-L17
https://github.com/stephenlauck/delivery-cluster/blob/include_provisioning_node/recipes/provisioning_node.rb#L7-L10
https://github.com/stephenlauck/chef-provisioning-node/blob/master/recipes/setup_ssh_keys.rb#L3,L4
https://github.com/stephenlauck/chef-provisioning-node/blob/master/recipes/setup_ssh_keys.rb#L10,L11
https://github.com/stephenlauck/chef-provisioning-node/blob/master/recipes/setup_ssh_keys.rb#L19-L20

Closing this since we are now using Delivery to ship delivery-cluster.. Yey! :smile:


nerdtree-git-plugin conflicts with python-mode

When I have nerdtree-git-plugin and python-mode both installed, and try to use :PymodeLintAuto and :PymodeLint command, this error message keeps poping up:
"adminforms.py" 6L, 205C 已写入
处理 function pymode#buffer_post_write 时发生错误:
第    8 行:
E121: 未定义的变量: b:pymode_modified
E15: 无效的表达式: g:pymode_lint_unmodified || (g:pymode_lint_on_write && b:pymode_modified)
An Issue has already been submitted on python-mode project and yet not closed. I'm not sure which plugin should be modified in order to solve the problem. Maybe someone here knows the answer.
Related Link:
https://github.com/python-mode/python-mode/issues/1006

I have to correct my statement.
The error messages appear to have something to do with :w<cr> command, not :PymodeLintAuto nor :PymodeLint.

Add this into your .vimrc and it may help:
let NERDTreeIgnore=['\.pyc', '\~$']

It's werid that I can't reproduce the error now.
Maybe it's because I wrote this line in my vimrc:
let NERDTreeIgnore = ['^__pycache__$']
Anyway, I'm going to add '\.pyc' and '~$' to the list as well.
Thank you very much for your help @nineKnight .


Mobile signer support

Not mergable in current state; here for reference.
PoC of support for iOS wallet wrapper @ https://github.com/nearprotocol/near-wallet-ios

Closing out this draft as it's not relevant atm. Might be relevant when we look into wallet connect though.


JWS signing runs very slowly

Reproduction: https://github.com/domdomegg/fastly-jws-signing
(can't use fiddle as it doesn't support external deps)
Fastly takes about ~10,000ms to sign a JWT using the jsrsasign library (a JS-native implementation of crypto functions), on a production-enabled service. When running with fastly compute serve it takes ~2,000ms on my machine.
In the browser this takes ~3ms. My understanding is that this is doing the same amount of work: it doesn't defer to a built in crypto module here. So I think fastly should be able to reach similar performance.
I'd also be happy with alternative suggestions on how to generate a JWT on Fastly (e.g. other libraries - however these are limited by the execution environment not having crypto built-ins), or otherwise authenticate against Google APIs with OAuth2 on Fastly :)

It seems to be a performance issue with binary operations (e.g. via JWS.sign -> RSAKey.doPublic -> jsbn.bnModPow -> jsbn.squareTo -> jsbn.am). An even smaller example:
const doMaths = () => {
  let xl = 1;
  for (let i = 0; i < 10_000_000; i++) {
    xl++ & 0x1234;
  }
}

addEventListener("fetch", event => {
  // NB: date is not the most reliable way of getting time, but process.hrtime is not defined in the fastly environment
  const t1 = new Date().getTime()
  doMaths()
  const t2 = new Date().getTime()
  const message = `Doing maths took ${t2 - t1}ms`
  console.log(message)

  event.respondWith(new Response(message));
});

In the browser, this runs in ~8ms. In fastly compute serve it takes ~6000ms, and on Fastly itself takes ~30,000ms.

Closing this as we now have it implemented natively 👍


show element without affecting on the display style of it

This fix will effect on popup function which call show function for displaying popups. need to find a better way to fix it.