Cannot install DeepSpeed on Ubuntu 20.04

Attempting to install DeepSpeed using the following steps:

Cloned DeepSpeed repository
Created virtual environment: python3 -m venv env
Activated virtual environment: source env/bin/activate
Ran install script: ./install.sh

gcc: 8.4.0
nvcc: 10.2
g++: 8.4.0
$ pip3 list
Package       Version
------------- -------
apex          0.1
cpufeature    0.1.1
future        0.18.2
numpy         1.19.2
Pillow        7.2.0
pip           20.0.2
pkg-resources 0.0.0
protobuf      3.13.0
psutil        5.7.2
setuptools    44.0.0
six           1.15.0
tensorboardX  1.8
torch         1.6.0
torchvision   0.7.0
tqdm          4.49.0
wheel         0.35.1

The install script throws the error message below:
removing build/bdist.linux-x86_64/wheel
/home/user/code/DeepSpeed
Installing apex locally so that deepspeed will build
Found existing installation: apex 0.1
Uninstalling apex-0.1:
  Successfully uninstalled apex-0.1
Non-user install because user site-packages disabled
Created temporary directory: /tmp/pip-ephem-wheel-cache-8wavy60a
Created temporary directory: /tmp/pip-req-tracker-a5l1t8ki
Initialized build tracking at /tmp/pip-req-tracker-a5l1t8ki
Created build tracker: /tmp/pip-req-tracker-a5l1t8ki
Entered build tracker: /tmp/pip-req-tracker-a5l1t8ki
Created temporary directory: /tmp/pip-install-tzd3lyjo
Processing ./third_party/apex/dist/apex-0.1-cp38-cp38-linux_x86_64.whl
  Added apex==0.1 from file:///home/user/code/DeepSpeed/third_party/apex/dist/apex-0.1-cp38-cp38-linux_x86_64.whl to build tracker '/tmp/pip-req-tracker-a5l1t8ki'
  Removed apex==0.1 from file:///home/user/code/DeepSpeed/third_party/apex/dist/apex-0.1-cp38-cp38-linux_x86_64.whl from build tracker '/tmp/pip-req-tracker-a5l1t8ki'
Installing collected packages: apex
  Created temporary directory: /tmp/pip-unpacked-wheel-rdepxzch

Successfully installed apex-0.1
Cleaning up...
Removed build tracker: '/tmp/pip-req-tracker-a5l1t8ki'
Building deepspeed wheel
./install.sh: line 196: 41599 Floating point exception(core dumped) python setup.py -v bdist_wheel
Error on line 195
Fail to install deepspeed

Hi @drfinkus, thanks for your detailed report. Is there other output from the build process you could capture and share? Our setup.py does several things, including building CUDA extensions. We'll need to narrow down where the issue is. I think some of the build outputs and errors are printed to STDERR.
You might also try disabling the extension building to do a python-only install. I'd be very curious if that works and would also help narrow down the issue. To do that, just prepend DS_BUILD_CUDA=0 to your installation command.

Same error, identified core dump as being caused by an import:
import cpufeature
Replicable via:
python -c "import cpufeature; cpufeature.print_features()"
Version:
Ubuntu 18.04
python --version
Python 3.6.10 :: Anaconda, Inc.
pip list | grep cpufeature
cpufeature             0.1.1

Here is the full log, as requested:
(env) user@desktop:~/code/DeepSpeed$ ./install.sh
Attempting to remove deepspeed/git_version_info_installed.py
Attempting to remove dist
Attempting to remove build
Attempting to remove deepspeed.egg-info
Attempting to remove third_party/apex/dist
Attempting to remove third_party/apex/build
Attempting to remove third_party/apex/apex.egg-info
No hostfile exists at /job/hostfile, installing locally
Non-user install because user site-packages disabled
Created temporary directory: /tmp/pip-ephem-wheel-cache-tsk9wsb0
Created temporary directory: /tmp/pip-req-tracker-ayv7e7xe
Initialized build tracking at /tmp/pip-req-tracker-ayv7e7xe
Created build tracker: /tmp/pip-req-tracker-ayv7e7xe
Entered build tracker: /tmp/pip-req-tracker-ayv7e7xe
Created temporary directory: /tmp/pip-install-y_l89l49
Requirement already satisfied: torch>=1.2 in ./env/lib/python3.8/site-packages (from -r requirements/requirements.txt (line 1)) (1.6.0)
Requirement already satisfied: torchvision>=0.4.0 in ./env/lib/python3.8/site-packages (from -r requirements/requirements.txt (line 2)) (0.7.0)
Requirement already satisfied: tqdm in ./env/lib/python3.8/site-packages (from -r requirements/requirements.txt (line 3)) (4.49.0)
Requirement already satisfied: psutil in ./env/lib/python3.8/site-packages (from -r requirements/requirements.txt (line 4)) (5.7.2)
Requirement already satisfied: cpufeature in ./env/lib/python3.8/site-packages (from -r requirements/requirements.txt (line 5)) (0.1.1)
Requirement already satisfied: tensorboardX==1.8 in ./env/lib/python3.8/site-packages (from -r requirements/requirements.txt (line 6)) (1.8)
Requirement already satisfied: future in ./env/lib/python3.8/site-packages (from torch>=1.2->-r requirements/requirements.txt (line 1)) (0.18.2)
Requirement already satisfied: numpy in ./env/lib/python3.8/site-packages (from torch>=1.2->-r requirements/requirements.txt (line 1)) (1.19.2)
Requirement already satisfied: pillow>=4.1.1 in ./env/lib/python3.8/site-packages (from torchvision>=0.4.0->-r requirements/requirements.txt (line 2)) (7.2.0)
Requirement already satisfied: six in ./env/lib/python3.8/site-packages (from tensorboardX==1.8->-r requirements/requirements.txt (line 6)) (1.15.0)
Requirement already satisfied: protobuf>=3.2.0 in ./env/lib/python3.8/site-packages (from tensorboardX==1.8->-r requirements/requirements.txt (line 6)) (3.13.0)
Requirement already satisfied: setuptools in ./env/lib/python3.8/site-packages (from protobuf>=3.2.0->tensorboardX==1.8->-r requirements/requirements.txt (line 6)) (44.0.0)
Cleaning up...
Removed build tracker: '/tmp/pip-req-tracker-ayv7e7xe'
Checking out sub-module(s)
Building apex wheel
torch.__version__  =  1.6.0
setup.py:43: UserWarning: Option --pyprof not specified. Not installing PyProf dependencies!
  warnings.warn("Option --pyprof not specified. Not installing PyProf dependencies!")

Compiling cuda extensions with
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2019 NVIDIA Corporation
Built on Wed_Oct_23_19:24:38_PDT_2019
Cuda compilation tools, release 10.2, V10.2.89
from /usr/local/cuda/bin

running bdist_wheel
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/utils/cpp_extension.py:335: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend.
  warnings.warn(msg.format('we could not find ninja.'))
running build
running build_py
creating build
creating build/lib.linux-x86_64-3.8
creating build/lib.linux-x86_64-3.8/apex
copying apex/__init__.py -> build/lib.linux-x86_64-3.8/apex
creating build/lib.linux-x86_64-3.8/apex/contrib
copying apex/contrib/__init__.py -> build/lib.linux-x86_64-3.8/apex/contrib
creating build/lib.linux-x86_64-3.8/apex/parallel
copying apex/parallel/LARC.py -> build/lib.linux-x86_64-3.8/apex/parallel
copying apex/parallel/distributed.py -> build/lib.linux-x86_64-3.8/apex/parallel
copying apex/parallel/__init__.py -> build/lib.linux-x86_64-3.8/apex/parallel
copying apex/parallel/optimized_sync_batchnorm.py -> build/lib.linux-x86_64-3.8/apex/parallel
copying apex/parallel/sync_batchnorm.py -> build/lib.linux-x86_64-3.8/apex/parallel
copying apex/parallel/multiproc.py -> build/lib.linux-x86_64-3.8/apex/parallel
copying apex/parallel/optimized_sync_batchnorm_kernel.py -> build/lib.linux-x86_64-3.8/apex/parallel
copying apex/parallel/sync_batchnorm_kernel.py -> build/lib.linux-x86_64-3.8/apex/parallel
creating build/lib.linux-x86_64-3.8/apex/multi_tensor_apply
copying apex/multi_tensor_apply/__init__.py -> build/lib.linux-x86_64-3.8/apex/multi_tensor_apply
copying apex/multi_tensor_apply/multi_tensor_apply.py -> build/lib.linux-x86_64-3.8/apex/multi_tensor_apply
creating build/lib.linux-x86_64-3.8/apex/normalization
copying apex/normalization/fused_layer_norm.py -> build/lib.linux-x86_64-3.8/apex/normalization
copying apex/normalization/__init__.py -> build/lib.linux-x86_64-3.8/apex/normalization
creating build/lib.linux-x86_64-3.8/apex/optimizers
copying apex/optimizers/fused_lamb.py -> build/lib.linux-x86_64-3.8/apex/optimizers
copying apex/optimizers/fused_novograd.py -> build/lib.linux-x86_64-3.8/apex/optimizers
copying apex/optimizers/__init__.py -> build/lib.linux-x86_64-3.8/apex/optimizers
copying apex/optimizers/fused_sgd.py -> build/lib.linux-x86_64-3.8/apex/optimizers
copying apex/optimizers/fused_adam.py -> build/lib.linux-x86_64-3.8/apex/optimizers
creating build/lib.linux-x86_64-3.8/apex/pyprof
copying apex/pyprof/__init__.py -> build/lib.linux-x86_64-3.8/apex/pyprof
creating build/lib.linux-x86_64-3.8/apex/RNN
copying apex/RNN/cells.py -> build/lib.linux-x86_64-3.8/apex/RNN
copying apex/RNN/__init__.py -> build/lib.linux-x86_64-3.8/apex/RNN
copying apex/RNN/RNNBackend.py -> build/lib.linux-x86_64-3.8/apex/RNN
copying apex/RNN/models.py -> build/lib.linux-x86_64-3.8/apex/RNN
creating build/lib.linux-x86_64-3.8/apex/amp
copying apex/amp/utils.py -> build/lib.linux-x86_64-3.8/apex/amp
copying apex/amp/rnn_compat.py -> build/lib.linux-x86_64-3.8/apex/amp
copying apex/amp/frontend.py -> build/lib.linux-x86_64-3.8/apex/amp
copying apex/amp/_initialize.py -> build/lib.linux-x86_64-3.8/apex/amp
copying apex/amp/amp.py -> build/lib.linux-x86_64-3.8/apex/amp
copying apex/amp/_process_optimizer.py -> build/lib.linux-x86_64-3.8/apex/amp
copying apex/amp/opt.py -> build/lib.linux-x86_64-3.8/apex/amp
copying apex/amp/__init__.py -> build/lib.linux-x86_64-3.8/apex/amp
copying apex/amp/handle.py -> build/lib.linux-x86_64-3.8/apex/amp
copying apex/amp/scaler.py -> build/lib.linux-x86_64-3.8/apex/amp
copying apex/amp/__version__.py -> build/lib.linux-x86_64-3.8/apex/amp
copying apex/amp/compat.py -> build/lib.linux-x86_64-3.8/apex/amp
copying apex/amp/_amp_state.py -> build/lib.linux-x86_64-3.8/apex/amp
copying apex/amp/wrap.py -> build/lib.linux-x86_64-3.8/apex/amp
creating build/lib.linux-x86_64-3.8/apex/reparameterization
copying apex/reparameterization/reparameterization.py -> build/lib.linux-x86_64-3.8/apex/reparameterization
copying apex/reparameterization/__init__.py -> build/lib.linux-x86_64-3.8/apex/reparameterization
copying apex/reparameterization/weight_norm.py -> build/lib.linux-x86_64-3.8/apex/reparameterization
creating build/lib.linux-x86_64-3.8/apex/fp16_utils
copying apex/fp16_utils/__init__.py -> build/lib.linux-x86_64-3.8/apex/fp16_utils
copying apex/fp16_utils/loss_scaler.py -> build/lib.linux-x86_64-3.8/apex/fp16_utils
copying apex/fp16_utils/fp16_optimizer.py -> build/lib.linux-x86_64-3.8/apex/fp16_utils
copying apex/fp16_utils/fp16util.py -> build/lib.linux-x86_64-3.8/apex/fp16_utils
creating build/lib.linux-x86_64-3.8/apex/contrib/xentropy
copying apex/contrib/xentropy/__init__.py -> build/lib.linux-x86_64-3.8/apex/contrib/xentropy
copying apex/contrib/xentropy/softmax_xentropy.py -> build/lib.linux-x86_64-3.8/apex/contrib/xentropy
creating build/lib.linux-x86_64-3.8/apex/contrib/optimizers
copying apex/contrib/optimizers/__init__.py -> build/lib.linux-x86_64-3.8/apex/contrib/optimizers
copying apex/contrib/optimizers/fp16_optimizer.py -> build/lib.linux-x86_64-3.8/apex/contrib/optimizers
copying apex/contrib/optimizers/fused_sgd.py -> build/lib.linux-x86_64-3.8/apex/contrib/optimizers
copying apex/contrib/optimizers/fused_adam.py -> build/lib.linux-x86_64-3.8/apex/contrib/optimizers
creating build/lib.linux-x86_64-3.8/apex/contrib/groupbn
copying apex/contrib/groupbn/__init__.py -> build/lib.linux-x86_64-3.8/apex/contrib/groupbn
copying apex/contrib/groupbn/batch_norm.py -> build/lib.linux-x86_64-3.8/apex/contrib/groupbn
creating build/lib.linux-x86_64-3.8/apex/pyprof/nvtx
copying apex/pyprof/nvtx/__init__.py -> build/lib.linux-x86_64-3.8/apex/pyprof/nvtx
copying apex/pyprof/nvtx/nvmarker.py -> build/lib.linux-x86_64-3.8/apex/pyprof/nvtx
creating build/lib.linux-x86_64-3.8/apex/pyprof/parse
copying apex/pyprof/parse/nvvp.py -> build/lib.linux-x86_64-3.8/apex/pyprof/parse
copying apex/pyprof/parse/__main__.py -> build/lib.linux-x86_64-3.8/apex/pyprof/parse
copying apex/pyprof/parse/parse.py -> build/lib.linux-x86_64-3.8/apex/pyprof/parse
copying apex/pyprof/parse/__init__.py -> build/lib.linux-x86_64-3.8/apex/pyprof/parse
copying apex/pyprof/parse/db.py -> build/lib.linux-x86_64-3.8/apex/pyprof/parse
copying apex/pyprof/parse/kernel.py -> build/lib.linux-x86_64-3.8/apex/pyprof/parse
creating build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/loss.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/optim.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/output.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/misc.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/__main__.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/usage.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/index_slice_join_mutate.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/pointwise.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/blas.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/embedding.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/reduction.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/prof.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/utility.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/__init__.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/softmax.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/recurrentCell.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/randomSample.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/conv.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/data.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/pooling.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/activation.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/linear.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/normalization.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/base.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/dropout.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
copying apex/pyprof/prof/convert.py -> build/lib.linux-x86_64-3.8/apex/pyprof/prof
creating build/lib.linux-x86_64-3.8/apex/amp/lists
copying apex/amp/lists/torch_overrides.py -> build/lib.linux-x86_64-3.8/apex/amp/lists
copying apex/amp/lists/__init__.py -> build/lib.linux-x86_64-3.8/apex/amp/lists
copying apex/amp/lists/functional_overrides.py -> build/lib.linux-x86_64-3.8/apex/amp/lists
copying apex/amp/lists/tensor_overrides.py -> build/lib.linux-x86_64-3.8/apex/amp/lists
running build_ext
building 'apex_C' extension
creating build/temp.linux-x86_64-3.8
creating build/temp.linux-x86_64-3.8/csrc
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/TH -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/THC -I/home/user/code/DeepSpeed/env/include -I/usr/include/python3.8 -c csrc/flatten_unflatten.cpp -o build/temp.linux-x86_64-3.8/csrc/flatten_unflatten.o -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=apex_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Parallel.h:149,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/utils.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/nn/cloneable.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/nn.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:7,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/flatten_unflatten.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ParallelOpenMP.h:84: warning: ignoring #pragma omp parallel [-Wunknown-pragmas]
   84 | #pragma omp parallel for if ((end - begin) >= grain_size)
      |
In file included from csrc/flatten_unflatten.cpp:2:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/utils/tensor_flatten.h: In member function ‘at::DeprecatedTypeProperties& torch::utils::TensorGroup::type()’:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/utils/tensor_flatten.h:36:28: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
   36 |     return tensors[0].type();
      |                            ^
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/flatten_unflatten.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:268:30: note: declared here
  268 |   DeprecatedTypeProperties & type() const {
      |                              ^~~~
x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.8/csrc/flatten_unflatten.o -L/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/lib -lc10 -ltorch -ltorch_cpu -ltorch_python -o build/lib.linux-x86_64-3.8/apex_C.cpython-38-x86_64-linux-gnu.so
building 'amp_C' extension
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/TH -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/user/code/DeepSpeed/env/include -I/usr/include/python3.8 -c csrc/amp_C_frontend.cpp -o build/temp.linux-x86_64-3.8/csrc/amp_C_frontend.o -O3 -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Parallel.h:149,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/utils.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/nn/cloneable.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/nn.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:7,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/amp_C_frontend.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ParallelOpenMP.h:84: warning: ignoring #pragma omp parallel [-Wunknown-pragmas]
   84 | #pragma omp parallel for if ((end - begin) >= grain_size)
      |
/usr/local/cuda/bin/nvcc -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/TH -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/user/code/DeepSpeed/env/include -I/usr/include/python3.8 -c csrc/multi_tensor_sgd_kernel.cu -o build/temp.linux-x86_64-3.8/csrc/multi_tensor_sgd_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_61,code=sm_61 -std=c++14
/usr/local/cuda/bin/nvcc -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/TH -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/user/code/DeepSpeed/env/include -I/usr/include/python3.8 -c csrc/multi_tensor_scale_kernel.cu -o build/temp.linux-x86_64-3.8/csrc/multi_tensor_scale_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_61,code=sm_61 -std=c++14
/usr/local/cuda/bin/nvcc -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/TH -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/user/code/DeepSpeed/env/include -I/usr/include/python3.8 -c csrc/multi_tensor_axpby_kernel.cu -o build/temp.linux-x86_64-3.8/csrc/multi_tensor_axpby_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_61,code=sm_61 -std=c++14
/usr/local/cuda/bin/nvcc -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/TH -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/user/code/DeepSpeed/env/include -I/usr/include/python3.8 -c csrc/multi_tensor_l2norm_kernel.cu -o build/temp.linux-x86_64-3.8/csrc/multi_tensor_l2norm_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_61,code=sm_61 -std=c++14
/usr/local/cuda/bin/nvcc -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/TH -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/user/code/DeepSpeed/env/include -I/usr/include/python3.8 -c csrc/multi_tensor_lamb_stage_1.cu -o build/temp.linux-x86_64-3.8/csrc/multi_tensor_lamb_stage_1.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_61,code=sm_61 -std=c++14
/usr/local/cuda/bin/nvcc -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/TH -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/user/code/DeepSpeed/env/include -I/usr/include/python3.8 -c csrc/multi_tensor_lamb_stage_2.cu -o build/temp.linux-x86_64-3.8/csrc/multi_tensor_lamb_stage_2.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_61,code=sm_61 -std=c++14
/usr/local/cuda/bin/nvcc -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/TH -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/user/code/DeepSpeed/env/include -I/usr/include/python3.8 -c csrc/multi_tensor_adam.cu -o build/temp.linux-x86_64-3.8/csrc/multi_tensor_adam.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_61,code=sm_61 -std=c++14
/usr/local/cuda/bin/nvcc -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/TH -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/user/code/DeepSpeed/env/include -I/usr/include/python3.8 -c csrc/multi_tensor_novograd.cu -o build/temp.linux-x86_64-3.8/csrc/multi_tensor_novograd.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_61,code=sm_61 -std=c++14
/usr/local/cuda/bin/nvcc -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/TH -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/user/code/DeepSpeed/env/include -I/usr/include/python3.8 -c csrc/multi_tensor_lamb.cu -o build/temp.linux-x86_64-3.8/csrc/multi_tensor_lamb.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_61,code=sm_61 -std=c++14
x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.8/csrc/amp_C_frontend.o build/temp.linux-x86_64-3.8/csrc/multi_tensor_sgd_kernel.o build/temp.linux-x86_64-3.8/csrc/multi_tensor_scale_kernel.o build/temp.linux-x86_64-3.8/csrc/multi_tensor_axpby_kernel.o build/temp.linux-x86_64-3.8/csrc/multi_tensor_l2norm_kernel.o build/temp.linux-x86_64-3.8/csrc/multi_tensor_lamb_stage_1.o build/temp.linux-x86_64-3.8/csrc/multi_tensor_lamb_stage_2.o build/temp.linux-x86_64-3.8/csrc/multi_tensor_adam.o build/temp.linux-x86_64-3.8/csrc/multi_tensor_novograd.o build/temp.linux-x86_64-3.8/csrc/multi_tensor_lamb.o -L/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/lib -L/usr/local/cuda/lib64 -lc10 -ltorch -ltorch_cpu -ltorch_python -lcudart -lc10_cuda -ltorch_cuda -o build/lib.linux-x86_64-3.8/amp_C.cpython-38-x86_64-linux-gnu.so
building 'syncbn' extension
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/TH -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/user/code/DeepSpeed/env/include -I/usr/include/python3.8 -c csrc/syncbn.cpp -o build/temp.linux-x86_64-3.8/csrc/syncbn.o -O3 -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=syncbn -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Parallel.h:149,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/utils.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/nn/cloneable.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/nn.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:7,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/syncbn.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ParallelOpenMP.h:84: warning: ignoring #pragma omp parallel [-Wunknown-pragmas]
   84 | #pragma omp parallel for if ((end - begin) >= grain_size)
      |
/usr/local/cuda/bin/nvcc -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/TH -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/user/code/DeepSpeed/env/include -I/usr/include/python3.8 -c csrc/welford.cu -o build/temp.linux-x86_64-3.8/csrc/welford.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -O3 -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=syncbn -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_61,code=sm_61 -std=c++14
x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.8/csrc/syncbn.o build/temp.linux-x86_64-3.8/csrc/welford.o -L/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/lib -L/usr/local/cuda/lib64 -lc10 -ltorch -ltorch_cpu -ltorch_python -lcudart -lc10_cuda -ltorch_cuda -o build/lib.linux-x86_64-3.8/syncbn.cpython-38-x86_64-linux-gnu.so
building 'fused_layer_norm_cuda' extension
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/TH -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/user/code/DeepSpeed/env/include -I/usr/include/python3.8 -c csrc/layer_norm_cuda.cpp -o build/temp.linux-x86_64-3.8/csrc/layer_norm_cuda.o -O3 -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=fused_layer_norm_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Parallel.h:149,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/utils.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/nn/cloneable.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/nn.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:7,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ParallelOpenMP.h:84: warning: ignoring #pragma omp parallel [-Wunknown-pragmas]
   84 | #pragma omp parallel for if ((end - begin) >= grain_size)
      |
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
csrc/layer_norm_cuda.cpp: In function ‘std::vector<at::Tensor> layer_norm(at::Tensor, c10::IntArrayRef, double)’:
csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                                          ^
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:146:65: note: in definition of macro ‘C10_UNLIKELY’
  146 | #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
      |                                                                 ^~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:330:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
  330 |   if (C10_UNLIKELY_OR_CONST(!(cond))) {                               \
      |       ^~~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:318:3: note: in expansion of macro ‘TORCH_CHECK_WITH_MSG’
  318 |   TORCH_CHECK_WITH_MSG(error_t, cond, "", __VA_ARGS__)
      |   ^~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:341:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
  341 | #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
      |                                ^~~~~~~~~~~~~~~~
csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                       ^~~~~~~~~~~
csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
  119 | #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
      |                        ^~~~~~~~~~
csrc/layer_norm_cuda.cpp:129:3: note: in expansion of macro ‘CHECK_INPUT’
  129 |   CHECK_INPUT(input);
      |   ^~~~~~~~~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:268:30: note: declared here
  268 |   DeprecatedTypeProperties & type() const {
      |                              ^~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
csrc/layer_norm_cuda.cpp: In function ‘std::vector<at::Tensor> layer_norm_affine(at::Tensor, c10::IntArrayRef, at::Tensor, at::Tensor, double)’:
csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                                          ^
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:146:65: note: in definition of macro ‘C10_UNLIKELY’
  146 | #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
      |                                                                 ^~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:330:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
  330 |   if (C10_UNLIKELY_OR_CONST(!(cond))) {                               \
      |       ^~~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:318:3: note: in expansion of macro ‘TORCH_CHECK_WITH_MSG’
  318 |   TORCH_CHECK_WITH_MSG(error_t, cond, "", __VA_ARGS__)
      |   ^~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:341:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
  341 | #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
      |                                ^~~~~~~~~~~~~~~~
csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                       ^~~~~~~~~~~
csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
  119 | #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
      |                        ^~~~~~~~~~
csrc/layer_norm_cuda.cpp:149:3: note: in expansion of macro ‘CHECK_INPUT’
  149 |   CHECK_INPUT(input);
      |   ^~~~~~~~~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:268:30: note: declared here
  268 |   DeprecatedTypeProperties & type() const {
      |                              ^~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                                          ^
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:146:65: note: in definition of macro ‘C10_UNLIKELY’
  146 | #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
      |                                                                 ^~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:330:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
  330 |   if (C10_UNLIKELY_OR_CONST(!(cond))) {                               \
      |       ^~~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:318:3: note: in expansion of macro ‘TORCH_CHECK_WITH_MSG’
  318 |   TORCH_CHECK_WITH_MSG(error_t, cond, "", __VA_ARGS__)
      |   ^~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:341:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
  341 | #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
      |                                ^~~~~~~~~~~~~~~~
csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                       ^~~~~~~~~~~
csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
  119 | #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
      |                        ^~~~~~~~~~
csrc/layer_norm_cuda.cpp:150:3: note: in expansion of macro ‘CHECK_INPUT’
  150 |   CHECK_INPUT(gamma);
      |   ^~~~~~~~~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:268:30: note: declared here
  268 |   DeprecatedTypeProperties & type() const {
      |                              ^~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                                          ^
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:146:65: note: in definition of macro ‘C10_UNLIKELY’
  146 | #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
      |                                                                 ^~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:330:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
  330 |   if (C10_UNLIKELY_OR_CONST(!(cond))) {                               \
      |       ^~~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:318:3: note: in expansion of macro ‘TORCH_CHECK_WITH_MSG’
  318 |   TORCH_CHECK_WITH_MSG(error_t, cond, "", __VA_ARGS__)
      |   ^~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:341:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
  341 | #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
      |                                ^~~~~~~~~~~~~~~~
csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                       ^~~~~~~~~~~
csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
  119 | #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
      |                        ^~~~~~~~~~
csrc/layer_norm_cuda.cpp:151:3: note: in expansion of macro ‘CHECK_INPUT’
  151 |   CHECK_INPUT(beta);
      |   ^~~~~~~~~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:268:30: note: declared here
  268 |   DeprecatedTypeProperties & type() const {
      |                              ^~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
csrc/layer_norm_cuda.cpp: In function ‘at::Tensor layer_norm_gradient(at::Tensor, at::Tensor, at::Tensor, at::Tensor, c10::IntArrayRef, double)’:
csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                                          ^
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:146:65: note: in definition of macro ‘C10_UNLIKELY’
  146 | #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
      |                                                                 ^~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:330:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
  330 |   if (C10_UNLIKELY_OR_CONST(!(cond))) {                               \
      |       ^~~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:318:3: note: in expansion of macro ‘TORCH_CHECK_WITH_MSG’
  318 |   TORCH_CHECK_WITH_MSG(error_t, cond, "", __VA_ARGS__)
      |   ^~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:341:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
  341 | #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
      |                                ^~~~~~~~~~~~~~~~
csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                       ^~~~~~~~~~~
csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
  119 | #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
      |                        ^~~~~~~~~~
csrc/layer_norm_cuda.cpp:193:3: note: in expansion of macro ‘CHECK_INPUT’
  193 |   CHECK_INPUT(dout);
      |   ^~~~~~~~~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:268:30: note: declared here
  268 |   DeprecatedTypeProperties & type() const {
      |                              ^~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                                          ^
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:146:65: note: in definition of macro ‘C10_UNLIKELY’
  146 | #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
      |                                                                 ^~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:330:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
  330 |   if (C10_UNLIKELY_OR_CONST(!(cond))) {                               \
      |       ^~~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:318:3: note: in expansion of macro ‘TORCH_CHECK_WITH_MSG’
  318 |   TORCH_CHECK_WITH_MSG(error_t, cond, "", __VA_ARGS__)
      |   ^~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:341:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
  341 | #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
      |                                ^~~~~~~~~~~~~~~~
csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                       ^~~~~~~~~~~
csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
  119 | #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
      |                        ^~~~~~~~~~
csrc/layer_norm_cuda.cpp:194:3: note: in expansion of macro ‘CHECK_INPUT’
  194 |   CHECK_INPUT(mean);
      |   ^~~~~~~~~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:268:30: note: declared here
  268 |   DeprecatedTypeProperties & type() const {
      |                              ^~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                                          ^
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:146:65: note: in definition of macro ‘C10_UNLIKELY’
  146 | #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
      |                                                                 ^~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:330:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
  330 |   if (C10_UNLIKELY_OR_CONST(!(cond))) {                               \
      |       ^~~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:318:3: note: in expansion of macro ‘TORCH_CHECK_WITH_MSG’
  318 |   TORCH_CHECK_WITH_MSG(error_t, cond, "", __VA_ARGS__)
      |   ^~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:341:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
  341 | #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
      |                                ^~~~~~~~~~~~~~~~
csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                       ^~~~~~~~~~~
csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
  119 | #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
      |                        ^~~~~~~~~~
csrc/layer_norm_cuda.cpp:195:3: note: in expansion of macro ‘CHECK_INPUT’
  195 |   CHECK_INPUT(invvar);
      |   ^~~~~~~~~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:268:30: note: declared here
  268 |   DeprecatedTypeProperties & type() const {
      |                              ^~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                                          ^
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:146:65: note: in definition of macro ‘C10_UNLIKELY’
  146 | #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
      |                                                                 ^~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:330:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
  330 |   if (C10_UNLIKELY_OR_CONST(!(cond))) {                               \
      |       ^~~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:318:3: note: in expansion of macro ‘TORCH_CHECK_WITH_MSG’
  318 |   TORCH_CHECK_WITH_MSG(error_t, cond, "", __VA_ARGS__)
      |   ^~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:341:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
  341 | #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
      |                                ^~~~~~~~~~~~~~~~
csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                       ^~~~~~~~~~~
csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
  119 | #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
      |                        ^~~~~~~~~~
csrc/layer_norm_cuda.cpp:196:3: note: in expansion of macro ‘CHECK_INPUT’
  196 |   CHECK_INPUT(input);
      |   ^~~~~~~~~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:268:30: note: declared here
  268 |   DeprecatedTypeProperties & type() const {
      |                              ^~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
csrc/layer_norm_cuda.cpp: In function ‘std::vector<at::Tensor> layer_norm_gradient_affine(at::Tensor, at::Tensor, at::Tensor, at::Tensor, c10::IntArrayRef, at::Tensor, at::Tensor, double)’:
csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                                          ^
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:146:65: note: in definition of macro ‘C10_UNLIKELY’
  146 | #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
      |                                                                 ^~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:330:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
  330 |   if (C10_UNLIKELY_OR_CONST(!(cond))) {                               \
      |       ^~~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:318:3: note: in expansion of macro ‘TORCH_CHECK_WITH_MSG’
  318 |   TORCH_CHECK_WITH_MSG(error_t, cond, "", __VA_ARGS__)
      |   ^~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:341:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
  341 | #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
      |                                ^~~~~~~~~~~~~~~~
csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                       ^~~~~~~~~~~
csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
  119 | #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
      |                        ^~~~~~~~~~
csrc/layer_norm_cuda.cpp:218:3: note: in expansion of macro ‘CHECK_INPUT’
  218 |   CHECK_INPUT(dout);
      |   ^~~~~~~~~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:268:30: note: declared here
  268 |   DeprecatedTypeProperties & type() const {
      |                              ^~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                                          ^
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:146:65: note: in definition of macro ‘C10_UNLIKELY’
  146 | #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
      |                                                                 ^~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:330:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
  330 |   if (C10_UNLIKELY_OR_CONST(!(cond))) {                               \
      |       ^~~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:318:3: note: in expansion of macro ‘TORCH_CHECK_WITH_MSG’
  318 |   TORCH_CHECK_WITH_MSG(error_t, cond, "", __VA_ARGS__)
      |   ^~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:341:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
  341 | #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
      |                                ^~~~~~~~~~~~~~~~
csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                       ^~~~~~~~~~~
csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
  119 | #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
      |                        ^~~~~~~~~~
csrc/layer_norm_cuda.cpp:219:3: note: in expansion of macro ‘CHECK_INPUT’
  219 |   CHECK_INPUT(mean);
      |   ^~~~~~~~~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:268:30: note: declared here
  268 |   DeprecatedTypeProperties & type() const {
      |                              ^~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                                          ^
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:146:65: note: in definition of macro ‘C10_UNLIKELY’
  146 | #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
      |                                                                 ^~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:330:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
  330 |   if (C10_UNLIKELY_OR_CONST(!(cond))) {                               \
      |       ^~~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:318:3: note: in expansion of macro ‘TORCH_CHECK_WITH_MSG’
  318 |   TORCH_CHECK_WITH_MSG(error_t, cond, "", __VA_ARGS__)
      |   ^~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:341:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
  341 | #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
      |                                ^~~~~~~~~~~~~~~~
csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                       ^~~~~~~~~~~
csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
  119 | #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
      |                        ^~~~~~~~~~
csrc/layer_norm_cuda.cpp:220:3: note: in expansion of macro ‘CHECK_INPUT’
  220 |   CHECK_INPUT(invvar);
      |   ^~~~~~~~~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:268:30: note: declared here
  268 |   DeprecatedTypeProperties & type() const {
      |                              ^~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                                          ^
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:146:65: note: in definition of macro ‘C10_UNLIKELY’
  146 | #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
      |                                                                 ^~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:330:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
  330 |   if (C10_UNLIKELY_OR_CONST(!(cond))) {                               \
      |       ^~~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:318:3: note: in expansion of macro ‘TORCH_CHECK_WITH_MSG’
  318 |   TORCH_CHECK_WITH_MSG(error_t, cond, "", __VA_ARGS__)
      |   ^~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:341:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
  341 | #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
      |                                ^~~~~~~~~~~~~~~~
csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                       ^~~~~~~~~~~
csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
  119 | #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
      |                        ^~~~~~~~~~
csrc/layer_norm_cuda.cpp:221:3: note: in expansion of macro ‘CHECK_INPUT’
  221 |   CHECK_INPUT(input);
      |   ^~~~~~~~~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:268:30: note: declared here
  268 |   DeprecatedTypeProperties & type() const {
      |                              ^~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                                          ^
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:146:65: note: in definition of macro ‘C10_UNLIKELY’
  146 | #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
      |                                                                 ^~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:330:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
  330 |   if (C10_UNLIKELY_OR_CONST(!(cond))) {                               \
      |       ^~~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:318:3: note: in expansion of macro ‘TORCH_CHECK_WITH_MSG’
  318 |   TORCH_CHECK_WITH_MSG(error_t, cond, "", __VA_ARGS__)
      |   ^~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:341:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
  341 | #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
      |                                ^~~~~~~~~~~~~~~~
csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                       ^~~~~~~~~~~
csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
  119 | #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
      |                        ^~~~~~~~~~
csrc/layer_norm_cuda.cpp:222:3: note: in expansion of macro ‘CHECK_INPUT’
  222 |   CHECK_INPUT(gamma);
      |   ^~~~~~~~~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:268:30: note: declared here
  268 |   DeprecatedTypeProperties & type() const {
      |                              ^~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                                          ^
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:146:65: note: in definition of macro ‘C10_UNLIKELY’
  146 | #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
      |                                                                 ^~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:330:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
  330 |   if (C10_UNLIKELY_OR_CONST(!(cond))) {                               \
      |       ^~~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:318:3: note: in expansion of macro ‘TORCH_CHECK_WITH_MSG’
  318 |   TORCH_CHECK_WITH_MSG(error_t, cond, "", __VA_ARGS__)
      |   ^~~~~~~~~~~~~~~~~~~~
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:341:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
  341 | #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
      |                                ^~~~~~~~~~~~~~~~
csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
  117 | #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
      |                       ^~~~~~~~~~~
csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
  119 | #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
      |                        ^~~~~~~~~~
csrc/layer_norm_cuda.cpp:223:3: note: in expansion of macro ‘CHECK_INPUT’
  223 |   CHECK_INPUT(beta);
      |   ^~~~~~~~~~~
In file included from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/ATen.h:5,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                 from /home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
                 from csrc/layer_norm_cuda.cpp:1:
/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:268:30: note: declared here
  268 |   DeprecatedTypeProperties & type() const {
      |                              ^~~~
/usr/local/cuda/bin/nvcc -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/TH -I/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/user/code/DeepSpeed/env/include -I/usr/include/python3.8 -c csrc/layer_norm_cuda_kernel.cu -o build/temp.linux-x86_64-3.8/csrc/layer_norm_cuda_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -maxrregcount=50 -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=fused_layer_norm_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_61,code=sm_61 -std=c++14
x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.8/csrc/layer_norm_cuda.o build/temp.linux-x86_64-3.8/csrc/layer_norm_cuda_kernel.o -L/home/user/code/DeepSpeed/env/lib/python3.8/site-packages/torch/lib -L/usr/local/cuda/lib64 -lc10 -ltorch -ltorch_cpu -ltorch_python -lcudart -lc10_cuda -ltorch_cuda -o build/lib.linux-x86_64-3.8/fused_layer_norm_cuda.cpython-38-x86_64-linux-gnu.so
installing to build/bdist.linux-x86_64/wheel
running install
running install_lib
creating build/bdist.linux-x86_64
creating build/bdist.linux-x86_64/wheel
copying build/lib.linux-x86_64-3.8/amp_C.cpython-38-x86_64-linux-gnu.so -> build/bdist.linux-x86_64/wheel
copying build/lib.linux-x86_64-3.8/fused_layer_norm_cuda.cpython-38-x86_64-linux-gnu.so -> build/bdist.linux-x86_64/wheel
copying build/lib.linux-x86_64-3.8/syncbn.cpython-38-x86_64-linux-gnu.so -> build/bdist.linux-x86_64/wheel
creating build/bdist.linux-x86_64/wheel/apex
creating build/bdist.linux-x86_64/wheel/apex/contrib
creating build/bdist.linux-x86_64/wheel/apex/contrib/xentropy
copying build/lib.linux-x86_64-3.8/apex/contrib/xentropy/__init__.py -> build/bdist.linux-x86_64/wheel/apex/contrib/xentropy
copying build/lib.linux-x86_64-3.8/apex/contrib/xentropy/softmax_xentropy.py -> build/bdist.linux-x86_64/wheel/apex/contrib/xentropy
creating build/bdist.linux-x86_64/wheel/apex/contrib/optimizers
copying build/lib.linux-x86_64-3.8/apex/contrib/optimizers/__init__.py -> build/bdist.linux-x86_64/wheel/apex/contrib/optimizers
copying build/lib.linux-x86_64-3.8/apex/contrib/optimizers/fp16_optimizer.py -> build/bdist.linux-x86_64/wheel/apex/contrib/optimizers
copying build/lib.linux-x86_64-3.8/apex/contrib/optimizers/fused_sgd.py -> build/bdist.linux-x86_64/wheel/apex/contrib/optimizers
copying build/lib.linux-x86_64-3.8/apex/contrib/optimizers/fused_adam.py -> build/bdist.linux-x86_64/wheel/apex/contrib/optimizers
copying build/lib.linux-x86_64-3.8/apex/contrib/__init__.py -> build/bdist.linux-x86_64/wheel/apex/contrib
creating build/bdist.linux-x86_64/wheel/apex/contrib/groupbn
copying build/lib.linux-x86_64-3.8/apex/contrib/groupbn/__init__.py -> build/bdist.linux-x86_64/wheel/apex/contrib/groupbn
copying build/lib.linux-x86_64-3.8/apex/contrib/groupbn/batch_norm.py -> build/bdist.linux-x86_64/wheel/apex/contrib/groupbn
creating build/bdist.linux-x86_64/wheel/apex/parallel
copying build/lib.linux-x86_64-3.8/apex/parallel/LARC.py -> build/bdist.linux-x86_64/wheel/apex/parallel
copying build/lib.linux-x86_64-3.8/apex/parallel/distributed.py -> build/bdist.linux-x86_64/wheel/apex/parallel
copying build/lib.linux-x86_64-3.8/apex/parallel/__init__.py -> build/bdist.linux-x86_64/wheel/apex/parallel
copying build/lib.linux-x86_64-3.8/apex/parallel/optimized_sync_batchnorm.py -> build/bdist.linux-x86_64/wheel/apex/parallel
copying build/lib.linux-x86_64-3.8/apex/parallel/sync_batchnorm.py -> build/bdist.linux-x86_64/wheel/apex/parallel
copying build/lib.linux-x86_64-3.8/apex/parallel/multiproc.py -> build/bdist.linux-x86_64/wheel/apex/parallel
copying build/lib.linux-x86_64-3.8/apex/parallel/optimized_sync_batchnorm_kernel.py -> build/bdist.linux-x86_64/wheel/apex/parallel
copying build/lib.linux-x86_64-3.8/apex/parallel/sync_batchnorm_kernel.py -> build/bdist.linux-x86_64/wheel/apex/parallel
creating build/bdist.linux-x86_64/wheel/apex/multi_tensor_apply
copying build/lib.linux-x86_64-3.8/apex/multi_tensor_apply/__init__.py -> build/bdist.linux-x86_64/wheel/apex/multi_tensor_apply
copying build/lib.linux-x86_64-3.8/apex/multi_tensor_apply/multi_tensor_apply.py -> build/bdist.linux-x86_64/wheel/apex/multi_tensor_apply
creating build/bdist.linux-x86_64/wheel/apex/normalization
copying build/lib.linux-x86_64-3.8/apex/normalization/fused_layer_norm.py -> build/bdist.linux-x86_64/wheel/apex/normalization
copying build/lib.linux-x86_64-3.8/apex/normalization/__init__.py -> build/bdist.linux-x86_64/wheel/apex/normalization
creating build/bdist.linux-x86_64/wheel/apex/optimizers
copying build/lib.linux-x86_64-3.8/apex/optimizers/fused_lamb.py -> build/bdist.linux-x86_64/wheel/apex/optimizers
copying build/lib.linux-x86_64-3.8/apex/optimizers/fused_novograd.py -> build/bdist.linux-x86_64/wheel/apex/optimizers
copying build/lib.linux-x86_64-3.8/apex/optimizers/__init__.py -> build/bdist.linux-x86_64/wheel/apex/optimizers
copying build/lib.linux-x86_64-3.8/apex/optimizers/fused_sgd.py -> build/bdist.linux-x86_64/wheel/apex/optimizers
copying build/lib.linux-x86_64-3.8/apex/optimizers/fused_adam.py -> build/bdist.linux-x86_64/wheel/apex/optimizers
creating build/bdist.linux-x86_64/wheel/apex/pyprof
creating build/bdist.linux-x86_64/wheel/apex/pyprof/nvtx
copying build/lib.linux-x86_64-3.8/apex/pyprof/nvtx/__init__.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/nvtx
copying build/lib.linux-x86_64-3.8/apex/pyprof/nvtx/nvmarker.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/nvtx
copying build/lib.linux-x86_64-3.8/apex/pyprof/__init__.py -> build/bdist.linux-x86_64/wheel/apex/pyprof
creating build/bdist.linux-x86_64/wheel/apex/pyprof/parse
copying build/lib.linux-x86_64-3.8/apex/pyprof/parse/nvvp.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/parse
copying build/lib.linux-x86_64-3.8/apex/pyprof/parse/__main__.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/parse
copying build/lib.linux-x86_64-3.8/apex/pyprof/parse/parse.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/parse
copying build/lib.linux-x86_64-3.8/apex/pyprof/parse/__init__.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/parse
copying build/lib.linux-x86_64-3.8/apex/pyprof/parse/db.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/parse
copying build/lib.linux-x86_64-3.8/apex/pyprof/parse/kernel.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/parse
creating build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/loss.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/optim.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/output.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/misc.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/__main__.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/usage.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/index_slice_join_mutate.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/pointwise.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/blas.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/embedding.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/reduction.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/prof.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/utility.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/__init__.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/softmax.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/recurrentCell.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/randomSample.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/conv.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/data.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/pooling.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/activation.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/linear.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/normalization.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/base.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/dropout.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/pyprof/prof/convert.py -> build/bdist.linux-x86_64/wheel/apex/pyprof/prof
copying build/lib.linux-x86_64-3.8/apex/__init__.py -> build/bdist.linux-x86_64/wheel/apex
creating build/bdist.linux-x86_64/wheel/apex/RNN
copying build/lib.linux-x86_64-3.8/apex/RNN/cells.py -> build/bdist.linux-x86_64/wheel/apex/RNN
copying build/lib.linux-x86_64-3.8/apex/RNN/__init__.py -> build/bdist.linux-x86_64/wheel/apex/RNN
copying build/lib.linux-x86_64-3.8/apex/RNN/RNNBackend.py -> build/bdist.linux-x86_64/wheel/apex/RNN
copying build/lib.linux-x86_64-3.8/apex/RNN/models.py -> build/bdist.linux-x86_64/wheel/apex/RNN
creating build/bdist.linux-x86_64/wheel/apex/amp
copying build/lib.linux-x86_64-3.8/apex/amp/utils.py -> build/bdist.linux-x86_64/wheel/apex/amp
copying build/lib.linux-x86_64-3.8/apex/amp/rnn_compat.py -> build/bdist.linux-x86_64/wheel/apex/amp
copying build/lib.linux-x86_64-3.8/apex/amp/frontend.py -> build/bdist.linux-x86_64/wheel/apex/amp
copying build/lib.linux-x86_64-3.8/apex/amp/_initialize.py -> build/bdist.linux-x86_64/wheel/apex/amp
copying build/lib.linux-x86_64-3.8/apex/amp/amp.py -> build/bdist.linux-x86_64/wheel/apex/amp
copying build/lib.linux-x86_64-3.8/apex/amp/_process_optimizer.py -> build/bdist.linux-x86_64/wheel/apex/amp
copying build/lib.linux-x86_64-3.8/apex/amp/opt.py -> build/bdist.linux-x86_64/wheel/apex/amp
copying build/lib.linux-x86_64-3.8/apex/amp/__init__.py -> build/bdist.linux-x86_64/wheel/apex/amp
copying build/lib.linux-x86_64-3.8/apex/amp/handle.py -> build/bdist.linux-x86_64/wheel/apex/amp
copying build/lib.linux-x86_64-3.8/apex/amp/scaler.py -> build/bdist.linux-x86_64/wheel/apex/amp
copying build/lib.linux-x86_64-3.8/apex/amp/__version__.py -> build/bdist.linux-x86_64/wheel/apex/amp
copying build/lib.linux-x86_64-3.8/apex/amp/compat.py -> build/bdist.linux-x86_64/wheel/apex/amp
copying build/lib.linux-x86_64-3.8/apex/amp/_amp_state.py -> build/bdist.linux-x86_64/wheel/apex/amp
creating build/bdist.linux-x86_64/wheel/apex/amp/lists
copying build/lib.linux-x86_64-3.8/apex/amp/lists/torch_overrides.py -> build/bdist.linux-x86_64/wheel/apex/amp/lists
copying build/lib.linux-x86_64-3.8/apex/amp/lists/__init__.py -> build/bdist.linux-x86_64/wheel/apex/amp/lists
copying build/lib.linux-x86_64-3.8/apex/amp/lists/functional_overrides.py -> build/bdist.linux-x86_64/wheel/apex/amp/lists
copying build/lib.linux-x86_64-3.8/apex/amp/lists/tensor_overrides.py -> build/bdist.linux-x86_64/wheel/apex/amp/lists
copying build/lib.linux-x86_64-3.8/apex/amp/wrap.py -> build/bdist.linux-x86_64/wheel/apex/amp
creating build/bdist.linux-x86_64/wheel/apex/reparameterization
copying build/lib.linux-x86_64-3.8/apex/reparameterization/reparameterization.py -> build/bdist.linux-x86_64/wheel/apex/reparameterization
copying build/lib.linux-x86_64-3.8/apex/reparameterization/__init__.py -> build/bdist.linux-x86_64/wheel/apex/reparameterization