KeyError: 'n_genes'

Hello, is there another step I'm missing? i was expecting qc_metrics to create an n_genes col in .obs
# Convert anndata and downsample cells
data = io.MultimodalData(adat[sample(range(adat.shape[0]), k=10000), :])
data.obs["Channel"] = data.obs.study

# Run QC
pg.qc_metrics(data, percent_mito=10)

Error message
Trying to set attribute `.obs` of view, copying.
---------------------------------------------------------------------------
KeyError                                  Traceback (most recent call last)
~/anaconda3/envs/pegasus/lib/python3.8/site-packages/pandas/core/indexes/base.py in get_loc(self, key, method, tolerance)
   3079             try:
-> 3080                 return self._engine.get_loc(casted_key)
   3081             except KeyError as err:

pandas/_libs/index.pyx in pandas._libs.index.IndexEngine.get_loc()

pandas/_libs/index.pyx in pandas._libs.index.IndexEngine.get_loc()

pandas/_libs/hashtable_class_helper.pxi in pandas._libs.hashtable.PyObjectHashTable.get_item()

pandas/_libs/hashtable_class_helper.pxi in pandas._libs.hashtable.PyObjectHashTable.get_item()

KeyError: 'n_genes'

The above exception was the direct cause of the following exception:

KeyError                                  Traceback (most recent call last)
<ipython-input-40-d6ddbdb7cebc> in <module>
----> 1 pg.qc_metrics(data, percent_mito=10)

~/anaconda3/envs/pegasus/lib/python3.8/site-packages/pegasus/tools/preprocessing.py in qc_metrics(data, select_singlets, remap_string, subset_string, min_genes, max_genes, min_umis, max_umis, mito_prefix, percent_mito)
     80         min_umis = 1
     81
---> 82     calc_qc_filters(data, select_singlets = select_singlets, remap_string = remap_string, subset_string = subset_string, min_genes = min_genes, max_genes = max_genes, min_umis = min_umis, max_umis = max_umis, mito_prefix = mito_prefix, percent_mito = percent_mito)
     83
     84

~/anaconda3/envs/pegasus/lib/python3.8/site-packages/pegasusio/qc_utils.py in calc_qc_filters(unidata, select_singlets, remap_string, subset_string, min_genes, max_genes, min_umis, max_umis, mito_prefix, percent_mito)
    121             unidata.obs["n_genes"] = unidata.X.getnnz(axis=1)
    122         if min_cond:
--> 123             filters.append(unidata.obs["n_genes"] >= min_genes)
    124         if max_cond:
    125             filters.append(unidata.obs["n_genes"] < max_genes)

~/anaconda3/envs/pegasus/lib/python3.8/site-packages/pandas/core/frame.py in __getitem__(self, key)
   3022             if self.columns.nlevels > 1:
   3023                 return self._getitem_multilevel(key)
-> 3024             indexer = self.columns.get_loc(key)
   3025             if is_integer(indexer):
   3026                 indexer = [indexer]

~/anaconda3/envs/pegasus/lib/python3.8/site-packages/pandas/core/indexes/base.py in get_loc(self, key, method, tolerance)
   3080                 return self._engine.get_loc(casted_key)
   3081             except KeyError as err:
-> 3082                 raise KeyError(key) from err
   3083
   3084         if tolerance is not None:

KeyError: 'n_genes'

Versions
print(pg.__version__)
print(ad.__version__)

1.2.0
0.7.6

Hello @bschilder , I was able to reproduce your error. This is because the MultimodalData object was created from a view of AnnData object, instead of the AnnData object itself. And in this case, even manually adding attributes to obs field would also fail.
As a quick fix, please add .copy() when converting:
data = io.MultimodalData(adat[sample(range(adat.shape[0]), k=10000).copy(), :])
data.obs["Channel"] = data.obs.study

# Run QC
pg.qc_metrics(data, percent_mito=10)

We'll think about if there is a better way of doing the conversion without causing this kind of issues. And once we come about a solution, we'll update the tutorial on 'PegasusIO' accordingly.

omg, yes that's absolutely it. that's such a simple thing, apologies for not realizing it sooner. though I'm kind of surprising io.MultimodalData() accepted theanndata View.

Yeah, this is a good idea to give users the warnings regarding this kind of situations. Thank you for your suggestion!


uavcan V1 compatible ?

If I understand gui_tool is for uavcan version 0 only.
If I am right I cannot find something about this in README file

Thank you, the README has been updated.


Implement Search UI

Beep boop: Automatically setting the following values for this issue because they were unset when the issue was closed in agilesix/1:\n- Set sprint to current sprint

Beep boop: Automatically setting the following values for this issue because they were unset when the issue was closed in agilesix/1:\n- Set sprint to current sprint

Beep boop: Automatically setting the following values for this issue because they were unset when the issue was closed in agilesix/18:\n- Set sprint to current sprint

Beep boop Automatically setting the following values for this issue because they were unset when the issue was closed in agilesix/18:\n- Set sprint to current sprint

Beep boop: Automatically setting the point and sprint values for this issue because they were unset when the issue was closed in agilesix/18.

Beep boop: Automatically setting the point and sprint values for this issue in project agilesix/18 because they were unset when the issue was closed.


Add Tutorial: Running a VM-style workload using Stateful Set

cc @bprashanth @erictune @foxish @kow3ns @enisoc @kubernetes/sig-apps

This change is

Is the main purpose of this tutorial to teach users how to run a VM-like workload? Or is it to demonstrate StatefulSet patterns? If it's the latter, I think there will be a lot of overlap with #1722 which uses the same patterns, but for MySQL.

@enisoc the main purpose of this tutorial is teaching users how Kubenetes + pods are different from VMs, based on http://kubernetes.io/docs/user-guide/petset/bootstrapping/, and deprecating the bootstrapping guide

OK in that case I'll try to minimize overlap in my tutorial.

I'm starting a writing review now.

See this commit for suggested changes.

Reviewed 7 of 8 files at r1, 2 of 2 files at r2, 1 of 1 files at r5.
Review status: all files reviewed at latest revision, 10 unresolved discussions, some commit checks failed.

_data/tutorials.yml, line 56 at r5 (raw file):

- title: Stateful Applications
  section:
  - title: Running a VM-style workload using Stateful Set

Merge StatefulSet into one word in title and URL.

docs/tutorials/stateful-application/vm-style-workload-using-stateful-set.md, line 29 at r5 (raw file):

* Learn about the runtime initialization of StatefulSets.

* Run a VM-style workload by using a StatefulSet and a Kubernetes a feature called

Remove extra "a" before "feature".

docs/tutorials/stateful-application/vm-style-workload-using-stateful-set.md, line 51 at r5 (raw file):

* Your Kubernetes cluster must be running Kubernetes version 1.5 or later.

* Familiarize yourself with the terminology in

Add "the" at the end.

docs/tutorials/stateful-application/vm-style-workload-using-stateful-set.md, line 73 at r5 (raw file):

To further simulate a VM, a Pod needs a way to initialize its user environment
when the the Pod starts. Also, tools like `kubectl exec` must not be allowed to

Double "the".

docs/tutorials/stateful-application/vm-style-workload-using-stateful-set.md, line 84 at r5 (raw file):

Instead of guaranteeing that containers will not be restarted, Kubernetes provides
a way to ensure that when a container stops and restarts, all of of the state

Double "of".

docs/tutorials/stateful-application/vm-style-workload-using-stateful-set.md, line 201 at r5 (raw file):

In this portion of the tutorial, you create a StatefulSet of nginx servers, and
you make one of them a master. The other nginx servers will proxy requests to
the master. See

Add "the" at the end.

docs/tutorials/stateful-application/vm-style-workload-using-stateful-set.md, line 315 at r5 (raw file):

* Write the config to a `hostPath` volume shared with the parent StatefulSet.

**Important:** In practice all Pods should query their peers for the current

We should elaborate on why this is important, especially since my replicated MySQL tutorial does the opposite. The difference is in this case you're allowing the master to change dynamically, whereas mine requires that the master is always index 0.

docs/tutorials/stateful-application/vm-style-workload-using-stateful-set.md, line 323 at r5 (raw file):

{% capture whatsnext %}

* You can deploy some example StatefulSets found

TODO: Add a link to Replicated Stateful Application tutorial.

Comments from Reviewable

Review status: all files reviewed at latest revision, 11 unresolved discussions, some commit checks failed.

docs/tutorials/stateful-application/statefulset_vm.yaml, line 36 at r5 (raw file):

                    "/bin/sh",
                    "-c",
                    "for d in usr lib etc; do cp -vnpr /$d/* /${d}mnt; done;"

The overall script should somehow exit with a non-zero error code if the whole process didn't succeed. You don't want to run the real workload if the initialization was incomplete. In Bash you can just add set -e at the beginning of the script. I'm not sure if that's guaranteed to work in whatever /bin/sh refers to.
In general, this approach of trying to merge in potential changes from the image (with cp --no-clobber) after the PVC has been initialized once before is dangerous. Suppose you let everything initialize, then delete a conf.d file that contains default login credentials. A subsequent Pod restart will restore that file, creating a vulnerability. This example also doesn't account for /var being lost between Pod reschedulings, which can cause data loss and other unexpected behavior.
At the least, we should warn that you shouldn't actually do this; it's just a toy example to demonstrate some concepts. A step further would be to do nothing at all if the PVC has ever been initialized before. That would at least be safer, although it means you should never change the image.
Personally my recommendation is to drop this tutorial altogether for now. If there are still concepts we want to teach that aren't covered in other tutorials, we should start over and rethink how to present them in a less misleading way. I suspect I'm in the minority in that so I'll defer to the wisdom of the team.

Comments from Reviewable

from @enisoc: Personally my recommendation is to drop this tutorial altogether for now.

@erictune @foxish @kow3ns thoughts?

To summarize: we discussed this offline and agreed to remove the VM-style tutorial for now because our other new StatefulSet tutorials cover the important concepts with use cases that have clearer motivations.
This PR will be repurposed to just point the old bootstrapping tutorial URL at new StatefulSet docs.

PR & title updated, PTAL

LGTM

I think we should absolutely add this note at the top of the documentation, but leave it where it is for now--it still applies to 1.4 users.

@devin-donnelly I think it would make sense to keep the doc if it was helping 1.4 users to maintain existing PetSets (like if it was a Task page describing how to do a manual rolling update), but to me the point of this particular doc is encouraging users to adopt PetSet for new use cases. Since PetSet is deprecated, our plan was to discourage against creating new PetSets and instead recommend upgrading to 1.5+ and using StatefulSets.

@enisoc I understand. The only users I feel like we might miss are those that don't want to risk upgrading off 1.4 but still want to use PetSet (despite it being Alpha). I don't know if there are a lot of those users out there; any insight?

@enisoc After a close reading, I strike my objection. Is there existing documentation that's a more basic "PetSet Guide" that needs to be marked as deprecated, however?

@janetkuo Would you like to squash commits before we merge this?

@devin-donnelly Yeah I think user-guide/petset fits your description for the basic guide that should probably be kept with just a deprecation warning at the top.

I didn't see a PR yet for the above so created https://github.com/kubernetes/kubernetes.github.io/pull/1874

I'll go ahead and merge this.


cascade order

Problem description:
I need to pass a className to a component that exposes a className prop. Based on some parent components state I'd like an icon to be visible or not visible. I could render two different components, but then I lose my native css transition.
const icon = css`
  opacity: 0;
  transition: opacity 0.1s ease-in-out;
`;

const iconVisible = css`
  opacity: 1;
`;

<Icon
  color={palette.primary}
  className={classNames({
    [icon]: true,
    [iconVisible]: !!this.state.value,
  })}
  onClick={this.onClear} />

Because of the way cascade order is determined, my opacity definition (opacity 1) is always overridden by the first definition.

Does anyone have any ideas about how to best handle this type of situation?

This assumes you are on version 7.
const transition = css`transition: opacity 0.1s ease-in-out;`

const icon = css`
  ${transition};
  opacity: 0;
`;

const iconVisible = css`
  ${transition};
  opacity: 1;
`;

css can also be dynamic.
const icon = css`
  opacity: ${!!this.state.value ? 1 : 0};
  transition: opacity 0.1s ease-in-out;
`;

Thanks @tkh44
I dropped the css declaration into the component and used the second method you provided and its working nice - thx. Using the first suggestion I still get the same issue where both classes have the same specificity but the class that I am adding dynamically is declared earlier in the generated stylesheet. As a result the class that is declared later in the stylesheet overrides the first.


Save file space by removing...

Removing the "https://www.youtube.com/watch?v=" and having the bot add it inside it's code could save file space to run the bot with less information in memory?
https://github.com/SexualRhinoceros/MusicBot/blob/develop/config/backuplist.txt

Irrelevant, since you can put things other than youtube videos in that list.


[soundtouch] build failure

Host Environment

OS: Windows 10 20H2 19042.685
Compiler: CMake 3.19.2
Vcpkg version: 2020.11.12-nohash

To Reproduce
Steps to reproduce the behavior:
vcpkg install soundtouch
Failure logs
[1/2] cmd /c "cd ../../x64-windows-dbg && "C:/Program Files/CMake/bin/cmake.exe" "F:/vcpkg-master/buildtrees/soundtouch/src/undtouch-2-ed25d761b4.clean" "-DCMAKE_MAKE_PROGRAM=F:/vcpkg-master/downloads/tools/ninja/1.10.1-windows/ninja.exe" "-DBUILD_SHARED_LIBS=ON" "-DVCPKG_CHAINLOAD_TOOLCHAIN_FILE=F:/vcpkg-master/scripts/toolchains/windows.cmake" "-DVCPKG_TARGET_TRIPLET=x64-windows" "-DVCPKG_SET_CHARSET_FLAG=ON" "-DVCPKG_PLATFORM_TOOLSET=v142" "-DCMAKE_EXPORT_NO_PACKAGE_REGISTRY=ON" "-DCMAKE_FIND_PACKAGE_NO_PACKAGE_REGISTRY=ON" "-DCMAKE_FIND_PACKAGE_NO_SYSTEM_PACKAGE_REGISTRY=ON" "-DCMAKE_INSTALL_SYSTEM_RUNTIME_LIBS_SKIP=TRUE" "-DCMAKE_VERBOSE_MAKEFILE=ON" "-DVCPKG_APPLOCAL_DEPS=OFF" "-DCMAKE_TOOLCHAIN_FILE=F:/vcpkg-master/scripts/buildsystems/vcpkg.cmake" "-DCMAKE_ERROR_ON_ABSOLUTE_INSTALL_DESTINATION=ON" "-DVCPKG_CXX_FLAGS=" "-DVCPKG_CXX_FLAGS_RELEASE=" "-DVCPKG_CXX_FLAGS_DEBUG=" "-DVCPKG_C_FLAGS=" "-DVCPKG_C_FLAGS_RELEASE=" "-DVCPKG_C_FLAGS_DEBUG=" "-DVCPKG_CRT_LINKAGE=dynamic" "-DVCPKG_LINKER_FLAGS=" "-DVCPKG_LINKER_FLAGS_RELEASE=" "-DVCPKG_LINKER_FLAGS_DEBUG=" "-DVCPKG_TARGET_ARCHITECTURE=x64" "-DCMAKE_INSTALL_LIBDIR:STRING=lib" "-DCMAKE_INSTALL_BINDIR:STRING=bin" "-D_VCPKG_ROOT_DIR=F:/vcpkg-master" "-D_VCPKG_INSTALLED_DIR=F:/vcpkg-master/installed" "-DVCPKG_MANIFEST_INSTALL=OFF" "-G" "Ninja" "-DCMAKE_BUILD_TYPE=Debug" "-DCMAKE_INSTALL_PREFIX=F:/vcpkg-master/packages/soundtouch_x64-windows/debug""
FAILED: ../../x64-windows-dbg/CMakeCache.txt
cmd /c "cd ../../x64-windows-dbg && "C:/Program Files/CMake/bin/cmake.exe" "F:/vcpkg-master/buildtrees/soundtouch/src/undtouch-2-ed25d761b4.clean" "-DCMAKE_MAKE_PROGRAM=F:/vcpkg-master/downloads/tools/ninja/1.10.1-windows/ninja.exe" "-DBUILD_SHARED_LIBS=ON" "-DVCPKG_CHAINLOAD_TOOLCHAIN_FILE=F:/vcpkg-master/scripts/toolchains/windows.cmake" "-DVCPKG_TARGET_TRIPLET=x64-windows" "-DVCPKG_SET_CHARSET_FLAG=ON" "-DVCPKG_PLATFORM_TOOLSET=v142" "-DCMAKE_EXPORT_NO_PACKAGE_REGISTRY=ON" "-DCMAKE_FIND_PACKAGE_NO_PACKAGE_REGISTRY=ON" "-DCMAKE_FIND_PACKAGE_NO_SYSTEM_PACKAGE_REGISTRY=ON" "-DCMAKE_INSTALL_SYSTEM_RUNTIME_LIBS_SKIP=TRUE" "-DCMAKE_VERBOSE_MAKEFILE=ON" "-DVCPKG_APPLOCAL_DEPS=OFF" "-DCMAKE_TOOLCHAIN_FILE=F:/vcpkg-master/scripts/buildsystems/vcpkg.cmake" "-DCMAKE_ERROR_ON_ABSOLUTE_INSTALL_DESTINATION=ON" "-DVCPKG_CXX_FLAGS=" "-DVCPKG_CXX_FLAGS_RELEASE=" "-DVCPKG_CXX_FLAGS_DEBUG=" "-DVCPKG_C_FLAGS=" "-DVCPKG_C_FLAGS_RELEASE=" "-DVCPKG_C_FLAGS_DEBUG=" "-DVCPKG_CRT_LINKAGE=dynamic" "-DVCPKG_LINKER_FLAGS=" "-DVCPKG_LINKER_FLAGS_RELEASE=" "-DVCPKG_LINKER_FLAGS_DEBUG=" "-DVCPKG_TARGET_ARCHITECTURE=x64" "-DCMAKE_INSTALL_LIBDIR:STRING=lib" "-DCMAKE_INSTALL_BINDIR:STRING=bin" "-D_VCPKG_ROOT_DIR=F:/vcpkg-master" "-D_VCPKG_INSTALLED_DIR=F:/vcpkg-master/installed" "-DVCPKG_MANIFEST_INSTALL=OFF" "-G" "Ninja" "-DCMAKE_BUILD_TYPE=Debug" "-DCMAKE_INSTALL_PREFIX=F:/vcpkg-master/packages/soundtouch_x64-windows/debug""
-- The CXX compiler identification is MSVC 19.28.29335.0
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - failed
-- Check for working CXX compiler: F:/Visual Studio - IDE/VC/Tools/MSVC/14.28.29333/bin/Hostx64/x64/cl.exe
-- Check for working CXX compiler: F:/Visual Studio - IDE/VC/Tools/MSVC/14.28.29333/bin/Hostx64/x64/cl.exe - broken
CMake Error at C:/Program Files/CMake/share/cmake-3.19/Modules/CMakeTestCXXCompiler.cmake:59 (message):
The C++ compiler
"F:/Visual Studio - IDE/VC/Tools/MSVC/14.28.29333/bin/Hostx64/x64/cl.exe"

is not able to compile a simple test program.
It fails with the following output:
Change Dir: F:/vcpkg-master/buildtrees/soundtouch/x64-windows-dbg/CMakeFiles/CMakeTmp

Run Build Command(s):F:/vcpkg-master/downloads/tools/ninja/1.10.1-windows/ninja.exe cmTC_9ee8f && [1/2] Building CXX object CMakeFiles\cmTC_9ee8f.dir\testCXXCompiler.cxx.obj
[2/2] Linking CXX executable cmTC_9ee8f.exe
FAILED: cmTC_9ee8f.exe
cmd.exe /C "cd . && "C:\Program Files\CMake\bin\cmake.exe" -E vs_link_exe --intdir=CMakeFiles\cmTC_9ee8f.dir --rc=rc --mt=CMAKE_MT-NOTFOUND --manifests  -- "F:\Visual Studio - IDE\VC\Tools\MSVC\14.28.29333\bin\Hostx64\x64\link.exe" /nologo CMakeFiles\cmTC_9ee8f.dir\testCXXCompiler.cxx.obj  /out:cmTC_9ee8f.exe /implib:cmTC_9ee8f.lib /pdb:cmTC_9ee8f.pdb /version:0.0 /machine:x64  /debug /INCREMENTAL /subsystem:console  kernel32.lib user32.lib gdi32.lib winspool.lib shell32.lib ole32.lib oleaut32.lib uuid.lib comdlg32.lib advapi32.lib && cd ."
RC Pass 1: command "rc /fo CMakeFiles\cmTC_9ee8f.dir/manifest.res CMakeFiles\cmTC_9ee8f.dir/manifest.rc" failed (exit code 0) with the following output:
O sistema não pode encontrar o arquivo especificado
ninja: build stopped: subcommand failed.

CMake will not be able to correctly generate this project.
Call Stack (most recent call first):
CMakeLists.txt:2 (project)
-- Configuring incomplete, errors occurred!
See also "F:/vcpkg-master/buildtrees/soundtouch/x64-windows-dbg/CMakeFiles/CMakeOutput.log".
See also "F:/vcpkg-master/buildtrees/soundtouch/x64-windows-dbg/CMakeFiles/CMakeError.log".
[2/2] cmd /c "cd .. && "C:/Program Files/CMake/bin/cmake.exe" "F:/vcpkg-master/buildtrees/soundtouch/src/undtouch-2-ed25d761b4.clean" "-DCMAKE_MAKE_PROGRAM=F:/vcpkg-master/downloads/tools/ninja/1.10.1-windows/ninja.exe" "-DBUILD_SHARED_LIBS=ON" "-DVCPKG_CHAINLOAD_TOOLCHAIN_FILE=F:/vcpkg-master/scripts/toolchains/windows.cmake" "-DVCPKG_TARGET_TRIPLET=x64-windows" "-DVCPKG_SET_CHARSET_FLAG=ON" "-DVCPKG_PLATFORM_TOOLSET=v142" "-DCMAKE_EXPORT_NO_PACKAGE_REGISTRY=ON" "-DCMAKE_FIND_PACKAGE_NO_PACKAGE_REGISTRY=ON" "-DCMAKE_FIND_PACKAGE_NO_SYSTEM_PACKAGE_REGISTRY=ON" "-DCMAKE_INSTALL_SYSTEM_RUNTIME_LIBS_SKIP=TRUE" "-DCMAKE_VERBOSE_MAKEFILE=ON" "-DVCPKG_APPLOCAL_DEPS=OFF" "-DCMAKE_TOOLCHAIN_FILE=F:/vcpkg-master/scripts/buildsystems/vcpkg.cmake" "-DCMAKE_ERROR_ON_ABSOLUTE_INSTALL_DESTINATION=ON" "-DVCPKG_CXX_FLAGS=" "-DVCPKG_CXX_FLAGS_RELEASE=" "-DVCPKG_CXX_FLAGS_DEBUG=" "-DVCPKG_C_FLAGS=" "-DVCPKG_C_FLAGS_RELEASE=" "-DVCPKG_C_FLAGS_DEBUG=" "-DVCPKG_CRT_LINKAGE=dynamic" "-DVCPKG_LINKER_FLAGS=" "-DVCPKG_LINKER_FLAGS_RELEASE=" "-DVCPKG_LINKER_FLAGS_DEBUG=" "-DVCPKG_TARGET_ARCHITECTURE=x64" "-DCMAKE_INSTALL_LIBDIR:STRING=lib" "-DCMAKE_INSTALL_BINDIR:STRING=bin" "-D_VCPKG_ROOT_DIR=F:/vcpkg-master" "-D_VCPKG_INSTALLED_DIR=F:/vcpkg-master/installed" "-DVCPKG_MANIFEST_INSTALL=OFF" "-G" "Ninja" "-DCMAKE_BUILD_TYPE=Release" "-DCMAKE_INSTALL_PREFIX=F:/vcpkg-master/packages/soundtouch_x64-windows""
FAILED: ../CMakeCache.txt
cmd /c "cd .. && "C:/Program Files/CMake/bin/cmake.exe" "F:/vcpkg-master/buildtrees/soundtouch/src/undtouch-2-ed25d761b4.clean" "-DCMAKE_MAKE_PROGRAM=F:/vcpkg-master/downloads/tools/ninja/1.10.1-windows/ninja.exe" "-DBUILD_SHARED_LIBS=ON" "-DVCPKG_CHAINLOAD_TOOLCHAIN_FILE=F:/vcpkg-master/scripts/toolchains/windows.cmake" "-DVCPKG_TARGET_TRIPLET=x64-windows" "-DVCPKG_SET_CHARSET_FLAG=ON" "-DVCPKG_PLATFORM_TOOLSET=v142" "-DCMAKE_EXPORT_NO_PACKAGE_REGISTRY=ON" "-DCMAKE_FIND_PACKAGE_NO_PACKAGE_REGISTRY=ON" "-DCMAKE_FIND_PACKAGE_NO_SYSTEM_PACKAGE_REGISTRY=ON" "-DCMAKE_INSTALL_SYSTEM_RUNTIME_LIBS_SKIP=TRUE" "-DCMAKE_VERBOSE_MAKEFILE=ON" "-DVCPKG_APPLOCAL_DEPS=OFF" "-DCMAKE_TOOLCHAIN_FILE=F:/vcpkg-master/scripts/buildsystems/vcpkg.cmake" "-DCMAKE_ERROR_ON_ABSOLUTE_INSTALL_DESTINATION=ON" "-DVCPKG_CXX_FLAGS=" "-DVCPKG_CXX_FLAGS_RELEASE=" "-DVCPKG_CXX_FLAGS_DEBUG=" "-DVCPKG_C_FLAGS=" "-DVCPKG_C_FLAGS_RELEASE=" "-DVCPKG_C_FLAGS_DEBUG=" "-DVCPKG_CRT_LINKAGE=dynamic" "-DVCPKG_LINKER_FLAGS=" "-DVCPKG_LINKER_FLAGS_RELEASE=" "-DVCPKG_LINKER_FLAGS_DEBUG=" "-DVCPKG_TARGET_ARCHITECTURE=x64" "-DCMAKE_INSTALL_LIBDIR:STRING=lib" "-DCMAKE_INSTALL_BINDIR:STRING=bin" "-D_VCPKG_ROOT_DIR=F:/vcpkg-master" "-D_VCPKG_INSTALLED_DIR=F:/vcpkg-master/installed" "-DVCPKG_MANIFEST_INSTALL=OFF" "-G" "Ninja" "-DCMAKE_BUILD_TYPE=Release" "-DCMAKE_INSTALL_PREFIX=F:/vcpkg-master/packages/soundtouch_x64-windows""
-- The CXX compiler identification is MSVC 19.28.29335.0
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - failed
-- Check for working CXX compiler: F:/Visual Studio - IDE/VC/Tools/MSVC/14.28.29333/bin/Hostx64/x64/cl.exe
-- Check for working CXX compiler: F:/Visual Studio - IDE/VC/Tools/MSVC/14.28.29333/bin/Hostx64/x64/cl.exe - broken
CMake Error at C:/Program Files/CMake/share/cmake-3.19/Modules/CMakeTestCXXCompiler.cmake:59 (message):
The C++ compiler
"F:/Visual Studio - IDE/VC/Tools/MSVC/14.28.29333/bin/Hostx64/x64/cl.exe"

is not able to compile a simple test program.
It fails with the following output:
Change Dir: F:/vcpkg-master/buildtrees/soundtouch/x64-windows-rel/CMakeFiles/CMakeTmp

Run Build Command(s):F:/vcpkg-master/downloads/tools/ninja/1.10.1-windows/ninja.exe cmTC_bf8f9 && [1/2] Building CXX object CMakeFiles\cmTC_bf8f9.dir\testCXXCompiler.cxx.obj
[2/2] Linking CXX executable cmTC_bf8f9.exe
FAILED: cmTC_bf8f9.exe
cmd.exe /C "cd . && "C:\Program Files\CMake\bin\cmake.exe" -E vs_link_exe --intdir=CMakeFiles\cmTC_bf8f9.dir --rc=rc --mt=CMAKE_MT-NOTFOUND --manifests  -- "F:\Visual Studio - IDE\VC\Tools\MSVC\14.28.29333\bin\Hostx64\x64\link.exe" /nologo CMakeFiles\cmTC_bf8f9.dir\testCXXCompiler.cxx.obj  /out:cmTC_bf8f9.exe /implib:cmTC_bf8f9.lib /pdb:cmTC_bf8f9.pdb /version:0.0 /machine:x64  /debug /INCREMENTAL /subsystem:console  kernel32.lib user32.lib gdi32.lib winspool.lib shell32.lib ole32.lib oleaut32.lib uuid.lib comdlg32.lib advapi32.lib && cd ."
RC Pass 1: command "rc /fo CMakeFiles\cmTC_bf8f9.dir/manifest.res CMakeFiles\cmTC_bf8f9.dir/manifest.rc" failed (exit code 0) with the following output:
O sistema não pode encontrar o arquivo especificado
ninja: build stopped: subcommand failed.

CMake will not be able to correctly generate this project.
Call Stack (most recent call first):
CMakeLists.txt:2 (project)
-- Configuring incomplete, errors occurred!
See also "F:/vcpkg-master/buildtrees/soundtouch/x64-windows-rel/CMakeFiles/CMakeOutput.log".
See also "F:/vcpkg-master/buildtrees/soundtouch/x64-windows-rel/CMakeFiles/CMakeError.log".
ninja: build stopped: subcommand failed.

i don't know what happened, but i reinstalled the SDK of Windows 10 and worked 🤔

i don't know what happened, but i reinstalled the SDK of Windows 10 and worked 🤔


Add assembly version to debug logs

This will help with diagnosability of issues where customers haven't updated ANCM

Should this be only in debug logs or in the event log?

Both


NotImplementedError sphinx.writers.latex.LaTeXTranslator departing unknown node type RailroadDiagramNode

Hi, apparently, since release 1.4.0, the latex build has stopped working with the following error:
Running Sphinx v5.3.0
loading translations [tr]... done
making output directory... done
loading pickled environment... done
building [mo]: targets for 0 po files that are out of date
building [latex]: all documents
updating environment: 0 added, 0 changed, 0 removed
looking for now-outdated files... none found
processing solidity.tex... index introduction-to-smart-contracts installing-solidity solidity-by-example layout-of-source-files structure-of-a-contract types units-and-global-variables control-structures contracts assembly cheatsheet grammar using-the-compiler analysing-compilation-output ir-breaking-changes internals/layout_in_storage internals/layout_in_memory internals/layout_in_calldata internals/variable_cleanup internals/source_mappings internals/optimizer metadata abi-spec 050-breaking-changes 060-breaking-changes 070-breaking-changes 080-breaking-changes natspec-format security-considerations smtchecker resources path-resolution yul style-guide common-patterns bugs contributing brand-guide language-influences
resolving references...
/home/docs/checkouts/readthedocs.org/user_builds/solidity-docs-tr-turkish/checkouts/v0.8.15/docs/introduction-to-smart-contracts.rst:196: WARNING: undefined label: 'özel bir global değişken <special-variables-functions>`dir. ``msg.sender`'
/home/docs/checkouts/readthedocs.org/user_builds/solidity-docs-tr-turkish/checkouts/v0.8.15/docs/introduction-to-smart-contracts.rst:212: WARNING: undefined label: 'hatalar'
/home/docs/checkouts/readthedocs.org/user_builds/solidity-docs-tr-turkish/checkouts/v0.8.15/docs/units-and-global-variables.rst:320: WARNING: undefined label: 'address`e gönderir ve yürütür. ``selfdestruct`'
/home/docs/checkouts/readthedocs.org/user_builds/solidity-docs-tr-turkish/checkouts/v0.8.15/docs/internals/optimizer.rst:305: WARNING: undefined label: 'var-decl-initializer'
/home/docs/checkouts/readthedocs.org/user_builds/solidity-docs-tr-turkish/checkouts/v0.8.15/docs/common-patterns.rst:13: WARNING: undefined label: 'güvenlikle i̇lgili değerlendirmeler'
done
writing... /home/docs/checkouts/readthedocs.org/user_builds/solidity-docs-tr-turkish/checkouts/v0.8.15/docs/grammar/SolidityParser.g4:: WARNING: unknown node type: <RailroadDiagramNode: >
failed

Exception occurred:
  File "/home/docs/checkouts/readthedocs.org/user_builds/solidity-docs-tr-turkish/envs/v0.8.15/lib/python3.7/site-packages/docutils/nodes.py", line 2058, in unknown_departure
    % (self.__class__, node.__class__.__name__))
NotImplementedError: <class 'sphinx.writers.latex.LaTeXTranslator'> departing unknown node type: RailroadDiagramNode
The full traceback has been saved in /tmp/sphinx-err-pn9u4xxa.log, if you want to report the issue to the developers.
Please also report this if it was a user error, so that a better error message can be provided next time.
A bug report can be filed in the tracker at <https://github.com/sphinx-doc/sphinx/issues>. Thanks!

The problem seems to be related to this change https://github.com/taminomara/sphinx-a4doc/commit/169ca4384e095e752b34bdf95b9f7c151e9e5abb. If I downgrade sphinx-a4doc to version 1.3.0, it works again.

I had no idea latex build worked... that was an accident!
Anyways, I've pushed experimental support for latex in c1e8c83, can you check if it works for you so I can make a release?

NVM ran solidity docs build and it works now. So, issue fixed in 1.6.0.

Thanks :)


[Bug] MarkArea gets cut off while scrolling in zoomed mode

Version
5.4.2
Link to Minimal Reproduction
https://codesandbox.io/s/wmppmi?file=/index.js
Steps to Reproduce

Open the demo on https://codesandbox.io/s/wmppmi?file=/index.js
Zoom in the chart several times (so that it can be scrollable)
Keep scrolling the chart to the right and watch the left-hand side of the mark area as it's getting cut off when the first tick on the X-axis is not aligned with the [0, 0] point on the graph (as if mark area began at this tick and the space before is ignored while it should be continuous)

Below a small demonstration:

Current Behavior
Mark area is getting cut off when the first tick on the X-axis is not aligned with the [0, 0] point on the graph.  It looks like mark area started at this tick and the space before it is ignored.
Expected Behavior
Mark area should be drawn as a continuous area while scrolling, with no ruptures.
Environment
- OS:
- Browser:
- Framework:

Any additional comments?
No response

Here is the configuration from the provided demo:
const randomValues = Array.from({ length: 100 }, (i) => (Math.random() * 40));

option = {
  xAxis: {
    data: randomValues.map((_, i) => (`meas${i}`))
  },
  yAxis: {},
  series: [{
    name: "Sale",
    type: "bar",
    data: randomValues,
    markArea: {
      silent: true,
      data: [
        [{ xAxis: 'meas10', itemStyle: { color: 'rgb(239, 150, 0)' } }, { yAxis: 20 }]
      ]
    }
  }],
  dataZoom: { type: 'inside' }
}

any answer to this?? i am experiencing this problem too


about dataset

Sorry to bother you, but could you please clarify whether you used a subset of the dataset or the entire dataset for your experiments? I noticed that the nq_open dataset alone has 88,000 entries in the test set, which might be very time-consuming to process.

We use a subset:

For each dataset, we use 400 train examples and 400 test examples randomly sampled from the original larger dataset. [...]

This will also be enabled in the code by default. Please see the methods section of the paper for more details!

thanks for your reply

No worries at all and thanks for your interest in our project!


bug at fresh RN 0.72.5 built

Describe the bug
at "yarn run android" :
you get :
" FAILURE: Build completed with 2 failures.
1: Task failed with an exception.

Where:
Build file '/home/william/logiciels/logiciels-windows/dev_RN-Node-sauv-GIT/test_rn_scan_camera_tesla/node_modules/react-native-camera-kit/android/build.gradle' line: 2

What went wrong:
A problem occurred evaluating project ':react-native-camera-kit'.

Plugin with id 'kotlin-android' not found.

Try:

Run with --stacktrace option to get the stack trace.
Run with --info or --debug option to get more log output.
Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.

What went wrong:
A problem occurred configuring project ':react-native-camera-kit'.

com.android.builder.errors.EvalIssueException: compileSdkVersion is not specified. Please add it to build.gradle
"

To Reproduce : SIMPLE
Steps to reproduce the behavior:

create a fresh react native (here 0.72.5) project
add this package : "yarn add react-native-camera-kit"
3.compile : "yarn run android"

Expected behavior
Build successful
Desktop (please complete the following information):

OS: [Linux]
Version [>5]

Smartphone (please complete the following information):
no matter

You'll probably want to read through the following. It fixed it for me.
https://github.com/teslamotors/react-native-camera-kit/blob/master/docs/kotlin.md

I thank you @daamsie , I did not see that.
I applied what is written , and at yarn run android , I had the failure :
`

Configure project :app
Warning: The 'kotlin-android-extensions' Gradle plugin is deprecated. Please use this migration guide (https://goo.gle/kotlin-android-extensions-deprecation) to start working with View Binding (https://developer.android.com/topic/libraries/view-binding) and the 'kotlin-parcelize' plugin.

Task :react-native-camera-kit:processDebugManifest
package="com.rncamerakit" found in source AndroidManifest.xml: /home/william/logiciels/logiciels-windows/dev_RN-Node-GIT/test_rn_scan_camera_tesla/node_modules/react-native-camera-kit/android/src/main/AndroidManifest.xml.
Setting the namespace via a source AndroidManifest.xml's package attribute is deprecated.
Please instead set the namespace (or testNamespace) in the module's build.gradle file, as described here: https://developer.android.com/studio/build/configure-app-module#set-namespace
This migration can be done automatically using the AGP Upgrade Assistant, please refer to https://developer.android.com/studio/build/agp-upgrade-assistant for more information.

Task :app:processDebugMainManifest FAILED

See https://developer.android.com/r/studio-ui/build/manifest-merger for more information about the manifest merger.
20 actionable tasks: 15 executed, 5 up-to-date
info 💡 Tip: Make sure that you have set up your development environment correctly, by running react-native doctor. To read more about doctor command visit: https://github.com/react-native-community/cli/blob/main/packages/cli-doctor/README.md#doctor
/home/william/logiciels/logiciels-windows/dev_RN-Node-GIT/test_rn_scan_camera_tesla/android/app/src/debug/AndroidManifest.xml Error:
uses-sdk:minSdkVersion 21 cannot be smaller than version 23 declared in library [:react-native-camera-kit] /home/william/logiciels/logiciels-windows/dev_RN-Node-GIT/test_rn_scan_camera_tesla/node_modules/react-native-camera-kit/android/build/intermediates/merged_manifest/debug/AndroidManifest.xml as the library might be using APIs not available in 21
Suggestion: use a compatible library with a minSdk of at most 21,
or increase this project's minSdk version to at least 23,
or use tools:overrideLibrary="com.rncamerakit" to force usage (may lead to runtime failures)
FAILURE: Build failed with an exception.

What went wrong:
Execution failed for task ':app:processDebugMainManifest'.

Manifest merger failed : uses-sdk:minSdkVersion 21 cannot be smaller than version 23 declared in library [:react-native-camera-kit] /home/william/logiciels/logiciels-windows/dev_RN-Node-GIT/test_rn_scan_camera_tesla/node_modules/react-native-camera-kit/android/build/intermediates/merged_manifest/debug/AndroidManifest.xml as the library might be using APIs not available in 21
Suggestion: use a compatible library with a minSdk of at most 21,
or increase this project's minSdk version to at least 23,
or use tools:overrideLibrary="com.rncamerakit" to force usage (may lead to runtime failures)

Try:

Run with --stacktrace option to get the stack trace.
Run with --info or --debug option to get more log output.
Run with --scan to get full insights.

Get more help at https://help.gradle.org

BUILD FAILED in 28s`
I do not know how to solve that . thank all . I do think my case is very general and not specific .

I had a similar error to that as well, please note the message in the error
Suggestion: use a compatible library with a minSdk of at most 21,
or increase this project's minSdk version to at least 23,

In your build.gradle you will have to bump up your minSdkVersion to at least 23 to be able to use this library.
23 is the equivalent of Android 6 which is pretty darn old already by now.

yes indeed , sorry , it works !!
Thank you a lot !


[Question] How to configuration ssh with a proxy

Hi,
In my .ssh/config, I use a proxycommand option do "jump" to my server.
Can we configure this kind of connection with insidelog ?

Hi, thank you for looking at insidelog
The software is designed to display content of files present in a server.
Sorry I do not understand what do you mean by "jump" to a server.
In fact you still can connect to a server without being obliged to type a password: by using your ssh public/private key pair.
If we want to offer another connection mechanism, we should see if it is supported by the underlying ssh java lib: http://www.jcraft.com/jsch/
Have a nice day.
Best regards,
Philippe

Hi,
Thanks for the reply, "jump" means that I must connect to a server A to be able to connect to a server B. From A I have access to the server B but I don't have a direct access.
There is an implementation example on Jsch pages: JumpHosts.java
Thanks


Release Orion 0.3.1

Is there going to be a changelog for this thing someday? :)

There should be - I'll add that as a backlog item


Improved improvements from adam and richard

my proposed change set, incorporating feedback from #34

Can you push this to your gh-pages so we can preview it?  And why doesn't github let us preview any damn branch we want? :-/

I already have
On 9 Sep 2015 6:41 pm, "Adam Spiers"<EMAIL_ADDRESS>wrote:

Can you push this to your gh-pages so we can preview it? And why doesn't
github let us preview any damn branch we want? :-/
—
Reply to this email directly or view it on GitHub
https://github.com/cyntss/opensuse-landing-page/pull/39#issuecomment-138968567
.

http://sysrich.github.io/opensuse-landing-page/
The leap section needs love (missing install button and the link to the portal)
And the news section needs the HR removed
Cynthia said she could do it.

I still think Leap should be on the left.  IMHO @cornelius hit the nail on the head regarding respecting the majority of the existing user base.  But if you still disagree and want to overrule us (which is of course your prerogative), it would be nicer simply to drop the patch which swaps them, rather than pollute history and the PR with two commits which simply annul each other.

@aspiers Sorry I didnt read the hole thread in the other discussion but what I understood (just from the commit name in Swap leap and Tumbleweed which I quote "More people will be interested in the stable release, so put Leap on the left and Tumbleweed on the right.") I have to disagree with you.
In a website, the most Positive side of the screen is the Right side, not the Left, being the reason why most ads are located on the right of a webpage. Because we read from left to right, we always end up paying sightly more attention to the Right; of course, for Arabic speaking countries this might not be the case. That being said, It is not like I disagree with you on the idea of focusing more on Leap over Tumbleweed, but the positioning on screen.
So, unless @sysrich wants to change it, I think the current layout is the proper one for our user base.

You're the professional - I don't want to change it.. closing this PR
I guess we take everything from #34 and then remove Machinery and fix the News HR?

@sysrich hmm I think this PR was the right one lol. #34 has the wrong position for Leap and Tumbleweed. I think you misunderstood me maybe

Tomorrow I remove the line in News and add the Install button on Leap, and that should be it.

oh, okay, basically, you're the boss, I've given my opinions, and at this point I'm equally happy if you take them, or don't :)


[FEATURE REQUEST] Store accounts in a secrets service if possible

On linux, there are many apps (such as kdewallet5 or gnome keyring), that provide org.freedesktop.secrets, so apps can ask them for passwords, login tokens etc, which these apps usually store in some encrypted way.
This basically functions like password manager, you login with a master password to decrypt the keyring and all other services can use different passwords, which you don't have to remember.
I've created this issue to track the progress, as I plan to implement this, but it's going to take me some time. (due to needed research, falling back to filesystem storage etc.)
I'm also not aware of whether those APIs exist on windows & macos, so this issue can also be used for discussion about implementing this on windows and macos.

It also seems like there is some accounts integration https://github.com/KDE/kaccounts-integration, which at least looks simillar to android's accounts settings, and eventhough I'm not 100% sure, I think those passwords are stored inside the secrets application.

So elk doesn't actually store any user passwords, it actually never gets to see either the email or password. The only thing elk gets to hold onto is an oauth token. And I guess storing that in a more secure place than just in a KV store on disk like right now might not hurt, but I don't know if that is what you had in mind?

Hey! Just letting you know that elk-native is no longer maintained, much of the team has moved on or is busy with other projects (there's only so much time in a day 😅), so this issue will likely not be fixed.
Please use the actively maintained elk PWA instead.
Thanks so much for your support and understanding so far! ❤


ValueError when opening array within array

Description
What steps will reproduce the problem?

connection=np.dtype([
    ('value', np.bool, (1)),
    ('connection',np.bool, (N,N))
])

grille=np.zeros((N,N),dtype=connection)

#Open variable explorer and selection from there the sub array in the connection window
Traceback
  File "C:\Users\joeda\Anaconda3\lib\site-packages\spyder\plugins\variableexplorer\widgets\arrayeditor.py", line 396, in createEditor
    value = not value
ValueError: The truth value of an array with more than one element is ambiguous.

I had a look at this. As the traceback shows, the problem occurs in
https://github.com/spyder-ide/spyder/blob/436290ba71bb16c5928676467a358b70f4f38c10/spyder/plugins/variableexplorer/widgets/arrayeditor.py#L391-L399
It is caused by model._data.dtype.name being "bool" not only when value is a boolean, but also when it is a numpy array of booleans.
A workaround that prevents an error from being thrown is to add the clause and type(value) != np.ndarray to line 395. Something shorter like if type(value) == bool: doesn't quite work because there are multiple scalar boolean types.
The deeper problem is that the array editor doesn't fully handle generic objects as elements of numpy arrays. As an example, consider
a = [1, 'abc', [1,4,'cd'], np.arange(4)]
b = np.array(a)

Variable a can be edited in the explorers without issue, but for variable b nothing can be done. Though I guess this is intentional since the title of the window contains "(read only)" when I open b.
It should be possible to open a new ArrayEditor, or even a CollectionsEditor, from within the ArrayEditor. That would result in more intuitive behaviour. But that is more than a one-liner and I don't know exactly how to implement it.

A workaround that prevents an error from being thrown is to add the clause and type(value) != np.ndarray to line 395.

Great! Could you open a pull request with that change? Doing it against the 4.x branch is fine in this case (since this is a bug).

Though I guess this is intentional since the title of the window contains "(read only)" when I open b.

Yes, it is intentional because we don't have a reliable way to allow users editing object arrays (which is what b is, i.e. a mix of several objects).

It should be possible to open a new ArrayEditor, or even a CollectionsEditor, from within the ArrayEditor. That would result in more intuitive behaviour. But that is more than a one-liner and I don't know exactly how to implement it.

No problem, that could be done later.

Sure, I'll make a pull request tonight.


Adapting own AudioInputStream for Linux SDK.

Please provide us with the following information:

This issue is for a: (mark with an x)
- [ ] bug report -> please search issues before submitting
- [v] feature request
- [v] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

Minimal steps to reproduce

tyring to implement own audioinputstream and connect to speechapi factory

Any log messages given by the failure

Expected/desired behavior

OS and Version?

Windows 7, 8 or 10. Linux (which distribution). Other.
ubuntu 16.04

Versions

Mention any other details that might be useful
hi,
Could you let me know how to connect own AudioInputStream more in detail for linux SDK? (sample code would be the best.)
I'm trying to adapt my own AudioInputStream on linux, c++ environment,
I have tried to implement MyAudioInputStream class which is defined as speechapi_cxx_audioinputstream.h and
use InitSpeechApi_AudioInputStreamAdapterFromAudioInputStream() in speechapi_cxx_factory.h to apply the MyAudioInputStream class.
but on this point, I needed to derive the SpeechApi_AudioInputStreamAdapter struct which seems to be defined in the sdk as a default one. due to that I couldn't find any point of this already-implemented adapter to connect MyAudioInputStream to the SDK, got stuck eventually.
please let me know if I am digging wrong way, or how to fix this problem.
thank you in advance.

Thanks! We'll be in touch soon.

The current version supports only file or microphone as an audiostream.
We will soon release an update that will support to pass an audioinputstream to the factory, that should make it a lot easier ...
Wolfgang

Please check the new SDK version 0.4.0 which support AudioInputStream. You can find more information in How-To guides here. And we have C# samples here. The C++ usuage is very similar, and we will provide C++ samples soon.
Please let us know if you have any questions or feedback to improve API.
Thanks,

Checked. Thank you for your support.


Fix default layout path

In https://github.com/coppolaemilio/dialogic/pull/1421 DialogicDefaultLayout (formerly DialogicDefaultScene) was moved and renamed, however paths pointing to its location were not updated, because GDScript is a very good language and refactoring code written in it is always a pleasure.
There are some occasional formatting fixes to dilute the atmosphere of inevitable hardcoded doom.

Thanks for this PR.
However, we can now use DialogicUtil.get_default_layout() to get this path. The methods in settings general seem like they are not needed anymore.

Updated and tested with the same usecase.

Thanks!


v0.4.0 Uncurried

This version subverts ReScripts v11 uncurrying standards by setting "uncurried": false" in rescript.json which disables the intended compiler behavior of uncurrying functions by default. This variant required us to correctly distinguish parameters that were uncurried and function calls that could be ambiguous.
Both PRs update the package.json dependencies and remove "@glennsl/bs-jest" as it was abandoned and had numerous security advisories

Closing in favor of #20


@rollup/plugin-replace 'preventAssignment' warning

Library Affected:
workbox-build
Browser & Platform:
node
Issue:
Get a warning in my terminal every time workbox-build is run.
@rollup/plugin-replace: 'preventAssignment' currently defaults to false. It is recommended to set this option to `true`, as the next major version will default this option to `true`.
https://github.com/rollup/plugins/blob/6bee5980155df7b73cfbd9746556517c8d7f0ad7/packages/replace/test/snapshots/misc.js.md#no-explicit-setting-of-preventassignment

This is resolved in https://github.com/GoogleChrome/workbox/releases/tag/v6.1.2


Add SCC options to AdoptOpenJDK-OpenJ9

There is ~30% reduction in Startup time with Tomcat when using the Shared Class Cache(SCC).
I wrote a detailed blog post here  https://blog.openj9.org/2020/05/18/startup-performance-of-tomcat-in-docker/   where I outlined what and how I measured.
So, created this PR to enable SCC options for AdoptOpenJDK-OpenJ9

If this is something upstream recommends, shouldn't it be noted in their documentation?  Maybe a configuration file/option which tells catalina.sh to use their preferred options?  It seems like even a dedicated subcommand (like run) to generate them would be useful, especially if the options during generation need to be different than the options during runtime.
Given that I'm not aware of any documentation from upstream which recommends this and that this is something users can accomplish in a dependent Dockerfile that's FROM tomcat:...-openj9, I'm inclined to not do this at this level for now.

@tianon
I did write a mail to Tomcat Community about the changes that help Startup Performance reduction. Awaiting for the reply on their suggestions about this.
In this Cloud era, a good reduction in Startup time will be very helpful for the Cloud customers. And as these options are specific to OpenJ9 alone, I'm assuming the changes will help most of the Cloud customers who are using this.
Also, as all customers may not be aware of how they can reduce their Startup time with OpenJ9 on Tomcat  (unless they google or look out for), why not we add in Docker file of OpenJ9 which we generate it here ?

I would rather not maintain the openj9-based images in their own Dockerfile for what amounts to a 3 line Dockerfile for users that want to have a class cache.  It is unfortunate that users may be unaware of how to speed up their startup time, but that seems like a general documentation issue with taking advantage of openj9 and not something specific to tomcat.
It is up to users to control how big they want the cache to balance increased image size (pull time) vs jvm startup time savings. (I'd also recommend using start and stop to cataliina.sh so that it isn't just killed when the sleep ends)
FROM tomcat:jdk11-adoptopenjdk-openj9
#COPY ./*.war /....
RUN set -eux; \
	export JAVA_OPTS="-Xshareclasses:name=tomcat_scc,cacheDir=/tmp,enableBCI -Xscmx20M"; \
	catalina.sh start; \
	sleep 20; \
	catalina.sh stop

ENV JAVA_OPTS="-Xshareclasses:name=tomcat_scc,cacheDir=/tmp,readonly"


Crouton not installing (sh: 0: Can´t open)

I am using a chromebook and it only has one available directory called media. All of the examples have Downloads/crouton and i´ve tried switching downloads with media and writing out the whole pathway but so far i cant even run it. I installed crouton within media directory but the pathway is a little long. media/usb/bcrouton/crouton. It is installed on a usb so im not sure if that is the issue.
i´ve tried typing this in with a bunch of variations but i always get
sh: 0: Can't open /home/chronos/user/media/usb/BCrouton/crouton
or
sh: 0: Can't open /home/chronos/user/media/crouton
if anyone can help id really appreciate it and if anymore info is needed just let me know

If you installed it on a usb, you shouldn't have a ~/ at the beginning of the file path. Then, enter the path exactly as it is spelled/capitalized.

@trevor93,
If it's on external media then the path would start with: /media/removable/
If you are using a Chromebook or any CrOS device then each user is given a Downloads folder and it's the default download location unless you changed it in Settings.
Hope this helps,
-DennisLfromGA

sh: 0: Can't open /home/chronos/user/Downloads/crouton

Closing. Please re-open if this issue is still a concern.


[BUG] UserWarning: Using the model-agnostic default max_length (=20)

Prerequisites

[X] I have read the documentation.
[X] I have checked other issues for similar problems.

Backend
Hugging Face Space/Endpoints
Interface Used
UI
CLI Command
No response
UI Screenshots & Parameters
{
"seed": 42,
"lr": 0.00005,
"epochs": 3,
"max_seq_length": 512,
"max_target_length": 256,
"max_length": 1024,
"max_new_tokens": 100,
"batch_size": 8,
"warmup_ratio": 0.1,
"gradient_accumulation": 1,
"optimizer": "adamw_torch",
"scheduler": "linear",
"weight_decay": 0,
"max_grad_norm": 1,
"logging_steps": -1,
"evaluation_strategy": "epoch",
"auto_find_batch_size": false,
"mixed_precision": "fp16",
"save_total_limit": 1,
"save_strategy": "epoch",
"peft": false,
"quantization": null,
"lora_r": 16,
"lora_alpha": 32,
"lora_dropout": 0.05,
"target_modules": [
"all-linear"
]
}

Error Logs
67%|██████▋ | 18000/27000 [1:28:30<36:56, 4.06it/s]/app/env/lib/python3.10/site-packages/transformers/generation/utils.py:1178: UserWarning: Using the model-agnostic default max_length (=20) to control the generation length. We recommend setting max_new_tokens to control the ma
Additional Information
Using seq2seq with google-t5 t5-base. Would love any suggestions on how to force it.

So seems the Seq2Seq in Google models such as t5, mt5 etc are limited to 20 tokens output due to this? ie the required params are not passed through?

no. thats just validation. inferencce doesnt matter

no. thats just validation. inferencce doesnt matter

So any idea why the inference output is always 20 tokens while when I train using Bart I get 256+?

Seems as though the Seq2Seq args aren't passing thorugh (especially for google models).

taking a look!

Full trace attached. The model is still generating only max 20 tokens:
[```
nltk_data] Downloading package punkt to /root/nltk_data...
[nltk_data]   Package punkt is already up-to-date!

WARNING Parameters not supplied by user and set to default: push_to_hub, model_ref, auto_find_batch_size, add_eos_token, data_path, lr, project_name, disable_gradient_checkpointing, logging_steps, optimizer, token, seed, lora_dropout, lora_r, rejected_text_column, batch_size, prompt_text_column, model_max_length, weight_decay, max_grad_norm, merge_adapter, gradient_accumulation, use_flash_attention_2, scheduler, valid_split, trainer, text_column, username, repo_id, lora_alpha, model, save_strategy, warmup_ratio, evaluation_strategy, save_total_limit, train_split, dpo_beta
WARNING Parameters not supplied by user and set to default: batch_size, epochs, log, weight_decay, max_grad_norm, auto_find_batch_size, max_seq_length, gradient_accumulation, scheduler, data_path, lr, valid_split, text_column, username, project_name, target_column, repo_id, logging_steps, optimizer, token, model, save_strategy, seed, warmup_ratio, save_total_limit, evaluation_strategy, push_to_hub, train_split
WARNING Parameters not supplied by user and set to default: batch_size, epochs, log, weight_decay, max_grad_norm, auto_find_batch_size, gradient_accumulation, scheduler, data_path, lr, username, valid_split, image_column, project_name, repo_id, target_column, logging_steps, optimizer, token, model, save_strategy, seed, warmup_ratio, save_total_limit, evaluation_strategy, push_to_hub, train_split
WARNING Parameters supplied but not used: target_modules
WARNING Parameters not supplied by user and set to default: epochs, auto_find_batch_size, data_path, lr, project_name, logging_steps, token, optimizer, seed, lora_dropout, lora_r, target_modules, max_target_length, batch_size, weight_decay, max_grad_norm, max_seq_length, gradient_accumulation, scheduler, username, valid_split, text_column, target_column, repo_id, lora_alpha, model, save_strategy, warmup_ratio, evaluation_strategy, save_total_limit, train_split, peft, push_to_hub, quantization
WARNING Parameters not supplied by user and set to default: id_column, categorical_columns, num_trials, numerical_columns, data_path, username, valid_split, repo_id, project_name, task, token, target_columns, model, seed, train_split, push_to_hub, time_limit
WARNING Parameters not supplied by user and set to default: resume_from_checkpoint, epochs, lr_power, tokenizer_max_length, validation_images, adam_beta1, num_cycles, num_class_images, project_name, token, pre_compute_text_embeddings, sample_batch_size, allow_tf32, xl, num_validation_images, seed, scale_lr, validation_epochs, checkpoints_total_limit, class_prompt, revision, rank, adam_weight_decay, prior_preservation, class_image_path, prior_loss_weight, max_grad_norm, adam_epsilon, scheduler, username, tokenizer, text_encoder_use_attention_mask, image_path, dataloader_num_workers, repo_id, class_labels_conditioning, prior_generation_precision, model, adam_beta2, validation_prompt, local_rank, checkpointing_steps, center_crop, push_to_hub, logging, warmup_steps
WARNING Parameters not supplied by user and set to default: tags_column, batch_size, epochs, log, tokens_column, weight_decay, max_grad_norm, auto_find_batch_size, max_seq_length, gradient_accumulation, scheduler, data_path, lr, valid_split, username, repo_id, project_name, logging_steps, optimizer, token, model, save_strategy, seed, warmup_ratio, save_total_limit, evaluation_strategy, push_to_hub, train_split
INFO    AutoTrain Public URL: NgrokTunnel: "https://b320-34-72-237-89.ngrok-free.app/" -> "http://localhost:7860/"
INFO    Please wait for the app to load...
INFO    ***
INFO:     Started server process [7599]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://<IP_ADDRESS>:7860/ (Press CTRL+C to quit)
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET / HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /logo.png HTTP/1.1" 200 OK
INFO    Task: llm:sft
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /params/llm%3Asft HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /model_choices/llm%3Asft HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /favicon.ico HTTP/1.1" 404 Not Found
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO    Task: seq2seq
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /params/seq2seq HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /model_choices/seq2seq HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO    hardware: Local
INFO    Running jobs: []
INFO    Task: seq2seq
INFO    Column mapping: {'text': 'text', 'label': 'target'}
INFO    Dataset: autotrain-gsxqu-k795g (seq2seq)
Train data: [<tempfile.SpooledTemporaryFile object at 0x7e16bada5b40>]
Valid data: []
Column mapping: {'text': 'text', 'label': 'target'}

Saving the dataset (1/1 shards): 100% 800/800 [00:00<00:00, 238160.49 examples/s]
Saving the dataset (1/1 shards): 100% 200/200 [00:00<00:00, 86072.32 examples/s]

WARNING Parameters not supplied by user and set to default: train_split
WARNING Parameters supplied but not used: model_max_length, max_length, max_new_tokens
INFO    Starting local training...
INFO    {"data_path":"autotrain-gsxqu-k795g/autotrain-data","model":"google-t5/t5-base","username":"tombenj","seed":42,"train_split":"train","valid_split":"validation","project_name":"autotrain-gsxqu-k795g","token":"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","push_to_hub":true,"text_column":"autotrain_text","target_column":"autotrain_label","repo_id":"tombenj/autotrain-gsxqu-k795g","lr":0.00005,"epochs":1,"max_seq_length":1024,"max_target_length":1024,"batch_size":8,"warmup_ratio":0.1,"gradient_accumulation":1,"optimizer":"adamw_torch","scheduler":"linear","weight_decay":0.0,"max_grad_norm":1.0,"logging_steps":-1,"evaluation_strategy":"epoch","auto_find_batch_size":false,"mixed_precision":"fp16","save_total_limit":1,"save_strategy":"epoch","peft":false,"quantization":null,"lora_r":16,"lora_alpha":32,"lora_dropout":0.05,"target_modules":["all-linear"]}
INFO    ['accelerate', 'launch', '--num_machines', '1', '--num_processes', '1', '--mixed_precision', 'fp16', '-m', 'autotrain.trainers.seq2seq', '--training_config', 'autotrain-gsxqu-k795g/training_params.json']
INFO    Training PID: 7899
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "POST /create_project HTTP/1.1" 200 OK
The following values were not passed to accelerate launch and had defaults used instead:
--dynamo_backend was set to a value of 'no'
To avoid this warning pass in values for each of the problematic parameters or run accelerate config.
INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
🚀 INFO   | 2024-03-13 09:15:12 | main:train:45 - Starting training...
🚀 INFO   | 2024-03-13 09:15:12 | main:train:46 - Training config: {'data_path': 'autotrain-gsxqu-k795g/autotrain-data', 'model': 'google-t5/t5-base', 'username': 'tombenj', 'seed': 42, 'train_split': 'train', 'valid_split': 'validation', 'project_name': 'autotrain-gsxqu-k795g', 'token': '*****', 'push_to_hub': True, 'text_column': 'autotrain_text', 'target_column': 'autotrain_label', 'repo_id': 'tombenj/autotrain-gsxqu-k795g', 'lr': 5e-05, 'epochs': 1, 'max_seq_length': 1024, 'max_target_length': 1024, 'batch_size': 8, 'warmup_ratio': 0.1, 'gradient_accumulation': 1, 'optimizer': 'adamw_torch', 'scheduler': 'linear', 'weight_decay': 0.0, 'max_grad_norm': 1.0, 'logging_steps': -1, 'evaluation_strategy': 'epoch', 'auto_find_batch_size': False, 'mixed_precision': 'fp16', 'save_total_limit': 1, 'save_strategy': 'epoch', 'peft': False, 'quantization': None, 'lora_r': 16, 'lora_alpha': 32, 'lora_dropout': 0.05, 'target_modules': ['all-linear']}
🚀 INFO   | 2024-03-13 09:15:12 | main:train:53 - loading dataset from disk
🚀 INFO   | 2024-03-13 09:15:12 | main:train:64 - loading dataset from disk
INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
/usr/local/lib/python3.10/dist-packages/transformers/models/t5/tokenization_t5_fast.py:171: FutureWarning: This tokenizer was incorrectly instantiated with a model max length of 512 which will be corrected in Transformers v5.
For now, this behavior is kept to avoid breaking backwards compatibility when padding/encoding with truncation is True.

Be aware that you SHOULD NOT rely on google-t5/t5-base automatically truncating your input to 512 when padding/encoding.
If you want to encode/pad to sequences longer than 512 you can either instantiate this tokenizer with model_max_length or pass max_length when encoding/padding.
To avoid this warning, please instantiate this tokenizer with model_max_length set to your preferred value.
warnings.warn(

INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
{'loss': 10.2023, 'grad_norm': 29.899457931518555, 'learning_rate': 1.5e-05, 'epoch': 0.05}
8% 8/100 [00:04<00:39,  2.33it/s]> INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
{'loss': 6.8607, 'grad_norm': 57.67634963989258, 'learning_rate': 3.5e-05, 'epoch': 0.1}
{'loss': 2.1809, 'grad_norm': 4.584061622619629, 'learning_rate': 4.888888888888889e-05, 'epoch': 0.15}
{'loss': 1.2057, 'grad_norm': 3.255554437637329, 'learning_rate': 4.6111111111111115e-05, 'epoch': 0.2}
20% 20/100 [00:09<00:34,  2.35it/s]INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
{'loss': 0.8056, 'grad_norm': 2.723172426223755, 'learning_rate': 4.3333333333333334e-05, 'epoch': 0.25}
{'loss': 0.5849, 'grad_norm': 1.7794570922851562, 'learning_rate': 4.055555555555556e-05, 'epoch': 0.3}
32% 32/100 [00:14<00:28,  2.36it/s]> INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
{'loss': 0.418, 'grad_norm': 1.8489391803741455, 'learning_rate': 3.777777777777778e-05, 'epoch': 0.35}
{'loss': 0.3179, 'grad_norm': 1.1671098470687866, 'learning_rate': 3.5e-05, 'epoch': 0.4}
44% 44/100 [00:19<00:23,  2.36it/s]INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
{'loss': 0.2652, 'grad_norm': 1.281832218170166, 'learning_rate': 3.222222222222223e-05, 'epoch': 0.45}
{'loss': 0.2405, 'grad_norm': 0.9086970686912537, 'learning_rate': 2.9444444444444448e-05, 'epoch': 0.5}
{'loss': 0.2329, 'grad_norm': 1.1303473711013794, 'learning_rate': 2.6666666666666667e-05, 'epoch': 0.55}
55% 55/100 [00:24<00:19,  2.32it/s]> INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
{'loss': 0.2199, 'grad_norm': 1.0673601627349854, 'learning_rate': 2.3888888888888892e-05, 'epoch': 0.6}
{'loss': 0.2137, 'grad_norm': 0.8874663710594177, 'learning_rate': 2.111111111111111e-05, 'epoch': 0.65}
67% 67/100 [00:29<00:14,  2.35it/s]INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
{'loss': 0.1876, 'grad_norm': 0.7264275550842285, 'learning_rate': 1.8333333333333333e-05, 'epoch': 0.7}
{'loss': 0.1834, 'grad_norm': 0.8036168217658997, 'learning_rate': 1.5555555555555555e-05, 'epoch': 0.75}
78% 78/100 [00:34<00:09,  2.30it/s]> INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
{'loss': 0.1952, 'grad_norm': 0.6779347062110901, 'learning_rate': 1.2777777777777777e-05, 'epoch': 0.8}
{'loss': 0.1827, 'grad_norm': 0.7915838360786438, 'learning_rate': 1e-05, 'epoch': 0.85}
{'loss': 0.187, 'grad_norm': 0.8215489387512207, 'learning_rate': 7.222222222222222e-06, 'epoch': 0.9}
{'loss': 0.1734, 'grad_norm': 0.7938928604125977, 'learning_rate': 4.444444444444445e-06, 'epoch': 0.95}
{'loss': 0.172, 'grad_norm': 0.6198846697807312, 'learning_rate': 1.6666666666666667e-06, 'epoch': 1.0}
100% 100/100 [00:43<00:00,  2.36it/s]/usr/local/lib/python3.10/dist-packages/transformers/generation/utils.py:1178: UserWarning: Using the model-agnostic default max_length (=20) to control the generation length. We recommend setting max_new_tokens to control the maximum length of the generation.
warnings.warn(

0% 0/13 [00:00<?, ?it/s]
15% 2/13 [00:00<00:05,  2.07it/s]
23% 3/13 [00:02<00:07,  1.36it/s]
31% 4/13 [00:02<00:07,  1.25it/s]
38% 5/13 [00:03<00:06,  1.23it/s]
46% 6/13 [00:04<00:05,  1.20it/s]
54% 7/13 [00:05<00:05,  1.19it/s]
62% 8/13 [00:06<00:04,  1.18it/s]
69% 9/13 [00:07<00:03,  1.17it/s]
77% 10/13 [00:08<00:02,  1.16it/s]
85% 11/13 [00:09<00:01,  1.15it/s]
92% 12/13 [00:09<00:00,  1.15it/s]
{'eval_loss': 0.1557321548461914, 'eval_rouge1': 14.9506, 'eval_rouge2': 12.1047, 'eval_rougeL': 14.938, 'eval_rougeLsum': 14.9251, 'eval_gen_len': 19.0, 'eval_runtime': 12.0496, 'eval_samples_per_second': 16.598, 'eval_steps_per_second': 1.079, 'epoch': 1.0}
100% 100/100 [00:55<00:00,  2.36it/s]
100% 13/13 [00:11<00:00,  1.25it/s]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK

INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
There were missing keys in the checkpoint model loaded: ['encoder.embed_tokens.weight', 'decoder.embed_tokens.weight', 'lm_head.weight'].
{'train_runtime': 78.2901, 'train_samples_per_second': 10.218, 'train_steps_per_second': 1.277, 'train_loss': 1.2514769697189332, 'epoch': 1.0}
100% 100/100 [01:18<00:00,  1.28it/s]
🚀 INFO   | 2024-03-13 09:16:38 | main:train:204 - Finished training, saving model...
INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
/usr/local/lib/python3.10/dist-packages/transformers/generation/utils.py:1178: UserWarning: Using the model-agnostic default max_length (=20) to control the generation length. We recommend setting max_new_tokens to control the maximum length of the generation.
warnings.warn(
15% 2/13 [00:01<00:05,  1.92it/s]> INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
54% 7/13 [00:05<00:05,  1.19it/s]INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
100% 13/13 [00:11<00:00,  1.18it/s]
🚀 INFO   | 2024-03-13 09:16:54 | main:train:218 - Pushing model to hub...
INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
model.safetensors:   0% 0.00/892M [00:00<?, ?B/s]
rng_state.pth:   0% 0.00/14.2k [00:00<?, ?B/s]

optimizer.pt:   0% 0.00/1.78G [00:00<?, ?B/s]
spiece.model:   0% 0.00/792k [00:00<?, ?B/s]
Upload 11 LFS files:   0% 0/11 [00:00<?, ?it/s]
scheduler.pt:   0% 0.00/1.06k [00:00<?, ?B/s]
optimizer.pt:   0% 16.4k/1.78G [00:00<10:59:15, 45.1kB/s]
spiece.model:   2% 16.4k/792k [00:00<00:17, 45.2kB/s]
model.safetensors:   0% 16.4k/892M [00:00<5:48:26, 42.6kB/s]
scheduler.pt: 100% 1.06k/1.06k [00:00<00:00, 2.36kB/s]
rng_state.pth: 100% 14.2k/14.2k [00:00<00:00, 28.2kB/s]
spiece.model: 100% 792k/792k [00:00<00:00, 1.16MB/s]
optimizer.pt:   1% 16.0M/1.78G [00:00<01:03, 28.0MB/s]
optimizer.pt:   1% 25.4M/1.78G [00:00<00:41, 42.6MB/s]
model.safetensors:   2% 16.0M/892M [00:00<00:39, 22.0MB/s]
training_args.bin: 100% 5.05k/5.05k [00:00<00:00, 86.1kB/s]
model.safetensors:   3% 22.9M/892M [00:01<00:27, 31.1MB/s]
events.out.tfevents.1710321319.a7547a852de5.7919.0: 100% 10.6k/10.6k [00:00<00:00, 91.3kB/s]
events.out.tfevents.1710321414.a7547a852de5.7919.1:   0% 0.00/603 [00:00<?, ?B/s]
model.safetensors:   1% 8.21M/892M [00:00<00:25, 35.0MB/s]
events.out.tfevents.1710321414.a7547a852de5.7919.1: 100% 603/603 [00:00<00:00, 5.20kB/s]
model.safetensors:   2% 14.6M/892M [00:00<00:19, 45.0MB/s]
spiece.model:   0% 0.00/792k [00:00<?, ?B/s]
model.safetensors:   4% 32.0M/892M [00:01<00:34, 25.0MB/s]
model.safetensors:   2% 19.2M/892M [00:00<00:29, 29.3MB/s]
spiece.model: 100% 792k/792k [00:00<00:00, 2.65MB/s]
model.safetensors:   5% 40.8M/892M [00:01<00:25, 33.7MB/s]
training_args.bin: 100% 5.05k/5.05k [00:00<00:00, 65.7kB/s]
model.safetensors:   3% 24.2M/892M [00:00<00:27, 31.7MB/s]
model.safetensors:   5% 46.4M/892M [00:01<00:23, 35.8MB/s]
model.safetensors:   3% 28.2M/892M [00:00<00:25, 33.6MB/s]
optimizer.pt:   3% 61.0M/1.78G [00:01<00:41, 41.5MB/s]
model.safetensors:   6% 51.0M/892M [00:01<00:27, 30.7MB/s]
model.safetensors:   7% 62.1M/892M [00:02<00:18, 45.0MB/s]
optimizer.pt:   4% 73.6M/1.78G [00:02<00:41, 41.7MB/s]
model.safetensors:   8% 68.1M/892M [00:02<00:26, 31.5MB/s]
model.safetensors:   4% 39.4M/892M [00:01<00:44, 19.1MB/s]
model.safetensors:   9% 79.0M/892M [00:02<00:19, 42.3MB/s]
optimizer.pt:   5% 87.1M/1.78G [00:02<00:47, 35.9MB/s]
model.safetensors:   5% 44.3M/892M [00:01<00:36, 23.2MB/s]
model.safetensors:  10% 84.9M/892M [00:02<00:24, 32.9MB/s]
model.safetensors:  11% 94.4M/892M [00:02<00:19, 41.0MB/s]
optimizer.pt:   6% 101M/1.78G [00:02<00:46, 36.2MB/s]
model.safetensors:   6% 54.1M/892M [00:02<00:32, 25.7MB/s]
optimizer.pt:   6% 107M/1.78G [00:03<00:42, 39.8MB/s]
model.safetensors:  11% 100M/892M [00:03<00:24, 33.0MB/s]
model.safetensors:  13% 112M/892M [00:03<00:17, 45.7MB/s]
model.safetensors:  13% 118M/892M [00:03<00:21, 35.5MB/s]
model.safetensors:  14% 127M/892M [00:03<00:17, 43.4MB/s]
optimizer.pt:   7% 128M/1.78G [00:03<00:50, 32.6MB/s]
model.safetensors:   8% 72.9M/892M [00:02<00:33, 24.5MB/s]
optimizer.pt:   8% 135M/1.78G [00:03<00:42, 38.6MB/s]
model.safetensors:  15% 133M/892M [00:04<00:23, 32.3MB/s]
model.safetensors:   9% 80.0M/892M [00:03<00:34, 23.6MB/s]
optimizer.pt:   8% 147M/1.78G [00:04<00:45, 35.8MB/s]
model.safetensors:  10% 88.4M/892M [00:03<00:25, 31.3MB/s]
model.safetensors:  16% 144M/892M [00:04<00:20, 36.0MB/s]
model.safetensors:  11% 95.0M/892M [00:03<00:21, 36.8MB/s]
model.safetensors:  18% 160M/892M [00:04<00:15, 45.9MB/s]
model.safetensors:  11% 100M/892M [00:03<00:26, 30.3MB/s] INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
optimizer.pt:   9% 162M/1.78G [00:04<00:52, 30.8MB/s]
model.safetensors:  12% 111M/892M [00:03<00:17, 44.5MB/s]> INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
model.safetensors:  19% 165M/892M [00:04<00:20, 36.3MB/s]
model.safetensors:  19% 172M/892M [00:05<00:18, 39.3MB/s]
model.safetensors:  14% 124M/892M [00:04<00:19, 40.3MB/s]
model.safetensors:  20% 177M/892M [00:05<00:21, 33.7MB/s]
model.safetensors:  21% 187M/892M [00:05<00:15, 46.4MB/s]
model.safetensors:  14% 129M/892M [00:04<00:22, 34.2MB/s]
optimizer.pt:  11% 190M/1.78G [00:05<00:41, 38.1MB/s]
model.safetensors:  15% 135M/892M [00:04<00:20, 36.4MB/s]
model.safetensors:  22% 193M/892M [00:05<00:19, 35.6MB/s]
model.safetensors:  23% 204M/892M [00:05<00:14, 47.1MB/s]
optimizer.pt:  11% 201M/1.78G [00:05<00:42, 37.3MB/s]
model.safetensors:  17% 149M/892M [00:04<00:21, 35.1MB/s]
model.safetensors:  24% 210M/892M [00:05<00:16, 41.0MB/s]
model.safetensors:  17% 155M/892M [00:05<00:19, 38.1MB/s]
model.safetensors:  24% 215M/892M [00:06<00:15, 42.6MB/s]
model.safetensors:  25% 221M/892M [00:06<00:15, 43.3MB/s]
model.safetensors:  18% 160M/892M [00:05<00:22, 33.0MB/s]
model.safetensors:  18% 164M/892M [00:05<00:21, 34.2MB/s]
optimizer.pt:  12% 222M/1.78G [00:06<00:39, 40.0MB/s]
model.safetensors:  19% 172M/892M [00:05<00:16, 44.2MB/s]
model.safetensors:  25% 226M/892M [00:06<00:24, 27.1MB/s]
model.safetensors:  20% 177M/892M [00:05<00:20, 35.6MB/s]
model.safetensors:  26% 232M/892M [00:06<00:21, 30.7MB/s]
model.safetensors:  27% 237M/892M [00:06<00:19, 32.8MB/s]
model.safetensors:  21% 190M/892M [00:05<00:16, 42.8MB/s]
model.safetensors:  27% 241M/892M [00:07<00:22, 29.1MB/s]
model.safetensors:  22% 195M/892M [00:06<00:18, 37.1MB/s]
model.safetensors:  28% 247M/892M [00:07<00:19, 33.4MB/s]
model.safetensors:  28% 252M/892M [00:07<00:17, 36.9MB/s]
model.safetensors:  23% 207M/892M [00:06<00:16, 41.6MB/s]
optimizer.pt:  15% 260M/1.78G [00:07<00:42, 35.8MB/s]
model.safetensors:  29% 256M/892M [00:07<00:21, 29.4MB/s]
model.safetensors:  30% 264M/892M [00:07<00:16, 37.3MB/s]
model.safetensors:  30% 271M/892M [00:07<00:14, 43.1MB/s]
model.safetensors:  25% 223M/892M [00:06<00:15, 41.9MB/s]
optimizer.pt:  15% 276M/1.78G [00:07<00:42, 35.1MB/s]
optimizer.pt:  16% 287M/1.78G [00:07<00:32, 46.5MB/s]
model.safetensors:  31% 276M/892M [00:08<00:20, 30.1MB/s]
model.safetensors:  32% 282M/892M [00:08<00:17, 34.5MB/s]
optimizer.pt:  16% 294M/1.78G [00:08<00:39, 37.4MB/s]
optimizer.pt:  17% 301M/1.78G [00:08<00:34, 43.0MB/s]
model.safetensors:  27% 244M/892M [00:07<00:18, 34.7MB/s]
model.safetensors:  32% 288M/892M [00:08<00:22, 27.3MB/s]
model.safetensors:  34% 300M/892M [00:08<00:13, 42.9MB/s]
optimizer.pt:  17% 312M/1.78G [00:08<00:39, 36.8MB/s]
model.safetensors:  29% 262M/892M [00:07<00:16, 38.4MB/s]
model.safetensors:  34% 306M/892M [00:08<00:16, 35.2MB/s]
model.safetensors:  35% 313M/892M [00:08<00:14, 39.8MB/s]
optimizer.pt:  18% 325M/1.78G [00:09<00:42, 34.5MB/s]
model.safetensors:  31% 275M/892M [00:08<00:15, 39.0MB/s]
optimizer.pt:  19% 331M/1.78G [00:09<00:36, 39.6MB/s]
model.safetensors:  36% 320M/892M [00:09<00:17, 32.5MB/s]
model.safetensors:  37% 329M/892M [00:09<00:13, 41.9MB/s]
optimizer.pt:  19% 336M/1.78G [00:09<00:44, 32.5MB/s]
model.safetensors:  33% 290M/892M [00:08<00:16, 36.7MB/s]
optimizer.pt:  19% 344M/1.78G [00:09<00:35, 40.7MB/s]
model.safetensors:  33% 296M/892M [00:08<00:15, 37.5MB/s]
optimizer.pt:  20% 350M/1.78G [00:09<00:33, 43.0MB/s]> INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
model.safetensors:  38% 336M/892M [00:09<00:16, 34.6MB/s]
model.safetensors:  39% 344M/892M [00:09<00:13, 40.6MB/s]
model.safetensors:  39% 350M/892M [00:09<00:12, 44.7MB/s]
optimizer.pt:  20% 363M/1.78G [00:09<00:32, 43.2MB/s]
model.safetensors:  35% 308M/892M [00:09<00:18, 31.1MB/s]
model.safetensors:  40% 356M/892M [00:10<00:14, 36.4MB/s]
model.safetensors:  41% 363M/892M [00:10<00:12, 43.2MB/s]
model.safetensors:  41% 368M/892M [00:10<00:15, 33.7MB/s]
optimizer.pt:  22% 384M/1.78G [00:10<00:37, 36.9MB/s]
model.safetensors:  43% 382M/892M [00:10<00:09, 51.9MB/s]
model.safetensors:  37% 327M/892M [00:09<00:20, 27.3MB/s]
optimizer.pt:  22% 391M/1.78G [00:10<00:34, 40.6MB/s]
model.safetensors:  37% 332M/892M [00:09<00:18, 30.6MB/s]
model.safetensors:  44% 389M/892M [00:10<00:13, 37.6MB/s]
model.safetensors:  38% 336M/892M [00:10<00:20, 27.1MB/s]
optimizer.pt:  23% 403M/1.78G [00:10<00:37, 36.6MB/s]
model.safetensors:  38% 343M/892M [00:10<00:15, 34.8MB/s]
optimizer.pt:  23% 407M/1.78G [00:11<00:35, 38.5MB/s]
model.safetensors:  39% 350M/892M [00:10<00:13, 40.0MB/s]
model.safetensors:  46% 411M/892M [00:11<00:10, 45.1MB/s]
optimizer.pt:  23% 419M/1.78G [00:11<00:38, 35.8MB/s]
optimizer.pt:  24% 428M/1.78G [00:11<00:29, 46.6MB/s]
model.safetensors:  47% 417M/892M [00:11<00:11, 40.7MB/s]
model.safetensors:  47% 423M/892M [00:11<00:10, 43.9MB/s]
optimizer.pt:  24% 433M/1.78G [00:11<00:36, 37.5MB/s]
model.safetensors:  48% 431M/892M [00:11<00:09, 47.9MB/s]
optimizer.pt:  25% 439M/1.78G [00:11<00:33, 39.6MB/s]
model.safetensors:  49% 436M/892M [00:12<00:12, 37.6MB/s]
model.safetensors:  50% 445M/892M [00:12<00:10, 44.3MB/s]
optimizer.pt:  25% 448M/1.78G [00:12<00:38, 34.7MB/s]
model.safetensors:  43% 382M/892M [00:11<00:12, 39.7MB/s]
model.safetensors:  50% 450M/892M [00:12<00:11, 38.9MB/s]
model.safetensors:  51% 457M/892M [00:12<00:09, 44.5MB/s]
model.safetensors:  52% 464M/892M [00:12<00:08, 47.6MB/s]
optimizer.pt:  26% 464M/1.78G [00:12<00:36, 36.4MB/s]
model.safetensors:  45% 397M/892M [00:11<00:12, 38.9MB/s]
model.safetensors:  54% 478M/892M [00:12<00:08, 48.0MB/s]
optimizer.pt:  27% 480M/1.78G [00:12<00:33, 38.8MB/s]
model.safetensors:  45% 401M/892M [00:12<00:20, 23.4MB/s]
optimizer.pt:  28% 494M/1.78G [00:13<00:22, 56.3MB/s]
model.safetensors:  54% 484M/892M [00:13<00:11, 35.4MB/s]
model.safetensors:  55% 489M/892M [00:13<00:10, 36.8MB/s]
model.safetensors:  55% 494M/892M [00:13<00:09, 40.2MB/s]
model.safetensors:  47% 416M/892M [00:12<00:17, 27.4MB/s]
model.safetensors:  56% 499M/892M [00:13<00:11, 35.0MB/s]
model.safetensors:  56% 503M/892M [00:13<00:10, 35.7MB/s]
optimizer.pt:  29% 519M/1.78G [00:13<00:30, 41.4MB/s]
model.safetensors:  57% 510M/892M [00:13<00:09, 41.7MB/s]
optimizer.pt:  30% 526M/1.78G [00:13<00:29, 43.2MB/s]
model.safetensors:  58% 515M/892M [00:13<00:09, 38.8MB/s]
model.safetensors:  50% 446M/892M [00:13<00:10, 42.4MB/s]
model.safetensors:  58% 519M/892M [00:14<00:09, 38.2MB/s]
model.safetensors:  59% 524M/892M [00:14<00:09, 38.0MB/s]
model.safetensors:  51% 451M/892M [00:13<00:12, 36.7MB/s]
model.safetensors:  51% 456M/892M [00:13<00:11, 36.6MB/s]
model.safetensors:  59% 528M/892M [00:14<00:12, 28.4MB/s]
model.safetensors:  60% 536M/892M [00:14<00:09, 37.8MB/s]
model.safetensors:  61% 542M/892M [00:14<00:08, 42.2MB/s]> INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
model.safetensors:  53% 472M/892M [00:13<00:10, 39.9MB/s]
optimizer.pt:  31% 561M/1.78G [00:14<00:33, 37.0MB/s]INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
model.safetensors:  62% 553M/892M [00:15<00:09, 36.8MB/s]
model.safetensors:  54% 480M/892M [00:14<00:12, 33.8MB/s]
model.safetensors:  55% 489M/892M [00:14<00:09, 42.9MB/s]
optimizer.pt:  32% 576M/1.78G [00:15<00:32, 36.8MB/s]
model.safetensors:  63% 560M/892M [00:15<00:11, 27.9MB/s]
model.safetensors:  56% 496M/892M [00:14<00:10, 37.6MB/s]
model.safetensors:  57% 505M/892M [00:14<00:08, 45.8MB/s]
model.safetensors:  64% 571M/892M [00:15<00:08, 38.3MB/s]
model.safetensors:  57% 511M/892M [00:14<00:08, 45.6MB/s]
model.safetensors:  65% 576M/892M [00:15<00:10, 30.9MB/s]
model.safetensors:  66% 586M/892M [00:15<00:07, 41.9MB/s]
model.safetensors:  59% 523M/892M [00:15<00:08, 41.8MB/s]
model.safetensors:  66% 592M/892M [00:16<00:08, 35.7MB/s]
optimizer.pt:  35% 621M/1.78G [00:16<00:24, 46.8MB/s]
model.safetensors:  67% 599M/892M [00:16<00:07, 41.6MB/s]
model.safetensors:  68% 606M/892M [00:16<00:06, 45.2MB/s]
optimizer.pt:  35% 628M/1.78G [00:16<00:30, 37.7MB/s]
model.safetensors:  69% 612M/892M [00:16<00:06, 40.9MB/s]
model.safetensors:  69% 616M/892M [00:16<00:06, 42.2MB/s]
model.safetensors:  70% 624M/892M [00:16<00:06, 39.4MB/s]
model.safetensors:  72% 639M/892M [00:17<00:04, 52.9MB/s]
optimizer.pt:  37% 657M/1.78G [00:17<00:29, 38.7MB/s]
model.safetensors:  72% 645M/892M [00:17<00:05, 43.7MB/s]
optimizer.pt:  38% 669M/1.78G [00:17<00:22, 49.2MB/s]
model.safetensors:  73% 650M/892M [00:17<00:05, 40.9MB/s]
optimizer.pt:  38% 675M/1.78G [00:17<00:25, 42.8MB/s]
model.safetensors:  74% 656M/892M [00:17<00:06, 36.6MB/s]
model.safetensors:  74% 663M/892M [00:17<00:05, 44.0MB/s]
model.safetensors:  63% 560M/892M [00:16<00:15, 21.6MB/s]
model.safetensors:  75% 669M/892M [00:17<00:05, 44.5MB/s]
model.safetensors:  64% 567M/892M [00:16<00:12, 26.8MB/s]
model.safetensors:  65% 576M/892M [00:17<00:08, 37.4MB/s]
model.safetensors:  76% 681M/892M [00:18<00:04, 46.4MB/s]
model.safetensors:  77% 686M/892M [00:18<00:04, 47.3MB/s]
model.safetensors:  78% 691M/892M [00:18<00:04, 41.6MB/s]
model.safetensors:  65% 581M/892M [00:17<00:13, 22.3MB/s]
model.safetensors:  79% 700M/892M [00:18<00:04, 43.0MB/s]
optimizer.pt:  40% 717M/1.78G [00:18<00:26, 39.9MB/s]
model.safetensors:  66% 585M/892M [00:17<00:13, 23.5MB/s]
model.safetensors:  66% 591M/892M [00:17<00:10, 28.2MB/s]
model.safetensors:  79% 705M/892M [00:18<00:06, 29.3MB/s]
model.safetensors:  67% 595M/892M [00:18<00:11, 26.0MB/s]
model.safetensors:  80% 711M/892M [00:19<00:05, 35.2MB/s]
model.safetensors:  80% 715M/892M [00:19<00:04, 36.6MB/s]
optimizer.pt:  41% 734M/1.78G [00:19<00:26, 39.4MB/s]
model.safetensors:  68% 605M/892M [00:18<00:09, 31.6MB/s]
model.safetensors:  81% 720M/892M [00:19<00:06, 26.5MB/s]
model.safetensors:  68% 609M/892M [00:18<00:10, 26.6MB/s]
optimizer.pt:  42% 749M/1.78G [00:19<00:24, 41.8MB/s]
model.safetensors:  82% 727M/892M [00:19<00:05, 32.5MB/s]> INFO    Running jobs: [7899]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
model.safetensors:  82% 733M/892M [00:19<00:04, 35.3MB/s]
optimizer.pt:  42% 754M/1.78G [00:19<00:35, 29.3MB/s]
model.safetensors:  83% 737M/892M [00:19<00:05, 29.9MB/s]
model.safetensors:  83% 742M/892M [00:20<00:04, 34.3MB/s]
model.safetensors:  84% 748M/892M [00:20<00:03, 38.1MB/s]
model.safetensors:  71% 637M/892M [00:19<00:06, 38.2MB/s]
optimizer.pt:  43% 770M/1.78G [00:20<00:30, 33.0MB/s]
model.safetensors:  84% 752M/892M [00:20<00:04, 28.8MB/s]
model.safetensors:  85% 760M/892M [00:20<00:03, 39.1MB/s]
model.safetensors:  86% 766M/892M [00:20<00:03, 41.7MB/s]
model.safetensors:  73% 654M/892M [00:19<00:05, 40.2MB/s]
model.safetensors:  86% 771M/892M [00:20<00:03, 37.9MB/s]
model.safetensors:  87% 777M/892M [00:20<00:02, 42.4MB/s]
model.safetensors:  88% 782M/892M [00:20<00:02, 43.7MB/s]
model.safetensors:  74% 664M/892M [00:20<00:06, 34.3MB/s]
model.safetensors:  75% 672M/892M [00:20<00:05, 43.8MB/s]
model.safetensors:  88% 787M/892M [00:21<00:03, 34.4MB/s]
model.safetensors:  89% 793M/892M [00:21<00:02, 41.9MB/s]
model.safetensors:  90% 799M/892M [00:21<00:02, 44.6MB/s]
optimizer.pt:  46% 819M/1.78G [00:21<00:26, 36.9MB/s]
model.safetensors:  77% 685M/892M [00:20<00:05, 38.7MB/s]
optimizer.pt:  46% 825M/1.78G [00:21<00:24, 39.8MB/s]
model.safetensors:  77% 690M/892M [00:20<00:06, 33.2MB/s]
model.safetensors:  79% 702M/892M [00:20<00:03, 50.1MB/s]
optimizer.pt:  47% 832M/1.78G [00:21<00:28, 33.1MB/s]
optimizer.pt:  47% 846M/1.78G [00:21<00:18, 50.3MB/s]
model.safetensors:  79% 709M/892M [00:21<00:04, 42.4MB/s]
model.safetensors:  81% 720M/892M [00:21<00:03, 56.4MB/s]
optimizer.pt:  48% 853M/1.78G [00:22<00:21, 42.9MB/s]
optimizer.pt:  48% 864M/1.78G [00:22<00:23, 39.3MB/s]
model.safetensors:  82% 727M/892M [00:21<00:04, 34.0MB/s]
optimizer.pt:  49% 873M/1.78G [00:22<00:19, 45.6MB/s]
model.safetensors:  82% 733M/892M [00:21<00:04, 36.3MB/s]
model.safetensors:  91% 816M/892M [00:22<00:04, 18.3MB/s]
model.safetensors:  83% 738M/892M [00:22<00:05, 29.4MB/s]
optimizer.pt:  50% 885M/1.78G [00:22<00:22, 39.9MB/s]
model.safetensors:  83% 744M/892M [00:22<00:04, 34.3MB/s]
optimizer.pt:  50% 891M/1.78G [00:23<00:21, 41.9MB/s]
model.safetensors:  92% 822M/892M [00:23<00:03, 18.0MB/s]
optimizer.pt:  50% 896M/1.78G [00:23<00:26, 33.0MB/s]
model.safetensors:  93% 832M/892M [00:23<00:02, 26.5MB/s]
optimizer.pt:  51% 902M/1.78G [00:23<00:23, 37.4MB/s]
model.safetensors:  85% 759M/892M [00:22<00:03, 35.1MB/s]
optimizer.pt:  51% 909M/1.78G [00:23<00:20, 42.1MB/s]
model.safetensors:  94% 838M/892M [00:23<00:02, 24.7MB/s]
optimizer.pt:  51% 914M/1.78G [00:23<00:26, 32.4MB/s]
optimizer.pt:  52% 927M/1.78G [00:23<00:17, 49.7MB/s]
model.safetensors:  95% 848M/892M [00:24<00:01, 26.0MB/s]
model.safetensors:  96% 857M/892M [00:24<00:01, 32.1MB/s]
model.safetensors:  97% 862M/892M [00:24<00:00, 34.4MB/s]
optimizer.pt:  53% 938M/1.78G [00:24<00:21, 38.9MB/s]
model.safetensors:  88% 784M/892M [00:23<00:03, 29.1MB/s]
model.safetensors:  89% 793M/892M [00:23<00:02, 38.7MB/s]
optimizer.pt:  53% 944M/1.78G [00:24<00:24, 33.8MB/s]
optimizer.pt:  54% 957M/1.78G [00:24<00:16, 51.6MB/s]
model.safetensors:  97% 867M/892M [00:24<00:01, 22.0MB/s]
model.safetensors:  98% 873M/892M [00:24<00:00, 26.1MB/s]
model.safetensors:  91% 814M/892M [00:24<00:01, 44.3MB/s]
model.safetensors:  99% 879M/892M [00:25<00:00, 29.1MB/s]
optimizer.pt:  54% 970M/1.78G [00:25<00:19, 41.3MB/s]
model.safetensors: 100% 889M/892M [00:25<00:00, 32.8MB/s]
model.safetensors:  93% 827M/892M [00:24<00:01, 41.4MB/s]
optimizer.pt:  55% 976M/1.78G [00:25<00:22, 35.3MB/s]
optimizer.pt:  55% 983M/1.78G [00:25<00:20, 39.6MB/s]
model.safetensors: 100% 892M/892M [00:25<00:00, 34.8MB/s]
model.safetensors:  94% 842M/892M [00:24<00:01, 48.6MB/s]
optimizer.pt:  56% 992M/1.78G [00:25<00:24, 32.6MB/s]
model.safetensors:  95% 848M/892M [00:24<00:01, 40.8MB/s]
optimizer.pt:  56% 1.00G/1.78G [00:25<00:18, 42.0MB/s]
model.safetensors:  96% 856M/892M [00:25<00:00, 48.8MB/s]
Upload 11 LFS files:   9% 1/11 [00:25<04:19, 25.95s/it]
optimizer.pt:  56% 1.01G/1.78G [00:26<00:17, 44.3MB/s]
model.safetensors:  97% 862M/892M [00:25<00:00, 49.3MB/s]
optimizer.pt:  57% 1.01G/1.78G [00:26<00:19, 39.1MB/s]
model.safetensors:  97% 868M/892M [00:25<00:00, 41.6MB/s]
optimizer.pt:  57% 1.02G/1.78G [00:26<00:17, 42.6MB/s]
model.safetensors:  98% 874M/892M [00:25<00:00, 44.6MB/s]
model.safetensors:  99% 880M/892M [00:25<00:00, 37.8MB/s]
optimizer.pt:  57% 1.02G/1.78G [00:26<00:22, 33.6MB/s]
model.safetensors: 100% 889M/892M [00:25<00:00, 49.3MB/s]
optimizer.pt:  58% 1.03G/1.78G [00:26<00:18, 40.2MB/s]
model.safetensors: 100% 892M/892M [00:25<00:00, 34.3MB/s]
optimizer.pt:  59% 1.05G/1.78G [00:27<00:18, 39.9MB/s]
optimizer.pt:  59% 1.06G/1.78G [00:27<00:21, 33.9MB/s]
optimizer.pt:  60% 1.07G/1.78G [00:27<00:14, 48.8MB/s]
optimizer.pt:  60% 1.08G/1.78G [00:27<00:18, 38.0MB/s]
optimizer.pt:  61% 1.09G/1.78G [00:27<00:14, 49.0MB/s]
optimizer.pt:  61% 1.09G/1.78G [00:28<00:16, 42.4MB/s]
optimizer.pt:  62% 1.10G/1.78G [00:28<00:16, 41.0MB/s]
optimizer.pt:  63% 1.12G/1.78G [00:28<00:11, 56.8MB/s]
optimizer.pt:  63% 1.13G/1.78G [00:29<00:19, 33.8MB/s]
optimizer.pt:  64% 1.14G/1.78G [00:29<00:18, 35.4MB/s]
optimizer.pt:  65% 1.15G/1.78G [00:29<00:12, 49.1MB/s]
optimizer.pt:  65% 1.16G/1.78G [00:29<00:13, 46.1MB/s]
optimizer.pt:  65% 1.17G/1.78G [00:30<00:17, 35.1MB/s]
optimizer.pt:  66% 1.18G/1.78G [00:30<00:12, 48.2MB/s]
optimizer.pt:  67% 1.19G/1.78G [00:30<00:14, 41.5MB/s]
optimizer.pt:  67% 1.20G/1.78G [00:30<00:16, 36.1MB/s]
optimizer.pt:  68% 1.21G/1.78G [00:30<00:11, 49.6MB/s]
optimizer.pt:  69% 1.22G/1.78G [00:31<00:15, 35.9MB/s]
optimizer.pt:  69% 1.23G/1.78G [00:31<00:18, 29.2MB/s]
optimizer.pt:  70% 1.25G/1.78G [00:31<00:12, 41.6MB/s]
optimizer.pt:  70% 1.25G/1.78G [00:32<00:13, 38.2MB/s]
optimizer.pt:  71% 1.26G/1.78G [00:32<00:12, 40.6MB/s]
optimizer.pt:  72% 1.28G/1.78G [00:32<00:09, 53.3MB/s]
optimizer.pt:  72% 1.28G/1.78G [00:32<00:10, 47.6MB/s]
optimizer.pt:  73% 1.30G/1.78G [00:33<00:11, 42.7MB/s]
optimizer.pt:  73% 1.31G/1.78G [00:33<00:08, 56.5MB/s]
optimizer.pt:  74% 1.32G/1.78G [00:33<00:09, 46.9MB/s]
optimizer.pt:  74% 1.33G/1.78G [00:33<00:14, 31.7MB/s]
optimizer.pt:  75% 1.34G/1.78G [00:34<00:09, 44.1MB/s]
optimizer.pt:  76% 1.35G/1.78G [00:34<00:12, 34.9MB/s]
optimizer.pt:  76% 1.36G/1.78G [00:34<00:11, 35.3MB/s]
optimizer.pt:  77% 1.37G/1.78G [00:34<00:08, 47.7MB/s]
optimizer.pt:  77% 1.38G/1.78G [00:35<00:09, 41.2MB/s]
optimizer.pt:  78% 1.39G/1.78G [00:35<00:12, 30.8MB/s]
optimizer.pt:  79% 1.41G/1.78G [00:35<00:08, 43.1MB/s]
optimizer.pt:  79% 1.41G/1.78G [00:36<00:09, 40.6MB/s]
optimizer.pt:  80% 1.42G/1.78G [00:36<00:10, 35.8MB/s]
optimizer.pt:  81% 1.44G/1.78G [00:36<00:07, 49.1MB/s]
optimizer.pt:  81% 1.45G/1.78G [00:36<00:07, 42.8MB/s]
optimizer.pt:  82% 1.46G/1.78G [00:37<00:08, 39.9MB/s]
optimizer.pt:  82% 1.47G/1.78G [00:37<00:05, 53.8MB/s]
optimizer.pt:  83% 1.48G/1.78G [00:37<00:07, 43.4MB/s]
optimizer.pt:  83% 1.49G/1.78G [00:37<00:07, 38.8MB/s]
optimizer.pt:  84% 1.50G/1.78G [00:37<00:05, 52.5MB/s]
optimizer.pt:  85% 1.51G/1.78G [00:38<00:07, 38.2MB/s]
optimizer.pt:  85% 1.52G/1.78G [00:38<00:07, 35.6MB/s]
optimizer.pt:  86% 1.53G/1.78G [00:38<00:05, 48.5MB/s]
optimizer.pt:  86% 1.54G/1.78G [00:39<00:06, 39.2MB/s]
optimizer.pt:  87% 1.55G/1.78G [00:39<00:05, 38.9MB/s]
optimizer.pt:  88% 1.57G/1.78G [00:39<00:04, 51.7MB/s]
optimizer.pt:  88% 1.57G/1.78G [00:39<00:04, 48.2MB/s]
optimizer.pt:  89% 1.58G/1.78G [00:39<00:04, 40.3MB/s]
optimizer.pt:  90% 1.60G/1.78G [00:40<00:03, 54.1MB/s]
optimizer.pt:  90% 1.61G/1.78G [00:40<00:03, 47.2MB/s]
optimizer.pt:  91% 1.62G/1.78G [00:40<00:04, 36.7MB/s]
optimizer.pt:  91% 1.63G/1.78G [00:40<00:03, 49.6MB/s]
optimizer.pt:  92% 1.64G/1.78G [00:41<00:04, 31.0MB/s]
optimizer.pt:  92% 1.65G/1.78G [00:41<00:04, 30.7MB/s]
optimizer.pt:  93% 1.66G/1.78G [00:41<00:02, 42.7MB/s]
optimizer.pt:  94% 1.67G/1.78G [00:42<00:02, 39.4MB/s]
optimizer.pt:  94% 1.68G/1.78G [00:42<00:02, 47.8MB/s]
optimizer.pt:  95% 1.69G/1.78G [00:42<00:02, 47.7MB/s]
optimizer.pt:  95% 1.70G/1.78G [00:42<00:02, 41.4MB/s]
optimizer.pt:  96% 1.71G/1.78G [00:42<00:01, 56.8MB/s]
optimizer.pt:  96% 1.72G/1.78G [00:43<00:01, 47.8MB/s]
optimizer.pt:  97% 1.73G/1.78G [00:43<00:01, 40.4MB/s]
optimizer.pt:  98% 1.74G/1.78G [00:43<00:00, 54.0MB/s]
optimizer.pt:  98% 1.75G/1.78G [00:43<00:00, 46.2MB/s]
optimizer.pt:  99% 1.76G/1.78G [00:44<00:00, 43.0MB/s]
optimizer.pt:  99% 1.77G/1.78G [00:44<00:00, 56.2MB/s]
optimizer.pt: 100% 1.78G/1.78G [00:44<00:00, 39.8MB/s]
Upload 11 LFS files: 100% 11/11 [00:45<00:00,  4.11s/it]
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK

INFO    Running jobs: [7899]
INFO    Killing PID: 7899
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /accelerators HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK
INFO    Running jobs: []
INFO:     2a02:14f:1f5:eba7:6821:2e7d:a0aa:87b4:0 - "GET /is_model_training HTTP/1.1" 200 OK

Tried several things in a fork https://github.com/tombenj/autotrain-advanced/commits/length/ such as adding max_new_tokens to the model generation:
https://github.com/tombenj/autotrain-advanced/commit/c9741b914c5625ff69b9890c2006964eea285754
As suggested here:
https://www.markhneedham.com/blog/2023/06/19/huggingface-max-length-generation-length-deprecated/
But still getting cut out 20 length token responses:

@abhishekkrthakur can you point to a direction how to resolve this?

ohh those are the default parameters. you can change the default params: https://huggingface.co/docs/hub/models-widgets#example-outputs

can you share the trained model repo?

@abhishekkrthakur yep here is an example:
https://huggingface.co/tombenj/tuple-1k-t5
Getting only 20 tokens as output.

changing params here have no effect: https://huggingface.co/tombenj/tuple-1k-t5/blob/main/config.json#L29 ?

@abhishekkrthakur changed here and getting the same max 20 token output:
https://huggingface.co/tombenj/tuple-1k-t5/commit/f9cfb398c7b1a18f312e5617767bda71c07b587b

@abhishekkrthakur any updates on this?


fix: corrected incorrect jsx attribute on drawer and modal components

hopefully this regex catches everything

find: label for="([\w-]+)" className
replace: label htmlFor="$1" className

Thank you 🙌

nw! I love the library, its saved me so much time. keep up the great work ^^


Update Set-Mailbox.md

Added note note about mailbox audting on by default to AuditEnabled parameter.

Docs Build status updates of commit 1d2ee68:
:clock10: Full build: the average full build time is 11 min(s) 52 sec(s), this is based on the last 893 build(s) for this repository.

Docs Build status updates of commit 1d2ee68:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

exchange/exchange-ps/exchange/mailboxes/Set-Mailbox.md
:white_check_mark:Succeeded
View (exchange-ps)

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.

Docs Build status updates of commit 945bf55:
:clock10: Full build: the average full build time is 11 min(s) 52 sec(s), this is based on the last 897 build(s) for this repository.

Docs Build status updates of commit 945bf55:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

exchange/exchange-ps/exchange/mailboxes/Set-Mailbox.md
:white_check_mark:Succeeded
View (exchange-ps)

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


6.0.0 beta railties dependency

Any chance you could bump the railties dependency of the beta to < 6? Currently, it messes up with Rails 5 because it will only work with railties < 5.0

Blocker for me as well...

Another ++

+1

Pretty sure this was fixed via https://github.com/rails/sass-rails/commit/acff4b407f7a74ae562966e5f481a84750f06242.
@arthurnn Do you know why 6.0.0 is still not released?

@rafaelfranca @arthurnn is this gem still being maintained?

Can we get a 6.0.0 release?

We don't need a 6.0.0 release just yet. 5.0 is the stable release and it works with Rails 5.1. sass-rails 6.0.x depends on sprockets 4 and sprockets 4 is not stable yet so we can't release. Please use sass-rails 5.0.x unless you need sprockets 4.


As a developer I want to explore TaskCat to test CloudFormation templates

Link to TaskCat: https://github.com/aws-quickstart/taskcat

This is not a real test as TaskCat tests an AWS CloudFormation template by deploying it in multiple AWS Regions simultaneously and generates a report with a pass/fail result for each Region.