[Package Issue Report]: [Question]: get python311Packages.django python311Packages.ipython working together

Are you requesting a new package or reporting an issue on an existing one?
Existing
If reporting an issue on an existing one, what is the name of the package?
python311Packages.django python311Packages.ipython
What changes are you requesting?
I am trying to test out options 2(explained in the context section below)
When installing any python package like django from nix, ipython or regular python interpreter cannot seem to see the package. This makes sense because the package is probably not linked with PYTHON_PATH
Nix seems to use withPackages as the solution
Is there a way to do something similar with devbox?
We can also create a plugin but then it will bypass devbox's benefits of being able to install packages from different nixpkgs version
Additional context
I am trying to evaluate a few option of adopting nix/devbox for an internal project. Two ways that we are thinking of:

Use devbox to install python. Then continue to use pip/pip-compile to manage package
Use devbox to install python and its related dependencies

(still learning about the nix ecosystems so any feedbacks or recommendations are appreciated)
Really leaning toward options 2 since we can start using things like caching from the nix eco system

Hey @dephiros, you're right that Nix expects developers to use the withPackages or withExtensions method that most of these packages are bundled with. Unfortunately, a lot of those methods aren't very compatible with setting the version of the subpackages (like django or ipython) that you want to include. We're working on some ways to expose these methods while also letting developers pin or select the versions they need.
For now, I'd recommend leaning towards option 1 -- installing python, then using pip to manage the packages in a virtual environment with venv. Our plugin for Python sets up the virtual environment automatically to support this.

Thanks for the response @Lagoja .
I have a follow-up question.
I am trying to install psycopg2 with pip and it requires openssl.
I tried installing openssl but psycopg2 still error pip install psycopg2==2.9.9 --no-binary=psycopg2 and cannot find openssl.
      ld: library not found for -lssl
      clang-11: error: linker command failed with exit code 1 (use -v to see invocation)
      error: command '/nix/store/sa6hywsm1mqfyd1xakyzv4ljjsb3hawh-clang-wrapper-11.1.0/bin/clang' failed with exit code 1

Checking ./.devbox/nix/profile/default/lib which is included in ~LDPATH and I found other lib that I installed like jansson but not openssl
Would you happen to know why this issue happen?

@dephiros could you try adding "flake:nixpkgs#openssl^bin,dev" to the list of packages in your devbox.json and then installing psycopg2 again? For example:
devbox.json
{
  "packages": [
<EMAIL_ADDRESS>    "python311Packages.pip",
    "postgresql@latest",
    "flake:nixpkgs#openssl^bin,dev"
  ]
}

$ devbox shell
(devbox) $ . $VENV_DIR/bin/activate
(.venv) (devbox) $ pip install psycopg2==2.9.9 --no-binary=psycopg2
(.venv) (devbox) $ python
Python 3.11.6 (main, Oct  2 2023, 13:45:54) [Clang 16.0.6 ] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import psycopg2
>>> psycopg2
<module 'psycopg2' from '/var/folders/79/1yc1ywp10w9f2xnr_rpp_ff00000gn/T/tmp.FFwpDXdvJi/.devbox/virtenv/python311Packages.pip/.venv/lib/python3.11/site-packages/psycopg2/__init__.py'>

@gcurtis , thank you for the suggestion
I tried "flake:nixpkgs#openssl^bin,dev" but devbox does not seem to like the flake: syntax
Based on the doc, I tried github:NixOS/nixpkgs/23.11#openssl^bin,dev but devbox does not seem to like the ^`
Error: error searching for pkg github:NixOS/nixpkgs/23.11#openssl%5Edev,bin: exit status 1

2024/01/10 13:08:43 Command stderr: error: flake 'github:NixOS/nixpkgs/23.11' does not provide attribute 'packages.aarch64-darwin.openssl^dev,bin', 'legacyPackages.aarch64-darwin.openssl^dev,bin' or 'openssl^dev,bin'

Ended up trying:
    "github:NixOS/nixpkgs/23.11#openssl.dev",
    "github:NixOS/nixpkgs/23.11#openssl.bin"

and psycopg2 seems to install now. Do you think it is a bug in devbox to not support github:NixOS/nixpkgs/23.11#openssl^bin,dev. I could not find a documentation on the ^ but this comment makes me think it is a valid flake url syntax

Sorry to keep piling on this issue(let me know if I should create a separate one)
I am trying to install pycurl next. Using the same strategy to install curl, I get the errors:
      clang -bundle -undefined dynamic_lookup -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-zlib-1.3/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-bzip2-1.0.8/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-expat-2.5.0/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-xz-5.4.4/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-libffi-3.4.4/lib -L/nix/store/jxgh20m58s1nwzficc9h8iz9rbaszzbl-libxcrypt-4.4.36/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-gdbm-1.23/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-sqlite-3.43.2/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-readline-8.2p1/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-ncurses-6.4/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-openssl-3.0.12/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-apple-framework-SystemConfiguration-11.0.0/lib -L/nix/store/my3y0ixd8sy1g6vslrhj3i609vvhz5wp-tzdata-2023c/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-zlib-1.3/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-bzip2-1.0.8/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-expat-2.5.0/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-xz-5.4.4/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-libffi-3.4.4/lib -L/nix/store/jxgh20m58s1nwzficc9h8iz9rbaszzbl-libxcrypt-4.4.36/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-gdbm-1.23/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-sqlite-3.43.2/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-readline-8.2p1/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-ncurses-6.4/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-openssl-3.0.12/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-apple-framework-SystemConfiguration-11.0.0/lib -L/nix/store/my3y0ixd8sy1g6vslrhj3i609vvhz5wp-tzdata-2023c/lib build/temp.macosx-11.0-arm64-cpython-311/src/docstrings.o build/temp.macosx-11.0-arm64-cpython-311/src/easy.o build/temp.macosx-11.0-arm64-cpython-311/src/easycb.o build/temp.macosx-11.0-arm64-cpython-311/src/easyinfo.o build/temp.macosx-11.0-arm64-cpython-311/src/easyopt.o build/temp.macosx-11.0-arm64-cpython-311/src/easyperform.o build/temp.macosx-11.0-arm64-cpython-311/src/module.o build/temp.macosx-11.0-arm64-cpython-311/src/multi.o build/temp.macosx-11.0-arm64-cpython-311/src/oscompat.o build/temp.macosx-11.0-arm64-cpython-311/src/pythoncompat.o build/temp.macosx-11.0-arm64-cpython-311/src/share.o build/temp.macosx-11.0-arm64-cpython-311/src/stringcompat.o build/temp.macosx-11.0-arm64-cpython-311/src/threadsupport.o build/temp.macosx-11.0-arm64-cpython-311/src/util.o -L/nix/store/c39qm57grkavw8a4hkramahpnspm1inq-curl-8.4.0/lib -L/nix/store/ai4hd8f1xhr0rfjdr17bxx1rwi42sx97-python3-3.11.6/lib -lssl -lcrypto -lcurl -o build/lib.macosx-11.0-arm64-cpython-311/pycurl.cpython-311-darwin.so -flat_namespace
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-zlib-1.3/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-bzip2-1.0.8/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-expat-2.5.0/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-xz-5.4.4/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-libffi-3.4.4/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-gdbm-1.23/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-sqlite-3.43.2/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-readline-8.2p1/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-ncurses-6.4/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-openssl-3.0.12/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-apple-framework-SystemConfiguration-11.0.0/lib'
      ld: warning: directory not found for option '-L/nix/store/my3y0ixd8sy1g6vslrhj3i609vvhz5wp-tzdata-2023c/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-zlib-1.3/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-bzip2-1.0.8/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-expat-2.5.0/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-xz-5.4.4/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-libffi-3.4.4/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-gdbm-1.23/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-sqlite-3.43.2/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-readline-8.2p1/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-ncurses-6.4/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-openssl-3.0.12/lib'
      ld: warning: directory not found for option '-L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-apple-framework-SystemConfiguration-11.0.0/lib'
      ld: warning: directory not found for option '-L/nix/store/my3y0ixd8sy1g6vslrhj3i609vvhz5wp-tzdata-2023c/lib'
      ld: warning: directory not found for option '-L/Users/annguyen/.local/share/devbox/global/default/.devbox/nix/profile/default/lib'
      ld: file not found: /System/Library/Frameworks/CoreServices.framework/Versions/A/CoreServices for architecture arm64
      clang-11: error: linker command failed with exit code 1 (use -v to see invocation)
      error: command '/nix/store/sa6hywsm1mqfyd1xakyzv4ljjsb3hawh-clang-wrapper-11.1.0/bin/clang' failed with exit code 1
      [end of output]

Any insight here is appreciated 🙏

@dephiros which version of Devbox are you on? You'll need Devbox 0.8.3 or higher for the flake ^ syntax to work. The dot syntax works too, so what you have looks good.
The second error looks like the linker can't find the CoreServices system library. I'm not sure why it's needed, but maybe try installing Xcode command line tools to see if that helps. You can do that by running xcode-select --install or installing and opening Xcode once.
Here are some additional debugging tips for build errors with Nix on macOS:

The clang being invoked is separate from the macOS default clang. Nix wraps it in a shell script. That script injects a bunch of flags so that clang can find the other Nix-installed libraries. If you set NIX_DEBUG=1 (I think it goes up to 7 for more verbosity) the clang wrapper script will print a bunch of debugging info describing the flags it's setting.
The ld warnings with the eeeeeees in them are misleading and you can ignore them. The only real error is the last one with "ld: file not found: ...".

Thanks for your help @gcurtis, I work with @dephiros at the same company.
I was able to take it further with the following devbox.json but now I'm stuck at install xmlsec with pip install xmlsec==1.3.13.
{
  "packages": [
<EMAIL_ADDRESS>    "nodePackages.pnpm@latest",
<EMAIL_ADDRESS>    "postgresql@latest",
    "jq@latest",
<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>    "pkg-config@latest",
    "flake:nixpkgs#xmlsec^out,dev",
    "flake:nixpkgs#openssl^bin,dev",
    "flake:nixpkgs#curl^dev",
    "flake:nixpkgs#cairo^dev"
  ],
  "shell": {
    "init_hook": [". $VENV_DIR/bin/activate"],
    "scripts": {
      "test": ["echo \"Error: no test specified\" && exit 1"]
    }
  }
}

🔋 99% at 15:40:37 ❯ pip install xmlsec==1.3.13
Collecting xmlsec==1.3.13
  Using cached xmlsec-1.3.13.tar.gz (64 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting lxml>=3.8 (from xmlsec==1.3.13)
  Using cached lxml-5.1.0-cp311-cp311-macosx_11_0_arm64.whl.metadata (3.5 kB)
Using cached lxml-5.1.0-cp311-cp311-macosx_11_0_arm64.whl (4.5 MB)
Building wheels for collected packages: xmlsec
  Building wheel for xmlsec (pyproject.toml) ... error
  error: subprocess-exited-with-error

  × Building wheel for xmlsec (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [14 lines of output]
      WARNING setuptools_scm.pyproject_reading toml section missing 'pyproject.toml does not contain a tool.setuptools_scm section'
      running bdist_wheel
      running build
      running build_py
      creating build
      creating build/lib.macosx-11.0-arm64-cpython-311
      creating build/lib.macosx-11.0-arm64-cpython-311/xmlsec
      copying src/xmlsec/tree.pyi -> build/lib.macosx-11.0-arm64-cpython-311/xmlsec
      copying src/xmlsec/__init__.pyi -> build/lib.macosx-11.0-arm64-cpython-311/xmlsec
      copying src/xmlsec/constants.pyi -> build/lib.macosx-11.0-arm64-cpython-311/xmlsec
      copying src/xmlsec/template.pyi -> build/lib.macosx-11.0-arm64-cpython-311/xmlsec
      copying src/xmlsec/py.typed -> build/lib.macosx-11.0-arm64-cpython-311/xmlsec
      running build_ext
      error: xmlsec1 is not installed or not in path.
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for xmlsec
Failed to build xmlsec
ERROR: Could not build wheels for xmlsec, which is required to install pyproject.toml-based projects


added RASEL

https://github.com/nakilon/rasel
https://esolangs.org/wiki/RASEL

Also Piet wasn't on a proper alphabetical position.

Hi @Nakilon
Lovely language 👍
Thanks for taking care of the piet problem!


node_modules in repository

its not a good practice to include node_modules when u publish your branch , always make sure to ass node_modules to .gitignore file

Thank you for bringing this to my attention. I've recently updated my project and removed the node_modules directory from the repository. It should no longer be included in the branch I'm publishing.
If you encounter any other issues or have further suggestions, please feel free to let me know ^^ .


Support Config Cache in Gradle 7.5+

In 7.5+ we need to use a providers to exec code
Config Cache is broken with the following message:
org.gradle.api.InvalidUserCodeException: Starting an external process 'git status --porcelain' during configuration time is unsupported.
To fix can change to something like:
providers
        .exec { it.commandLine("git", "rev-parse", "--abbrev-ref HEAD") }.standardOutput.asText

Hi @chrisjenx could you please tell us what version of Gradle, Gradle Enterprise Plugin and Common Custom User Data plugin you are seeing this with?

Enabling the STABLE_CONFIGURATION_CACHE flag, added in Gradle 7.5, triggers this.

When enabled, external processes launched at configuration time are reported as problems unless done in accordance with the Running external processes requirement.

Gradle 7.5-rc-2
Gradle Enterprise Plugin 3.10.2
Common Custom User Data plugin 1.7.2

The issue is solvable already via the tooling, use the providers.exec functions on Gradle 7.5+, we migrated our project to use those new providers fine.


build: Fix .NET bindings

This fixes the .NET bindings that #1941 broke.

@vanillajonathan thank you very much for such a speedy fix!


change authentication requirement from FULLY to REMEMBERED

This should fix the bad UX shown in #247, #250 and #252.
I didn't change the annotation for saveDeckAction in PrivateApi20Controller.php because a) I have no idea how to test private API access locally, and b) I have never experienced a problem using this API from Net Deck.

This doesn't require any migrations, right? Just pull the changes and it'll automatically reload?

I think so, yes. Maybe flushing the symphony cache is needed, I can't really tell from googling, but nothing more than that.

I'll make sure to do that when I pull this in.


Display joined missions in My Profile

In this PR, I did the following changes:

Displayed the joined missions in My profile.
Styled My Profile a bit.
Added test files for component.

Your PR is APPROVED
Comments

No Linter error
The App ran as expected
Clean UI
Folder structure is clean and well structured

Every comment with the [OPTIONAL] prefix won't stop the approval of the PR. However, I strongly recommend you to take them into account as they can make your code better and addressing them will really improve your application
((I strongly recommend you to take them into account as they can make your code better. Some of them were simply missed by the previous reviewer and addressing them will really improve your application))
Cheers and happy coding! 👍 👍 👍
Feel free to leave any question or comment in the PR thread if something is not 100% clear. Please, remember to tag me in your question so I can receive the notification.
Please, do not open a new Pull Request for re-review. You should use the same Pull Request submitted for the first review, either valid or invalid unless it is requested otherwise

As described in the Code review limit policy you have a limited number of reviews per project (Check the exact number in your dashboard). If  you think that this code review was not fair, you can request a second opinion using this form.


[RELAY] Support recursive call syntax

Current implementation uses object identity to look up global vars,
since we create new object for each node in AST, it won't resolve to the
correct global var.
Also fixed a bug in type_infer, functions and global_var_map_ should
always be in sync.

@jroesch @joshpoll @tqchen please take a look.

Thanks for working on the text format! There are definitely a lot of gaps that need to be filled. In fact I think the parser can't handle recursive local functions either right now.
I think this is a problem with the parser, not with the module interface. In my opinion, it would be better to solve this issue by adding a dict from GlobalVar to Optional[Function] in the parser, which would serve as an in-progress version of the module. In visitDefn, we'd add the GlobalVar to the dict (mapped to None) before visiting the function and then updating the function value in the dict. Finally in visitProg we could turn this dict into a Relay Module.

Additionally, although this wasn't introduced by this PR, I'm confused why we're using name_hint for equality in module.cc even though users are warned in multiple places not to use it for that purpose. Either we need to rewrite module.cc or change the comments.

Hey, @joshpoll I'm not sure if your suggestion would fix the issue. Let me expand a little bit. Let's use a simple program as example:
 def @id(%x: int32) -> int32 {
            let %v1 = @id(%x);
            let %v2 = @id(%x);
            %v2
 }

The 2 occurrences of @id inside function body corresponds to different GlobalVar objects. So if we use object identity as key to look up GlobalVar, either one of the function call will fail during InferType on calling ModuleNode::Lookup.  This is the stacktrace in current mainline with my unit test:
TVMError: [16:03:31] /Users/wweic/workspace/tvm/src/relay/ir/module.cc:78: Check failed: it != functions.end() There is no definition of id

Stack trace returned 10 entries:
[bt] (0) 0   libtvm.dylib                        0x0000000115cbf7f0 dmlc::StackTrace(unsigned long) + 512
[bt] (1) 1   libtvm.dylib                        0x0000000115cbf4a4 dmlc::LogMessageFatal::~LogMessageFatal() + 52
[bt] (2) 2   libtvm.dylib                        0x0000000116074bec tvm::relay::ModuleNode::Lookup(tvm::relay::GlobalVar const&) + 236
[bt] (3) 3   libtvm.dylib                        0x000000011624fed9 tvm::relay::TypeInferencer::VisitExpr_(tvm::relay::GlobalVarNode const*) + 329
[bt] (4) 4   libtvm.dylib                        0x000000011601dc10 std::__1::__function::__func<tvm::relay::ExprFunctor<tvm::relay::Value (tvm::relay::Expr const&)>::InitVTable()::'lambda2'(tvm::NodeRef const&, tvm::relay::ExprFunctor<tvm::relay::Value (tvm::relay::Expr const&)>*), std::__1::allocator<tvm::relay::ExprFunctor<tvm::relay::Value (tvm::relay::Expr const&)>::InitVTable()::'lambda2'(tvm::NodeRef const&, tvm::relay::ExprFunctor<tvm::relay::Value (tvm::relay::Expr const&)>*)>, tvm::relay::Value (tvm::NodeRef const&, tvm::relay::ExprFunctor<tvm::relay::Value (tvm::relay::Expr const&)>*)>::operator()(tvm::NodeRef const&, tvm::relay::ExprFunctor<tvm::relay::Value (tvm::relay::Expr const&)>*&&) + 32
[bt] (5) 5   libtvm.dylib                        0x0000000116252849 tvm::IRFunctor<tvm::relay::Type (tvm::NodeRef const&, tvm::relay::ExprFunctor<tvm::relay::Type (tvm::relay::Expr const&)>*)>::operator()(tvm::NodeRef const&, tvm::relay::ExprFunctor<tvm::relay::Type (tvm::relay::Expr const&)>*) const + 345
[bt] (6) 6   libtvm.dylib                        0x000000011624f5c7 tvm::relay::ExprFunctor<tvm::relay::Type (tvm::relay::Expr const&)>::VisitExpr(tvm::relay::Expr const&) + 119
[bt] (7) 7   libtvm.dylib                        0x0000000116249c56 tvm::relay::TypeInferencer::GetType(tvm::relay::Expr const&) + 86
[bt] (8) 8   libtvm.dylib                        0x000000011625597a tvm::relay::TypeInferencer::GeneralCall(tvm::relay::CallNode const*, tvm::Array<tvm::relay::Type, void>) + 74
[bt] (9) 9   libtvm.dylib                        0x0000000116251127 tvm::relay::TypeInferencer::VisitExpr_(tvm::relay::CallNode const*) + 1111

My solution is based on the language design that global vars are unique,  as long as global vars have the same name_hint, they should be fine to get resolved to the same GlobalVar object. I think that's also why ModuleNode::GetGlobalVar works.
Also by fixing the issue in module.cc, every API that relies on symbol resolution would get the fix automatically. For example if user manually construct a relay AST then call InferType, it will also get fixed.

Right I think I understand the issue, but it has already been resolved for local variables in the parser. Since local and global vars have the same equality mechanism, I think the solutions should be the same. Right now, as you've mentioned, the parser always generates a new GlobalVar when it encounters one; however, this is not how it handles Vars. For local variables, the parser keeps track of scopes and looks up local variables as needed. My proposal is to do something similar for global variables. Ideally we would be able to just use the module to look up global vars, but since the module is write-once, we need to use the strategy I suggested earlier.
To further clarify,
let %id = fn (%x: int32) -> int32 { %x };
let %f = fn () { %id(1) };
()

parses fine, because id is in scope and has been resolved using self.var_scopes, but
def @id(%x: int32) -> int32 { %x }
def @f() { @id(1) }

doesn't parse, since id is created fresh and there is currently no mechanism for looking up global vars. My solution is simply to add a lookup mechanism to parser similar to that for local vars, but that also constructs the Module.
As for the second point about fixing it in module.cc, the equality issue is the same as for Vars, which we already expect users to deal with. It's worth revisiting equality, but IMO if we decide to use name_hint equality for GlobalVars, it should be changed in the class definition in expr.h, not in module.cc.

@joshpoll Thanks, Just took a look at the local variable implementation :-). var_scope enqueues/dequeues as the lexical scope enters/exit through let binding. And lookup uses string name of local var for looking up.
I think I'm getting your point. Are you suggesting that add a scope similar to var_scope that maps string to GlobalVar objects, and always lookup first in this place?:
https://github.com/dmlc/tvm/blob/3516cbe0049c7e11ee58afbc668acddb1f110ece/python/tvm/relay/_parser.py#L143
So that @id maps to the same object universally instead of one object per occurrence(similar to local variable)? I think it would be better to just show you the code, will work on it soon.

@joshpoll I updated the code, and it does the symbol resolution in parser. Could you take a look?
As a side note,  we currently don't have mutual recursion. And I think it worths another PR to add that, don't plan to add it in this PR.

Yes that's along the lines of what I was thinking. It looks like that should handle everything including recursion and ensuring global vars are unique (will throw an error L328). I agree that we should add mutual recursion, but it will definitely require a bit more thought.

I don't think I understand the purpose of AddUnchecked. What problem is it solving? Is there a test case that it helps pass?

I think functions and global_var_map_ should be always kept in sync, whenever we add a function, it should be reflected in global_var_map_ as well, is it a fair assumption?
This is the reason why add the wrapper here:
https://github.com/dmlc/tvm/blob/8dd928c7092f76a98fe79e564bbb018c9cca278a/src/relay/pass/type_infer.cc#L546

I think I understand what's going on now. I'm not super familiar with that part of the code base so I'll defer to others if they have thoughts, but it does seem like a good idea.
A couple of others thoughts:
Notice that TypeInfer is speculatively typechecking func so you should replace the teardown code with a call to Remove to get rid of the entries in both maps.
It also seems like Add is the only place that uses this speculative version of the TypeInfer function. It might make sense to move that function completely inside module.cc and use the other TypeInfer to do type inference.

@joshpoll Nice advice about Remove, changed in latest revision.
@tqchen @jroesch Could you take a look at type inferencer side part of my change?

@joshpoll Resolved your comments.

The python files lgtm. Just waiting on feedback from others about the cpp files. UW's winter quarter resumes next week so PR speed should hopefully pick up then.

Sorry about the slow response @wweic I've been traveling since after the TVM conference and have been mostly offline. I'll take a pass over it this afternoon.


Clear updates

Describe your suggested feature
Couldn't find a way to clear the Updates list; is there a way?
If no, maybe add this feature?
Other details
No response
Acknowledgements

[X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open or closed issue.
[X] I have written a short but informative title.
[X] I have updated the app to version 0.17.0.
[X] I will fill out all of the requested information in this form.

Why?

I want to keep it clean.

As someone who’s had their updates constantly filled with the same manga, I know how frustrating it can be to sift through repetitive entries.

Please consider this suggestion


Help for address already in use

UPDATE - FIXED
4/9/2022 15:55
FIXED: I used this guide to get free the 53 port
https://www.linuxuprising.com/2020/07/ubuntu-how-to-free-up-port-53-used-by.html
ORIGINAL REQUEST
I think it's not a real issue so I am asking for help.
I have a vps used only for openVPN. I have done all installation steps and required sucessufully except the error that I got on make deploy: <IP_ADDRESS>:53: bind: address already in use.
I dont think openvpn needs that, how I can fix it?
/etc/systemd/resolved.conf
[Resolve] DNS=<IP_ADDRESS> <IP_ADDRESS> Domains=com
Result of make deploy command
`Successfully tagged davd/docker-ddns:latest
docker run -it -d -p 8080:8080 -p 53:53 -p 53:53/udp --env-file envfile --name=dyndns davd/docker-ddns:latest
6b89568fb6ad8fb5d83c8d0814600d58cac31e4878a71e81e6a18b70553de70a
docker: Error response from daemon: driver failed programming external connectivity on endpoint dyndns (bc19640c59221eb4657bcb6213dd78a7f1b5d9733d7949aec6b6f0d6942ebcfd): Error starting userland proxy: listen tcp4 <IP_ADDRESS>:53: bind: address already in use.
make: *** [Makefile:40: deploy] Error 125
root@qool7:~/docker-ddns# netstat -plunt
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address           Foreign Address         State       PID/Program name
tcp        0      0 <IP_ADDRESS>:53           <IP_ADDRESS>:*               LISTEN      1236429/systemd-res
udp        0      0 <IP_ADDRESS>:53           <IP_ADDRESS>:*                           1236429/systemd-res
`

Here again as you can see I fixed the previous issue with "bind: address already in use."
lsof -i :53 now show an empty result.
I need to performe the last step 16/16.
When I execute "make deploy" I get the following error message:
Step 16/16 : CMD ["sh", "-c", "/root/setup.sh ; service bind9 start ; /root/dyndns"]  ---> Using cache  ---> a6aab2b09f7c Successfully built a6aab2b09f7c Successfully tagged davd/docker-ddns:latest docker run -it -d -p 8080:8080 -p 53:53 -p 53:53/udp --env-file envfile --name=dyndns davd/docker-ddns:latest docker: Error response from daemon: Conflict. The container name "/dyndns" is already in use by container "6b89568fb6ad8fb5d83c8d0814600d58cac31e4878a71e81e6a18b70553de70a". You have to remove (or rename) that container to be able to reuse that name. See 'docker run --help'. make: *** [Makefile:40: deploy] Error 125
Any suggest?

Now I will try next step...the issue about port 53 in use fixed and also the final "make deploy".


TSDB can create overlapping blocks, race during forced compaction

This is not a problem for running Prometheus in general, but a bug in TSDB.
Generally when we try to add a sample which falls in the persistent block range or the compactable range, we check the minValidTime of Head and call it out-of-bound.
But there are possible cases where during compaction, overlapping samples can slip in which falls in the block being created. This is in the scenario when you explicitly calling the CompactHead method on DB where the maxt of the block being created is more than the Head's minValidTime.
Let's say for example Head has data from 0300 hrs to 0500 hrs, which means we can still add samples from 0400 considering 2h block range. If externally the compaction is called on Head block from 0300 to 0500 explicitly using the CompactHead method, the following can happen:

A sample comes in for 0430, the minValidTime check is a success.
The compaction for 0300 to 0500 starts in parallel before the sample is committed.
Compaction completes and during Head Truncate, it sets minValidTime and mint of Head to 0500
It is followed by the appender commit, which will set back the mint of Head to to be 0430 while minValidTime stays at 0500.

Since now the mint of the Head is 0430, the next compaction would yield a block for the range [0430, 0600], overlapping with the recently created block [0300, 0500].
I don't have a good solution for this yet without losing the samples which gets appended during the compaction.
Cortex has an option for force compaction of TSDB which calls CompactHead on entire data and we faced the overlap once, and this is the best guess that I have got so far for the issue.
/cc @pracucci @pstibrany

Hello from the bug scrub.
@codesome what's the current state of this issue, 3.5  years later?


deepstream failed to start for: no such module: uws_builtin

I followed official installation guide to install deepstream.io on ubuntu 16.04 x64, and got this:
$ deepstream start
Error: No such module: uws_builtin
    at native ([eval]:697:28)
    at Object.11.events ([eval]:714:3)
    at o ([eval]:1:265)
    at [eval]:1:316
    at Object.237.../../constants/constants ([eval]:47938:13)
    at o ([eval]:1:265)
    at [eval]:1:316
    at Object.236.../../constants/constants ([eval]:47209:23)
    at o ([eval]:1:265)
    at [eval]:1:316
{ Error: Cannot find module './uws_linux_57'
    at Function.Module._resolveFilename (module.js:547:15)
    at Function.Module._load (module.js:474:25)
    at Module.require (module.js:596:17)
    at require (internal/module.js:11:18)
    at o ([eval]:1:125)
    at [eval]:1:316
    at native ([eval]:699:20)
    at Object.11.events ([eval]:714:3)
    at o ([eval]:1:265)
    at [eval]:1:316 code: 'MODULE_NOT_FOUND' }
[eval]:710
            throw new Error('Compilation of WebSockets has failed and there is no pre-compiled binary ' +
            ^

Error: Compilation of WebSockets has failed and there is no pre-compiled binary available for your system. Please install a supported C++11 compiler and reinstall the module 'uws'.
    at native ([eval]:710:19)
    at Object.11.events ([eval]:714:3)
    at o ([eval]:1:265)
    at [eval]:1:316
    at Object.237.../../constants/constants ([eval]:47938:13)
    at o ([eval]:1:265)
    at [eval]:1:316
    at Object.236.../../constants/constants ([eval]:47209:23)
    at o ([eval]:1:265)
    at [eval]:1:316

Any idea how to fix it? I tried npm i -g uws and seems doesn't help.

Tried version 3.1.1, working good.

3.1.3 Same error

CentOS is the same.
Error: No such module: uws_builtin
at native ([eval]:697:28)
at Object.11.events ([eval]:714:3)
at o ([eval]:1:265)
at [eval]:1:316
at Object.237.../../constants/constants ([eval]:47938:13)
at o ([eval]:1:265)
at [eval]:1:316
at Object.236.../../constants/constants ([eval]:47209:23)
at o ([eval]:1:265)
at [eval]:1:316
{ Error: Cannot find module './uws_linux_57'
at Function.Module._resolveFilename (module.js:547:15)
at Function.Module._load (module.js:474:25)
at Module.require (module.js:596:17)
at require (internal/module.js:11:18)
at o ([eval]:1:125)
at [eval]:1:316
at native ([eval]:699:20)
at Object.11.events ([eval]:714:3)
at o ([eval]:1:265)
at [eval]:1:316 code: 'MODULE_NOT_FOUND' }
[eval]:710
throw new Error('Compilation of WebSockets has failed and there is no pre-compiled binary ' +
^
Error: Compilation of WebSockets has failed and there is no pre-compiled binary available for your system. Please install a supported C++11 compiler and reinstall the module 'uws'.
at native ([eval]:710:19)
at Object.11.events ([eval]:714:3)
at o ([eval]:1:265)
at [eval]:1:316
at Object.237.../../constants/constants ([eval]:47938:13)
at o ([eval]:1:265)
at [eval]:1:316
at Object.236.../../constants/constants ([eval]:47209:23)
at o ([eval]:1:265)
at [eval]:1:316

Rolling back to 3.1.1 helps for me for now. But still wait for fix in future releases.
 The build mechanism failed massively due to c++/nodejs/uws incompatabilities

@yasserf Hello! Now looks like starting fine.
Need more time to better testing.

Happy to hear!

@yasserf Thank you so much!

Closing this issue for now.
Need to push a docker image and figure out osx issue.


I need to have a way to RUN the code

VSCode Version: I dont know how to check
OS Version: Latest Windows 10

Reproduces without extensions: No

try this extension: code-runner

For running code sections in many languages follow the advice from @luyiming and use the code runner extension. If you want to debug a program then F5 'Start Debugging' should help.
For further questions we recommend to use Stack Overflow as described in our guidelines Submitting-Bugs-and-Suggestions.


[QST] Building-and-deploying-multi-stage-RecSys with custom dataset

❓ Questions & Help
Hi! Thanks for providing the multi-stage recommender system example. This is really helpful to learn to use Merlin in a more realistic scenario. I'm trying to run Building-and-deploying-multi-stage-RecSys with custom dataset.
However, I have some problem when doing this:

When I trying to train the both Retrieval Model and Ranking model, the val_loss_total is became higher as well as training epochs increase. I also trying to train more epochs in your examples and got same problem. When I train with just few epoch, the model seem like being underfitting. But the more epochs training, the worser model is.

I want to save Retrieval Model after training to get item embeddings. But I got this error (in the picture below). In your examples, we can only save model.retrieval_block.query_block(). So how can we save the entire model?

I am using merlin-tensorflow-inference:22.05 version.
Could you please help me figure out a solution? Thanks!

@sontung2310 is this still an issue for you? can you please check out our examples and rerun with your merlin-tensorflow:22.07  (or the latest tag) notebook?
Also please note that you cannot save entire Two-tower model now, you can save query tower. Please  follow this example  01-Building-Recommender-Systems-with-Merlin.ipynb which shows how to extract item embeddings.

@rnyak Have you ever trying to training with more epochs than one in both retrieval model and two tower model? Did the val_loss_total is became higher as well as training epochs increase?
Also in your examples, item_embs was extracted by entire query model not only query block. (item_embeddings was the method of entire model model_tt)

@sontung2310  for your question Also in your examples, item_embs was extracted by entire query model not only query block. (item_embeddings was the method of entire model model_tt)
Yes, this is how it works now.
This examples are not doing any HPO.  val_loss might be increasing when you train longer. so you can do HPO at your end.


KNN implemenation reference paper

Hi,
All the methods have reference paper, except KNN method. Could you please provide reference paper for KNN also ?

I think Alex kinda made it up, right @iskandr?

Yeah, that's pretty much right. It's inspired by the R implementation of knnImpute, which I think I've more or less reimplemented.

I'll stick Inspired by the R Implementation of knnImpute in the docstring of knn. Thanks!


Sync check for AVAX

Sync check needs to be implemented for non EVM chains

db needs 'syncCheckPath' to accomodate avax's multiple chains


Use broccoli as build tool

... instead of gulp

I'm curious (and am currently learning the JavaScript ecosystem at the same time): why the change from gulp to broccoli?  There seem to be so many build tools available, I'm interested to know why you'd like to move to a different one.

mostly just familiarity and personal experience 😅


Why did Dev Box and Hyper-V switch places

The Question
Dev Box and Hyper-V switched places from:

to:

This is a question, label this as Issue-Question.

Environments are an experimental feature and things may move around and change, especially while it's still under active development.

Environments are an experimental feature and things may move around and change, especially while it's still under active development.

This is in Machine Configuration --> Set up target.


How to return response text from server using $http.post

I am trying to bind server response message using $http.post after adding a contact. How I can bind server response to responseText ?
addContact: function(){

	var contact = this.newContact;

	this.contacts.push(contact);

    this.$http.post('api/contacts', contact);

	this.responseText = response.message;

}

Can anyone help me out.?

Got it!
this.$http.post('api/contacts', contact, function(response) {
 	that.responseText = response.message;
});


Error when Linking against OpenMP

I was trying to use ParlayLib's algorithm with OpenMP, because I used ParlayLib in a project of ours. A user encountered segmentation faults coming from the scheduler when they try to run the code on Linux Mint 20.2, X5675 CPU and CentOS Stream 9, Dual X5670. I was thinking a quick workaround is to run the code using an alternative scheduler like OpenMP, but still using ParlayLib's algorithms.
However, when I try to compile with OpenMP, I encountered errors containing:
multiple definition of `parlay::in_par_do';

I tried to link against OpenMP using multiple repositories using ParlayLib, but got the same error. The error can be reproduced like this:
git clone -b openmp https://github.com/ParAlg/ParGeo.git pargeo
cd pargeo
git submodule init
git submodule update
mkdir build
cd build
cmake ..
make -j

Specifically, I wasn't sure if my CMake setting is correct.
Here's the full error message:
/usr/bin/ld: ../src/enclosingBall/sampling/libsamplingSebLib.a(seb.cpp.o):(.bss+0x0): multiple definition of `parlay::in_par_do'; CMakeFiles/smallestEnclosingBall.dir/smallestEnclosingBall.cpp.o:(.bss+0x20): first defined here
collect2: error: ld returned 1 exit status
make[2]: *** [example/CMakeFiles/smallestEnclosingBall.dir/build.make:85: example/smallestEnclosingBall] Error 1
make[1]: *** [CMakeFiles/Makefile2:1547: example/CMakeFiles/smallestEnclosingBall.dir/all] Error 2

A fix for this will be coming in #21, but we are still investigating a related bug, so it's not quite ready yet. Apologies for the delay, hopefully it will be good soon!

This should be fixed now!

I will tryout the update soon, and let you know we encounter other problems. Thank you Daniel!


Shared_prefereneces giving gradle error

I'm using shared_preferences ^0.5.3+4 in my flutter project. When trying to run the app, I'm getting the following gradle error.
Launching lib\main.dart on LLD AL20 in debug mode...
Initializing gradle...
Resolving dependencies...
* Error running Gradle:
ProcessException: Process "C:\Users\Deepa\table_app\android\gradlew.bat" exited abnormally:

> Configure project :shared_preferences

Project evaluation failed including an error in afterEvaluate {}. Run with --stacktrace for details of the afterEvaluate {} error.

FAILURE: Build failed with an exception.

* What went wrong:
A problem occurred configuring project ':shared_preferences'.
> Could not resolve all artifacts for configuration ':shared_preferences:classpath'.
   > Could not download builder.jar (com.android.tools.build:builder:3.4.0)
      > Could not get resource 'https://dl.google.com/dl/android/maven2/com/android/tools/build/builder/3.4.0/builder-3.4.0.jar'.
         > Premature end of Content-Length delimited message body (expected: 31027880; received: 4456416
   > Could not download bundletool.jar (com.android.tools.build:bundletool:0.7.2)
      > Could not get resource 'https://dl.google.com/dl/android/maven2/com/android/tools/build/bundletool/0.7.2/bundletool-0.7.2.jar'.
         > Premature end of Content-Length delimited message body (expected: 5039840; received: 4456416

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 12m 40s
  Command: C:\Users\Deepa\table_app\android\gradlew.bat app:properties

Finished with error: Please review your Gradle project setup in the android/ folder.

Output of  flutter run --verbose
[  +40 ms] executing: [C:\flutter\] git log -n 1 --pretty=format:%H
[ +129 ms] Exit code 0 from: git log -n 1 --pretty=format:%H
[   +7 ms] 20e59316b8b8474554b38493b8ca888794b0234a
[   +2 ms] executing: [C:\flutter\] git describe --match v*.*.* --first-parent --long --tags
[  +83 ms] Exit code 0 from: git describe --match v*.*.* --first-parent --long --tags
[   +2 ms] v1.7.8+hotfix.4-0-g20e59316b
[  +33 ms] executing: [C:\flutter\] git rev-parse --abbrev-ref --symbolic @{u}
[ +112 ms] Exit code 0 from: git rev-parse --abbrev-ref --symbolic @{u}
[   +7 ms] origin/stable
[   +3 ms] executing: [C:\flutter\] git ls-remote --get-url origin
[ +120 ms] Exit code 0 from: git ls-remote --get-url origin
[   +5 ms] https://github.com/flutter/flutter.git
[ +162 ms] executing: [C:\flutter\] git rev-parse --abbrev-ref HEAD
[  +41 ms] Exit code 0 from: git rev-parse --abbrev-ref HEAD
[   +2 ms] stable
[  +63 ms] executing: C:\Users\Deepa\AppData\Local\Android\sdk\platform-tools\adb.exe devices -l
[  +33 ms] Exit code 0 from: C:\Users\Deepa\AppData\Local\Android\sdk\platform-tools\adb.exe devices -l
[   +2 ms] List of devices attached
           BRB3Y18614008282       device product:LLD-AL20 model:LLD_AL20 device:HWLLD-H2 transport_id:7
           emulator-5554          device product:sdk_gphone_x86 model:Android_SDK_built_for_x86 device:generic_x86
           transport_id:3
[  +23 ms] C:\Users\Deepa\AppData\Local\Android\sdk\platform-tools\adb.exe -s BRB3Y18614008282 shell getprop
[ +196 ms] Artifact Instance of 'FlutterWebSdk' is not required, skipping update.
[  +14 ms] Artifact Instance of 'WindowsEngineArtifacts' is not required, skipping update.
[   +3 ms] Artifact Instance of 'MacOSEngineArtifacts' is not required, skipping update.
[   +5 ms] Artifact Instance of 'LinuxEngineArtifacts' is not required, skipping update.
[   +3 ms] Artifact Instance of 'LinuxFuchsiaSDKArtifacts' is not required, skipping update.
[   +3 ms] Artifact Instance of 'MacOSFuchsiaSDKArtifacts' is not required, skipping update.
[ +118 ms] Found plugin shared_preferences at C:\flutter\.pub-cache\hosted\pub.dartlang.org\shared_preferences-0.5.3+4\
[ +170 ms] Found plugin shared_preferences at C:\flutter\.pub-cache\hosted\pub.dartlang.org\shared_preferences-0.5.3+4\
[  +47 ms] ro.hardware = hi6250
[   +3 ms] ro.build.characteristics = default
[  +29 ms] Launching lib/main.dart on LLD AL20 in debug mode...
[  +29 ms] Initializing gradle...
[   +5 ms] Using gradle from C:\Users\Deepa\table_app\android\gradlew.bat.
[ +452 ms] executing: C:\Users\Deepa\table_app\android\gradlew.bat -v
[+2550 ms]
                    ------------------------------------------------------------
                    Gradle 4.10.2
                    ------------------------------------------------------------

                    Build time:   2018-09-19 18:10:15 UTC
                    Revision:     b4d8d5d170bb4ba516e88d7fe5647e2323d791dd

                    Kotlin DSL:   1.0-rc-6
                    Kotlin:       1.2.61
                    Groovy:       2.4.15
                    Ant:          Apache Ant(TM) version 1.9.11 compiled on March 23 2018
                    JVM:          1.8.0_152-release (JetBrains s.r.o 25.152-b01)
                    OS:           Windows 10 10.0 amd64
[  +16 ms] Initializing gradle... (completed in 3.0s)
[   +2 ms] Resolving dependencies...
[   +1 ms] executing: [C:\Users\Deepa\table_app\android\] C:\Users\Deepa\table_app\android\gradlew.bat app:properties
[+587662 ms]
                      > Configure project :shared_preferences

                      Project evaluation failed including an error in afterEvaluate {}. Run with --stacktrace for
                      details of the afterEvaluate {} error.

                      FAILURE: Build failed with an exception.

                      * What went wrong:
                      A problem occurred configuring project ':shared_preferences'.
                      > Could not resolve all artifacts for configuration ':shared_preferences:classpath'.
                         > Could not download builder.jar (com.android.tools.build:builder:3.4.0)
                            > Could not get resource
                            'https://dl.google.com/dl/android/maven2/com/android/tools/build/builder/3.4.0/builder-3.4.0                            .jar'.
                               > Premature end of Content-Length delimited message body (expected: 31027880; received:
                               4456416
                         > Could not download bundletool.jar (com.android.tools.build:bundletool:0.7.2)
                            > Could not get resource
                            'https://dl.google.com/dl/android/maven2/com/android/tools/build/bundletool/0.7.2/bundletool                            -0.7.2.jar'.
                               > Premature end of Content-Length delimited message body (expected: 5039840; received:
                               2359280

                      * Try:
                      Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more                      log output. Run with --scan to get full insights.

                      * Get more help at https://help.gradle.org

                      BUILD FAILED in 9m 46s
[  +76 ms] Resolving dependencies... (completed in 587.7s, longer than expected)
[  +25 ms] * Error running Gradle:
           ProcessException: Process "C:\Users\Deepa\table_app\android\gradlew.bat" exited abnormally:

           > Configure project :shared_preferences

           Project evaluation failed including an error in afterEvaluate {}. Run with --stacktrace for details of the
afterEvaluate
           {} error.

           FAILURE: Build failed with an exception.

           * What went wrong:
           A problem occurred configuring project ':shared_preferences'.
           > Could not resolve all artifacts for configuration ':shared_preferences:classpath'.
              > Could not download builder.jar (com.android.tools.build:builder:3.4.0)
                 > Could not get resource
                 'https://dl.google.com/dl/android/maven2/com/android/tools/build/builder/3.4.0/builder-3.4.0.jar'.
                    > Premature end of Content-Length delimited message body (expected: 31027880; received: 4456416
              > Could not download bundletool.jar (com.android.tools.build:bundletool:0.7.2)
                 > Could not get resource

'https://dl.google.com/dl/android/maven2/com/android/tools/build/bundletool/0.7.2/bundletool-0.7.2.jar'.
                    > Premature end of Content-Length delimited message body (expected: 5039840; received: 2359280

           * Try:
           Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log
output. Run with
           --scan to get full insights.

           * Get more help at https://help.gradle.org

           BUILD FAILED in 9m 46s
             Command: C:\Users\Deepa\table_app\android\gradlew.bat app:properties

[  +45 ms] "flutter run" took 5,91,554ms.
[   +5 ms] "flutter run" took 5,91,554ms.
Please review your Gradle project setup in the android/ folder.

#0      throwToolExit (package:flutter_tools/src/base/common.dart:28:3)
#1      _readGradleProject (package:flutter_tools/src/android/gradle.dart:158:7)
<asynchronous suspension>
#2      _gradleProject (package:flutter_tools/src/android/gradle.dart:111:34)
<asynchronous suspension>
#3      getGradleAppOut (package:flutter_tools/src/android/gradle.dart:105:29)
<asynchronous suspension>
#4      AndroidApk.fromAndroidProject (package:flutter_tools/src/application_package.dart:160:23)
<asynchronous suspension>
#5      ApplicationPackageFactory.getPackageForPlatform (package:flutter_tools/src/application_package.dart:47:32)
<asynchronous suspension>
#6      FlutterDevice.runHot (package:flutter_tools/src/resident_runner.dart:352:56)
<asynchronous suspension>
#7      HotRunner.run (package:flutter_tools/src/run_hot.dart:251:39)
<asynchronous suspension>
#8      RunCommand.runCommand (package:flutter_tools/src/commands/run.dart:469:37)
<asynchronous suspension>
#9      FlutterCommand.verifyThenRunCommand (package:flutter_tools/src/runner/flutter_command.dart:478:18)
<asynchronous suspension>
#10     FlutterCommand.run.<anonymous closure> (package:flutter_tools/src/runner/flutter_command.dart:383:33)
<asynchronous suspension>
#11     AppContext.run.<anonymous closure> (package:flutter_tools/src/base/context.dart:153:29)
<asynchronous suspension>
#12     _rootRun (dart:async/zone.dart:1124:13)
#13     _CustomZone.run (dart:async/zone.dart:1021:19)
#14     _runZoned (dart:async/zone.dart:1516:10)
#15     runZoned (dart:async/zone.dart:1463:12)
#16     AppContext.run (package:flutter_tools/src/base/context.dart:152:18)
<asynchronous suspension>
#17     FlutterCommand.run (package:flutter_tools/src/runner/flutter_command.dart:375:20)
#18     CommandRunner.runCommand (package:args/command_runner.dart:197:27)
<asynchronous suspension>
#19     FlutterCommandRunner.runCommand.<anonymous closure>
(package:flutter_tools/src/runner/flutter_command_runner.dart:396:21)
<asynchronous suspension>
#20     AppContext.run.<anonymous closure> (package:flutter_tools/src/base/context.dart:153:29)
<asynchronous suspension>
#21     _rootRun (dart:async/zone.dart:1124:13)
#22     _CustomZone.run (dart:async/zone.dart:1021:19)
#23     _runZoned (dart:async/zone.dart:1516:10)
#24     runZoned (dart:async/zone.dart:1463:12)
#25     AppContext.run (package:flutter_tools/src/base/context.dart:152:18)
<asynchronous suspension>
#26     FlutterCommandRunner.runCommand (package:flutter_tools/src/runner/flutter_command_runner.dart:356:19)
<asynchronous suspension>
#27     CommandRunner.run.<anonymous closure> (package:args/command_runner.dart:112:25)
#28     new Future.sync (dart:async/future.dart:224:31)
#29     CommandRunner.run (package:args/command_runner.dart:112:14)
#30     FlutterCommandRunner.run (package:flutter_tools/src/runner/flutter_command_runner.dart:242:18)
#31     run.<anonymous closure>.<anonymous closure> (package:flutter_tools/runner.dart:62:22)
<asynchronous suspension>
#32     _rootRun (dart:async/zone.dart:1124:13)
#33     _CustomZone.run (dart:async/zone.dart:1021:19)
#34     _runZoned (dart:async/zone.dart:1516:10)
#35     runZoned (dart:async/zone.dart:1500:12)
#36     run.<anonymous closure> (package:flutter_tools/runner.dart:60:18)
<asynchronous suspension>
#37     AppContext.run.<anonymous closure> (package:flutter_tools/src/base/context.dart:153:29)
<asynchronous suspension>
#38     _rootRun (dart:async/zone.dart:1124:13)
#39     _CustomZone.run (dart:async/zone.dart:1021:19)
#40     _runZoned (dart:async/zone.dart:1516:10)
#41     runZoned (dart:async/zone.dart:1463:12)
#42     AppContext.run (package:flutter_tools/src/base/context.dart:152:18)
<asynchronous suspension>
#43     runInContext (package:flutter_tools/src/context_runner.dart:56:24)
<asynchronous suspension>
#44     run (package:flutter_tools/runner.dart:51:10)
#45     main (package:flutter_tools/executable.dart:62:9)
<asynchronous suspension>
#46     main (file:///C:/b/s/w/ir/k/archive/flutter/packages/flutter_tools/bin/flutter_tools.dart:8:3)
#47     _startIsolate.<anonymous closure> (dart:isolate-patch/isolate_patch.dart:299:32)
#48     _RawReceivePortImpl._handleMessage (dart:isolate-patch/isolate_patch.dart:172:12)

 output of flutter analyze

Running "flutter pub get" in table_app...                           1.5s
Analyzing table_app...

   info - Unused import: 'package:dots_indicator/dots_indicator.dart' - lib\on_board_page.dart:2:8 - unused_import

1 issue found. (ran in 31.6s)

Output of  flutter doctor -v here
Flutter (Channel stable, v1.7.8+hotfix.4, on Microsoft Windows [Version 10.0.17763.292], locale en-IN)
    • Flutter version 1.7.8+hotfix.4 at C:\flutter
    • Framework revision 20e59316b8 (2 weeks ago), 2019-07-18 20:04:33 -0700
    • Engine revision fee001c93f
    • Dart version 2.4.0

[√] Android toolchain - develop for Android devices (Android SDK version 29.0.1)
    • Android SDK at C:\Users\Deepa\AppData\Local\Android\sdk
    • Android NDK location not configured (optional; useful for native profiling support)
    • Platform android-29, build-tools 29.0.1
    • Java binary at: C:\Program Files\Android\Android Studio\jre\bin\java
    • Java version OpenJDK Runtime Environment (build 1.8.0_152-release-1343-b01)
    • All Android licenses accepted.

[√] Android Studio (version 3.4)
    • Android Studio at C:\Program Files\Android\Android Studio
    • Flutter plugin version 38.1.1
    • Dart plugin version 183.6270
    • Java version OpenJDK Runtime Environment (build 1.8.0_152-release-1343-b01)

[!] VS Code (version 1.36.1)
    • VS Code at C:\Users\Deepa\AppData\Local\Programs\Microsoft VS Code
    X Flutter extension not installed; install from
      https://marketplace.visualstudio.com/items?itemName=Dart-Code.flutter

[√] Connected device (2 available)
    • LLD AL20                  • BRB3Y18614008282 • android-arm64 • Android 8.0.0 (API 26)
    • Android SDK built for x86 • emulator-5554    • android-x86   • Android 8.0.0 (API 26) (emulator)

! Doctor found issues in 1 category.

how you solve it further , I m also having same error


fix: refactoring resilient oracle

Description

Refactored getUnderlyingPrice function to reduce contract calls, reduce memory storage, and lines of code. This will optimize gas usage whenever the function is used in a state change function in the protocol. Also saves deployment costs.
Peckshield audit fixes: https://www.notion.so/Peckshield-Oracle-d6b9f1c636a84be4993141bf7eca8e52
Audit fixes include one critical bug where the vBNB token not having an underlying token function would have broken all the oracle.getUnderlyingPrice for vBNB. All oracles now store an immutable vBNB address and the underlying asset of BNB with address: 0xbBbBBBBbbBBBbbbBbbBbbbbBBbBbbbbBbBbbBBbB . The only exception is the TWAP oracle for which the underlying asset is wBNB. This should be kept in mind when storing asset config and prices. Tests are updated accordingly.
Updated and added more tests.

Checklist

[x] I have updated the documentation to account for the changes in the code.
[x] If I added new functionality, I added tests covering it.
[x] If I fixed a bug, I added a test preventing this bug from silently reappearing again.
[x] My contribution follows Venus contribution guidelines.

LGTM


Docs differ from README as to which versions of django are supported

The README says that only versions 1.8 and 1.9 are supported while the docs linked to from the README also include 1.4 and 1.7.

I plan to drop support for old releases of Django that aren't supported by Django in the next version.  This will require work, for example dropping the South migrations.  Users of old versions can upgrade to 1.0.0, upgrade to a Django 1.8, and the upgrade to latest releases.

https://github.com/django-nose/django-nose/releases/tag/v1.4.4 dropped support for South, and has accurate Django support notes.


Traverse Topology in DFS format in block topology output

Perhaps this would be a good MR to introduce a document in repo that explains the vertex structure, just to make sure everyone is on the same page. I think that might be pretty helpful, perhaps we should discuss during review?


Testing with Dockerfile

Build :
-> docker build -t 'test:1.0' ./
Run with volumes :
-> docker run -d -P -v /tmp/localData:/usr/src/app/localData -v /tmp/localMetadata:/usr/src/app/localMetadata test:1.0
->  When running Dockerfile on macOS, there is an issue with the function : _setDirSyncFlag on init.js and the levelup and leveldown with levelDB.
Working fine when running directly on linux / linux VM.

Please configure your git to link commits to your account.

👍

@nicolas2bert Can you amend the author using git commit --amend --author?

@nicolas2bert please update your commit auther so we can merge it and I'll setup auto building on dockerhub

👍


/api/v3/openOrders returning wrong data

As you can see from the attached videos the /api/v3/openOrders returns wrong data during tests with postman.
As you can see in the video I have 3 open orders (both CHZEUR) and the api returns from 0 to 3 results each time I run it.
In the second video I have 1 CHZEUR order and 1 MATICEUR order, also in this case the api returns wrong values.
https://user-images.githubusercontent.com/12783153/119256347-8d14d600-bbc0-11eb-8709-9027fe140413.mp4
https://user-images.githubusercontent.com/12783153/119256411-eed54000-bbc0-11eb-9f7c-1113041e2a7a.mp4

Thanks for the feedback. Will check it with the team, grazie.

Hi. This is due to the incomplete DB cluster synchronisation.
You can either send API request with longer waiting time or subscribe to websocket user data stream and maintain the execution report locally.

Thanks! Is there a suggested wait time to use in order to have an higher chance of getting correct results?

For API related question, please open a topic at dev.binance.vision.


how to deal if the require path have variable

like this:  const producer = require(`${config.path.mq}producer`);

Similar to #344 but more dynamic. Closing #344.


Applying for Dapr Community Manager

reference: #396
Hi, I am interested in contributing to the Dapr Community by becoming a Community Manager and accomplish the tasks required in this role. I think community plays a vital role in success and adoption of any open source project, and I am passionate to play the part which would enable the community members to learn more about Dapr and its progress.
A few of my past open source contributions are:
Komiser

Feature: Added support for AWS RDS Proxies
Feature: Added support for MongoDB Atlas Serverless clusters
Feature: Added support for GCP Clusters
Feature: Added support for AWS RDS Cluster Snapshot

Meshery

Enabled Meshery application integration with GitHub Codespaces
Feature: Doc for installing/running Meshery on GitHub Codespaces
New User of the Month

Prisma

Discovered a GraphQL error in Nexus library, during it's integration with Prisma

Thank you for applying @AnnuCode! The Dapr STC will select the community manager end of December.

Hi @AnnuCode, can you please email me at<EMAIL_ADDRESS>so I can inform you about your community manager application?

@AnnuCode has accepted the role and onboarding process is started.


bla.aeiou.pt is not loading chat until app is closed

@BlazDT commented on Tue Sep 11 2018
https://github.com/AdguardTeam/AdguardFilters/issues/22022
Only when I close AdGuard for Windows, it is connecting to the chat. Disabling every AdGuard module didn't work - only closing the app via tray icon.

bla is not available anymore


cron: Move fetch-tor-exit-nodes to not on the hour.

We see connection timeouts and other access issues when run exactly on the hour, either due to load on their servers from similar cron jobs, or from operational processes of theirs.
Move to on the :17s to avoid these access issues.

Self-review checklist

[ ] Self-reviewed the changes for clarity and maintainability
(variable names, code reuse, readability, etc.).

Communicate decisions, questions, and potential concerns.

[ ] Explains differences from previous plans (e.g., issue description).
[ ] Highlights technical choices and bugs encountered.
[ ] Calls out remaining decisions and concerns.
[ ] Automated tests verify logic where appropriate.

Individual commits are ready for review (see commit discipline).

[ ] Each commit is a coherent idea.
[ ] Commit message(s) explain reasoning and motivation for changes.

Completed manual review and testing of the following:

[ ] Visual appearance of the changes.
[ ] Responsiveness and internationalization.
[ ] Strings and tooltips.
[ ] End-to-end functionality of buttons, interactions and flows.
[ ] Corner cases, error conditions, and easily imagined bugs.

Merged, thanks @alexmv!


Deleting the getenv function ,on the SG_API, which cause error

Thanks for submitting the PR!
I'm going to close this one out since this is no longer issue with the new library (we assume you already have the API key in your environment): https://github.com/sendgrid/sendgrid-php/tree/v3beta/examples


Add broadcast transaction tool

Note that this relies only on rest.bitcoin.com at this point. It would be good to have an least one other endpoint for redundancy in case one goes down.

preview tested to work


RNCryptor Inside a Framework

When trying to use RNCryptor inside a framework I get this error:
Include of non-modular header inside framework module 'RNCryptor.RNCryptor'

Has anyone found a workaround?

Currently Experiencing the same Issues with CocoaPods 0.3.6.rc.1
Is there any workaround?

Having same problem. Anyone found out how to fix it?

I am having the same issue and hoping to find a fix

Any maintainers have an idea? I would use CryptoSwift instead, but at the moment it does not have the same speed.

I managed to get this to work by changing "CLANG_ALLOW_NON_MODULAR_INCLUDES_IN_FRAMEWORK_MODULES" to Yes in "Build Settings". I found this solution on SO: http://stackoverflow.com/questions/24103169/swift-compiler-error-non-modular-header-inside-framework-module. What I don't know is if there is a catch to allowing this non modular framework modules.

Try making the .h files public for the iOS build, rather than Project.
(right-hand pane, look for "Target Membership"). If that works, I'll push a
version that includes that.
I never use CocoaPods and am not particularly familiar with how it works. I
just include RNCryptor's files in my main project, and it generally is
fine. If someone has a PR for the podspec, I'm happy to merge it.

@rnapier so the issue is that you can not include CommonCryptor in the Header file. I just created a pull request that should fix this by using the hard values instead of the constants.

@bassrock There must be a better solution than to use horrible magic constants everywhere in the code, and lose type-checking for enums.  CommonCrypto is a system framework and should be importable.  How does importing <Foundation/Foundation.h> work?

It is importable. However you can not import it into a header file that will be public. So you have to at least make the base file the end values but could still pas it enums. Open to any other solutions but this is all I could make work.

So if you have a public header, you can't import any, say, Foundation or UIKit headers directly?   That seems like a rather silly restriction from Apple, counter to normal C usage.  At some point, there will be dependent third-party frameworks (i.e. ones which use constants, type names, or superclasses from another framework).  That is usually the type of thing which CocoaPods is supposed to make easy.
Does removing the imports (and just adding them to the .pch) work?  That would require all consumers to add the same imports to their .pch files (or at least right before they import RNCryptor wherever that is).  If that works, maybe there is a way in the precompile environment to figure out that a modular framework is being built, and to put the imports inside of some #if !BUILDING_FRAMEWORK checks or something like that.  But to me, using the named constants and types from CommonCrypto in the code should be an absolute must.

So thats the catch. You can with Swift, but not with an iOS Framework that is written with Obj-C. The best solution would be to rewrite in Swift and then this would work.
As far as I could tell the modifications that I made were the only "easy" way for this to work, without having to use CocoaPods.

I edited my question above... does changing to <CommonCrypto/CommonCrypto.h> work (as opposed to the two individual imports)?

Yea using the constants defineltly should be a priority, I just couldn't see how to do it. And when importing the catchall header it was the same issue because it ultimately ends up importing the other ones.

The errors sounds like importing UIKit/UIKit.h is OK because that's a module header, though UIKit/UIView.h individually might be a problem.   But if CommonCrypto is not a module (rather just a C library) then that sounds like an issue.
If CLANG_ALLOW_NON_MODULAR_INCLUDES_IN_FRAMEWORK_MODULES doesn't work, another short-term solution might be to do something like
#if !BUILDING_MODULE
#import <CommonCrypto/xxxx.h>
#elif !defined(CC_COMMON_CRYPTOR) // it wasn't imported some other way yet
// copy definitions from CommonCrypto since we can't import directly
enum {
kCCEncrypt = 0,
kCCDecrypt,
};
typedef uint32_t CCOperation;
(and so on)
#endif
Then figure out some way to determine BUILDING_MODULE.  Could be a custom define in the framework target maybe.  That way the messiness is confined to one header, not every usage of the constants in the code.

Well that is sort of the case I believe I only changed the constants in the header files. It still imports them and uses them in the .m files.

I guess the kRNCryptorAES256Settings constant could be declared extern const in the header (instead of static const), then defined in the .m file instead.  That would limit the extra goop needed to a handful of typedefs.  It is still beneficial to have the type names used in the structure -- it's part of the documentation of allowed values (not that anyone should be using a different structure in that case).
Seems odd that system headers can be included (it gets the definition of size_t somehow) but not CommonCrypto.  This may just be some growing pain issues with Swift and frameworks which Apple will find better solutions to eventually.

I haven't been ignoring this conversation, btw, I just have been hoping
that a solution would present itself. I do believe it's transition pains
for Swift. I'd like to avoid removing the constants, since they're
important documentation. That said, I've long considered the need to
pass kRNCryptorAES256Settings a design flaw rather than a feature.
RNCryptor doesn't really expect you to make random changes to that struct.
I wonder if there's an easy way to fix this by providing a Swift interface
that does not expose the settings struct at all. Maybe split the Swift
interface into its own header and not import RNCryptor.h itself into Swift.
I have been very overloaded with other projects, and RNCryptor hasn't
gotten a lot of attention recently. I hope to change that, but I'm not
certain when. PRs are of course welcome and encouraged.

Please help test the fix I've applied. I decided to go with something a little more radical than @bassrock's solution #149. Rather than swapping out the types, I copied all the types we need into a temporary header file. This should help a little with type safety (not much for ObjC, but maybe a little), documents better, and is very easy to pull out when CommonCrypto is fixed.

is this issue fixed?
I have this issue at version 2.2
Using RNCryptor (2.2)

Have you tested the commit I reference above? cb1036f I'm waiting for a confirmation that this fix works for other people before tagging it.

@rnapier
Yes
Information: I've implemented my security kit that based on apple's CommonCryptor.
#import "AIKSecurityKit.h"
#import <CommonCrypto/CommonHMAC.h>
#import <CommonCrypto/CommonCryptor.h>
#import <RNCryptor/RNEncryptor.h>
#import <RNCryptor/RNDecryptor.h>

I have these lines:
warnings:
umbrella header for module 'RNCryptor' does not include header 'RNOpenSSLCryptor.h'
umbrella header for module 'RNCryptor' does not include header 'RNOpenSSLEncryptor.h'
umbrella header for module 'RNCryptor' does not include header 'RNOpenSSLCryptor.h'
errors: (nearly nine or more, one error for each symbol from CommonCryptor )
MyProject/Security/SecurityKit/AIKSecurityKit.m:42:12: error: reference to 'kCCHmacAlgSHA256' is ambiguous
    CCHmac(kCCHmacAlgSHA256, cKey, strlen(cKey), cData, strlen(cData), cHMAC);
           ^
In module 'RNCryptor' imported from
MyProject/Security/SecurityKit/AIKSecurityKit.m:13:
/Users/mac/Library/Developer/Xcode/DerivedData/SmartAirkey-himplrkcxiqdkzfpohykmuyhoqcd/Build/Products/Debug-iphonesimulator/RNCryptor.framework/Headers/RNCryptor+Swift.h:134:5: note: candidate found by name lookup is '::kCCHmacAlgSHA256'
    kCCHmacAlgSHA256,
    ^
In file included from
MyProject//Security/SecurityKit/AIKSecurityKit.m:11:
/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator8.4.sdk/usr/include/CommonCrypto/CommonHMAC.h:54:5: note: candidate found by name lookup is '::kCCHmacAlgSHA256'
    kCCHmacAlgSHA256,

It looks like you have some mix of versions here. RNOpenSSLCryptor is not part of that cb1036f. It was removed for security concerns and put into its own package. If you have something referencing those files, then it suggests you don't have a clean version of RNCryptor.
I suspect that AISecurityKit.h imports RNCryptor.h. That will likely cause problems if you later import CommonCryptor.h. You should import CommonCrypto first if you need it directly. (I assume this is an ObjC framework rather than a Swift framework.)
If that causes more trouble, then I'll have to drop the common crypto defines entirely and rename them all to internal constants. That's not a huge problem.
Do make sure you're not trying to link RNCryptor inside of another framework. That would be incredibly dangerous in cases that a consuming app uses RNCryptor for other purposes. Make sure that the final app links all the necessary frameworks (yours and anything you depend on). You should reference your headers from whatever version the app uses; they shouldn't be embedded either or you can get nasty surprises.

@rnapier, well, you are right
I didn't make frameworks, AIKSecurityKit is a part of my app.
It has AIKSecurityKit which contains security related code like encoding/decoding ( SHA128/SHA256 and HMac )
I try to import RNCryptor into this kit and use it as a replacement
It works great for ObjC, but Swift migration/mix causes problems
I made clean install of pods and made build.
Warnings disappeared.
Also, this import is a part of AIKSecurityKit.m
// AIKSecurityKit.m
#import "AIKSecurityKit.h"
#import <CommonCrypto/CommonHMAC.h>
#import <CommonCrypto/CommonCryptor.h>
#import <RNCryptor/RNEncryptor.h>
#import <RNCryptor/RNDecryptor.h>

Does anyone have a clean / concise method of getting RNCryptor to work within a Framework?  I'm using Cocoapods and I'm using frameworks.  Just setting the  CLANG_ALLOW_NON_MODULAR_INCLUDES_IN_FRAMEWORK_MODULES to Yes is not solving the problem.  I've been racking my head against the wall for a few hours on this.

It looks like that last commit undid the commit from #152.


Suggestion HACS

Any possibility we could get this into HACS? And also be able to pull more info than just medelvind.
Woke up to a storm right now and first thing I always check is the ViVa app for the peak wind in Helsingborg 😅

Hi. That sure is a possibility.


Bootstrap select dropdown gets distorted when used with slick slider

When using Bootstrap select dropdown with the slick slider, it gets distorted.
Here is the link to jsfiddle.
Does anyone have any solution for this?
Thanks in advance
====================================================================
[  paste your jsfiddle link here  ]
https://jsfiddle.net/iamaditya/01ncvrbj/
====================================================================
Steps to reproduce the problem
Click on the select box it gets distorted.

====================================================================
What is the expected behaviour?
Without Slick:

====================================================================
What is observed behaviour?
With Slick:

====================================================================

You need to set container: 'body' or data-container="body". https://developer.snapappointments.com/bootstrap-select/examples/#container

Thanks @caseyjhol :)


Could you release the train.py and test.py?

Thanks!
I would like to train your model on other tasks.
Having read your excellent work, I would like to learn more about the actual training process of the degradation model D.

Hi, thanks!
The degradation model D is not trained, while it is randomly initialized and optimized during the sampling. The loss will back-propagate to update the parameters of degradation model D.
You can devise a degradation model D, then optimize the parameters when sampling.
If you have further questions, please feel free to comment.

Thank you very much for your reply!


BIGTOP-3335. Fix Mahout build after upgrading Spark to 2.4.5

LGTM. +1.

Thanks! Resolved conflicts and waiting for the CI finishes.

Merged, thanks for the review Evans :)


[New feature] Support HAR in FILE mode

Test
./dalfox file ~/222.har --har --proxy http://localhost:8090

 🎯  Target                 /Users/hahwul/222.har
 🏁  Method                 FILE Mode
 🖥  Worker                 100
 🔦  BAV                    true
 ⛏  Mining                 true (Gf-Patterns)
 🔬  Mining-DOM             true (mining from DOM)
 ⏱  Timeout                10
 📤  FollowRedirect         false
 🕰  Started at             2022-06-04 23:47:24.541722 +0900 KST m=+0.087941095

[*] 🦊 Start scan [SID:0] / URL: https://www.hahwul.com/
[I] Found 0 testing point in DOM base parameter mining
...

=> Proxy log


Define ndc application profile

I expect
Every vocabulary has the following properties:

ndc:keyConcept - an ascii 7bit string identifier that is unique in each repository and with regard to a specific NDC namespace; it is used to identify the vocabulary to be published as REST API, eg. /vocabularies/v1/vocabularies/{keyConcept}

ndc:controlledVocabularyURI - a property to correlate a vocabulary with the REST API server url.

Notes
Property names may be changed

It seems that dcat has the proper keywords to reference APIs in the semantic world.
This as the advantage of not touching the Dataset entry.
@prefix dcat: <http://www.w3.org/ns/dcat#>

<https://w3id.org/italia/data/distribution/licence-API>
  a dcat:DataService;
  dcat:endpointURL <http://api.ndc.gov.it/vocabularies/v1/vocabularies/licences>
  dcat:servesDataset <https://w3id.org/italia/controlled-vocabulary/licences>
.

No @ioggstream unfortunately we have to pay attention here because, as I have already said on this point, DCAT-AP_IT, used at the time being in the datasets of this repo, is based on the previous versions of DCAT and DCAT-AP, not the new ones.  In the current version of DCAT-AP_IT, DataService class is not available and there is instead Distribution. BTW: a DataService is not a Distribution so the URI you are suggesting here should be .../data/data-service/licence-api
However, I think we should have a more semantic driven approach here. NDC application profile is an extension of DCAT-AP_IT for the NDC application. Therefore, according to what I have already delivered to you all for the NDC profile, based on the current DCAT-AP_IT, the official one in our country, we have:

ndc:keyConcept - it is a string defined in the NDC application profile (within NDC namespace); it is used to identify the key concept that a controlled vocabulary represents and it is used to create the related REST API URL of the vocabulary, eg. /vocabularies/v1/vocabularies/{keyConcept}
either we define a direct property named ndc:jsonSchemaURL (it is already there in the NDC I delivered) from Dataset, or we use Distribution with accessURL property. But we need to understand what we want to represent here: the API itself for getting the content of the vocabulary or only the schema? Because if it is the API itself, we can reuse Distribution with accessURL property, if not we need to think about the other alternative.

There is another possibility but this implies deviating from DCAT-AP_IT if we consider the new version of DCAT. I need to think a little bit about it in terms of semantics.
The real problem is that DCAT-AP_IT is old and should be up-to-date (I started saying that in 2019 more or less with no results) especially according to all these works here on schemas and APIs!

@giorgialodi ok of not using directli dcat v2. See #121 comments to the PR.

The real problem is that DCAT-AP_IT is old and should be up-to-date (I started saying that in 2019 more or less with no results) especially according to all these works here on schemas and APIs!

Agree... I think there are a lot of opportunities here.

This has been defined. I think we can close the issue. The ndc profile includes:

keyConcept property as in the past;
for the endpoint of the APIs, I reproduced the modelling of the new DCAT (version 2) because  DCAT-AP_IT is based on the previous version of DCAT. In essence, there is a new class in the namespace of ndc that is DataService and attached to this there are three properties: endpointURL, servesDataset (to link it to the dataset) and endpointDescription. I also created the inverse property from Dataset to DataService (which is not in DCAT), in the case it can be helpful at a certain moment in time. The previous property I introduced and named jsonSchemaURL has been fully removed. I also included some cardinality constraints: keyConcept is mandatory for the dataset (1 and only 1); if DataService is specified the endpointURL is mandatory (1 and only 1

@giorgialodi reopening with the associated PR.


Fixing docker-compose setup to include git repo

I found it a bit trickey to configure the git setup
So I've documented into the docker-compose setup.
Now out of the box, you can have git configured with a local file based repo
root@0f0a7a8e59a0:/go/src/github.com/vsco/dcdr# cat /etc/dcdr/decider.json
{
  "dcdr": {
    "info": {
      "current_sha": "65e3b58fe63c9d5ba0d521fd0e5a0afbdea8385a",
      "last_modfied_date":<PHONE_NUMBER>
    },
    "features": {
      "default": {
        "test1": true
      }
    }
  }

hmm travis... (I hope the compose isn't used there.. we'll find out soon enough :))

there is some instability in the watch test (in windows it's failing constently)

@negator care to review this one ?

Hi there @fruch, thanks so much for the contribution, I will be getting a review out for this today.

FYI, I'm working on clients for the dcdr Server in both python and node.js (while trying to pitch for using dcdr, or at least the same concepts in the projects I'm working at)
I'll upload them if/when I'll sort the legal stuff.

Added a PR to address the docker-compose example: https://github.com/vsco/dcdr/pull/67

seperated each issue into it's own PR,
about this one, I think having a way to show how to setup git is really helpful.
I was trying to see how to use the ETag for cacheing, and found out that it would be available on when git is enabled (would be a nice feature if we could checksum the feature json, and use that for the current_sha)

so you think we can put the example I did for setup of git in a separate repo ?

I'm new and seeing this PR for the first time - is this still applicable/desired?

In my opinion it isn't necessary to have the git functionality built into this "out of the box see it works" demo.
With regards to:

I think having a way to show how to setup git is really helpful.

I do think that is important, but I don't think it should fall into the docker-compose paradigm.


Work on accessibility

I would be really interested in using this for one of our projects, but we have pretty strict guidelines for accessibility.
You probably already know, but here are some things off the top of my head:

Tabindex for the different option-buttons
Focus indicators for buttons (so a user with a keyboard can tell which button they have currently selected)
Let user define (optional) Aria-Labels for the buttons... e.g.:

    1: {
        text: 'Hi! Welcome to Peekobot.',
        options: [
            {
                text: '👋',
                aria-label:'Hello there!',
                next: 2

            }
        ]
    },

I haven't tested screenreader support yet, but it might need an aria-live region?

Thanks so much for your interest and suggested additions. I'm happy with the basics of accessibility, but am not so good on accessibility of highly interactive elements, so I do appreciate any help I can get!
It might be a few days before I get around to working on it again. So if you want to try and make a PR then that's great. If not I'll try and look at it next week. I'd love for it to be accessible!
Also, I'm happy to blow the 100-line limit. I'm using "less than 100 lines" in the description right now, but it doesn't have to be. So don't worry about that if you are making a PR.
Thanks again!

if (option.ariaLabel) button.setAttribute("aria-label", option.ariaLabel);


PYD-124: improve docs for __get_pydantic_core_schema__

Selected Reviewer: @dmontagu

please review

@dmontagu what do you think of just swapping out the generics example here for https://github.com/pydantic/pydantic/issues/4161#issuecomment-1527960500?


SQL VM deployments

Page 1: Azure Settings Page

Page 2:  VM settings Page

VM image Dropdown

VM size dropdown

Page 3: Network Settings page

Existing Vnet

New Vnet

Page 4:
Sql server settings with sql auth enabled

sql server settings with sql auth disabled

Page 5: Summary page

Can you share images of each of the wizard pages? My biggest concern is if a custom wizard is needed, on the surface, it looks like that the notebook wizard that exists which defines each wizard page using JSON would fit the need. By looking at the screenshot I would like to evaluate that possibility.

Can you share images of each of the wizard pages? My biggest concern is if a custom wizard is needed, on the surface, it looks like that the notebook wizard that exists which defines each wizard page using JSON would fit the need. By looking at the screenshot I would like to evaluate that possibility.

@ranasaria I have added the screenshots.

there are conflicts with main branch


Use ThreadLocalRandom

Use https://docs.oracle.com/javase/8/docs/api/java/util/concurrent/ThreadLocalRandom.html instead of a thread local Random to reduce overhead and memory synchronization events.

Looks like ThreadLocalRandom cannot be reseeded which is needed for our "replayable randomness" feature.

Alternative attached :)
/**
 * Ultra-fast pseudo random generator that is not synchronized! Don't use anything from Random by inheritance, because it would
 * inherit a volatile!
 *
 * @author rschwietzke
 */
public class FastRandom
{
    private long seed;

    public FastRandom()
    {
        this.seed = System.currentTimeMillis();
    }

    public FastRandom(long seed)
    {
        this.seed = seed;
    }

    protected int next(int nbits)
    {
        // N.B. Not thread-safe!
        long x = this.seed;
        x ^= (x << 21);
        x ^= (x >>> 35);
        x ^= (x << 4);
        this.seed = x;

        x &= ((1L << nbits) - 1);

        return (int) x;
    }

    /**
     * Borrowed from the JDK. Bound is exclusive, that means a for 10, you get 0 to 9 back
     *
     * @param bound
     * @return
     */
    public int nextInt(int bound)
    {
        int r = next(31);
        int m = bound - 1;

        if ((bound & m) == 0)
        {
            // i.e., bound is a power of 2
            r = (int) ((bound * (long) r) >> 31);
        }
        else
        {
            for (int u = r; u - (r = u % bound) + m < 0; u = next(31))
            {
            }
        }
        return r;
    }

    /**
     * Borrowed from the JDK
     *
     * @return
     */
    public int nextInt()
    {
        return next(32);
    }

    /**
     * From and to, inclusive of the range
     *
     * @return
     */
    public int nextInt(int from, int to)
    {
        return from + nextInt(to - from + 1);
    }

    public boolean nextBoolean()
    {
        return nextInt(2) == 1;
    }

I have something available based on it.unimi.dsl.util.SplitMix64RandomGenerator


wascc/hello-world-assemblyscript: actor is not authorized to use capability wascc:logging

This may just be me and/or a limitation of my attempt to run krustlet w/ MicroK8s.
kubectl apply --filename=https://raw.githubusercontent.com/deislabs/krustlet/master/demos/wascc/hello-world-assemblyscript/k8s.yaml
pod/hello-world-wascc-assemblyscript configured

kubectl describe pod/hello-world-wascc-assemblyscript
Name:         hello-world-wascc-assemblyscript
Namespace:    default
Priority:     0
Node:         krustlet/
Labels:       <none>
Annotations:  Status:  Failed
Message:      Failed to run pod: Error configuring capabilities for module: WebAssembly module authorization failure: Unauthorized binding: actor MA6DECXXYRIRPWYJAIKQT7ZBPUCJ7HRBLK3ZSDTGE7WWIJ6VU52PZOCI is not authorized to use capability wascc:logging.
IP:
IPs:          <none>
Containers:
  hello-world-wascc-assemblyscript:
    Container ID:
    Image:          webassembly.azurecr.io/hello-world-wascc-assemblyscript:v0.1.0
    Image ID:
    Port:           8080/TCP
    Host Port:      0/TCP
    State:          Terminated
      Message:      Error while starting container: Error configuring capabilities for module: WebAssembly module authorization failure: Unauthorized binding: actor MA6DECXXYRIRPWYJAIKQT7ZBPUCJ7HRBLK3ZSDTGE7WWIJ6VU52PZOCI is not authorized to use capability wascc:logging.
      Exit Code:    1
      Started:      Mon, 01 Jan 0001 00:00:00 +0000
      Finished:     Fri, 08 May 2020 10:36:50 -0700
    Ready:          False
    Restart Count:  0
    Environment:
      PORT:  8080
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-x75t7 (ro)
Conditions:
  Type           Status
  PodScheduled   True
Volumes:
  default-token-x75t7:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  default-token-x75t7
    Optional:    false
QoS Class:       BestEffort
Node-Selectors:  beta.kubernetes.io/arch=wasm32-wascc
Tolerations:     krustlet/arch=wasm32-wascc:NoExecute
                 node.kubernetes.io/network-unavailable:NoSchedule
                 node.kubernetes.io/not-ready:NoExecute for 300s
                 node.kubernetes.io/unreachable:NoExecute for 300s
Events:
  Type    Reason     Age        From               Message
  ----    ------     ----       ----               -------
  Normal  Scheduled  <unknown>  default-scheduler  Successfully assigned default/hello-world-wascc-assemblyscript to krustlet

The Krustlet, run as:
RUST_LOG=info \
KUBECONFIG=${HOME}/.kube/config \
./target/debug/krustlet-wascc \
--node-ip=<IP_ADDRESS> \
--node-name=krustlet \
--pfx-password=password \
--pfx-path=./krustlet.pfx \
--port=3000

Outputs:
[2020-05-08T17:36:50Z INFO  wascc_provider] configuring capability wascc:http_server
[2020-05-08T17:36:50Z INFO  wascc_host] Attempting to bind actor MA6DECXXYRIRPWYJAIKQT7ZBPUCJ7HRBLK3ZSDTGE7WWIJ6VU52PZOCI to default,wascc:http_server
[2020-05-08T17:36:50Z INFO  wascc_httpsrv] Received HTTP Server configuration for MA6DECXXYRIRPWYJAIKQT7ZBPUCJ7HRBLK3ZSDTGE7WWIJ6VU52PZOCI
[2020-05-08T17:36:50Z INFO  wascc_provider] configuring capability wascc:logging
thread '<unnamed>' panicked at 'called `Result::unwrap()` on an `Err` value: Os { code: 98, kind: AddrInUse, message: "Address already in use" }', /home/dazwilkin/.cargo/registry/src/github.com-1ecc6299db9ec823/wascc-httpsrv-0.6.0/src/lib.rs:92:26
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

It appears (!) to successfully use the wascc:http_server capability but fail on wascc:logging.

The wasm module needs to be signed (via wascap) with the logging
capability.
On Fri, May 8, 2020, 1:41 PM Daz Wilkin<EMAIL_ADDRESS>wrote:

This may just be me and/or a limitation of my attempt to run krustlet w/
MicroK8s.
kubectl apply --filename=https://raw.githubusercontent.com/deislabs/krustlet/master/demos/wascc/hello-world-assemblyscript/k8s.yaml
pod/hello-world-wascc-assemblyscript https://raw.githubusercontent.com/deislabs/krustlet/master/demos/wascc/hello-world-assemblyscript/k8s.yamlpod/hello-world-wascc-assemblyscript configured
kubectl describe pod/hello-world-wascc-assemblyscript
Name:         hello-world-wascc-assemblyscript
Namespace:    default
Priority:     0
Node:         krustlet/
Labels:
Annotations:  Status:  Failed
Message:      Failed to run pod: Error configuring capabilities for module: WebAssembly module authorization failure: Unauthorized binding: actor MA6DECXXYRIRPWYJAIKQT7ZBPUCJ7HRBLK3ZSDTGE7WWIJ6VU52PZOCI is not authorized to use capability wascc:logging.
IP:
IPs:
Containers:
hello-world-wascc-assemblyscript:
Container ID:
Image:          webassembly.azurecr.io/hello-world-wascc-assemblyscript:v0.1.0
Image ID:
Port:           8080/TCP
Host Port:      0/TCP
State:          Terminated
Message:      Error while starting container: Error configuring capabilities for module: WebAssembly module authorization failure: Unauthorized binding: actor MA6DECXXYRIRPWYJAIKQT7ZBPUCJ7HRBLK3ZSDTGE7WWIJ6VU52PZOCI is not authorized to use capability wascc:logging.
Exit Code:    1
Started:      Mon, 01 Jan 0001 00:00:00 +0000
Finished:     Fri, 08 May 2020 10:36:50 -0700
Ready:          False
Restart Count:  0
Environment:
PORT:  8080
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from default-token-x75t7 (ro)
Conditions:
Type           Status
PodScheduled   True
Volumes:
default-token-x75t7:
Type:        Secret (a volume populated by a Secret)
SecretName:  default-token-x75t7
Optional:    false
QoS Class:       BestEffort
Node-Selectors:  beta.kubernetes.io/arch=wasm32-wascc
Tolerations:     krustlet/arch=wasm32-wascc:NoExecute
node.kubernetes.io/network-unavailable:NoSchedule
node.kubernetes.io/not-ready:NoExecute for 300s
node.kubernetes.io/unreachable:NoExecute for 300s
Events:
Type    Reason     Age        From               Message

Normal  Scheduled    default-scheduler  Successfully assigned default/hello-world-wascc-assemblyscript to krustlet
The Krustlet, run as:
RUST_LOG=info
KUBECONFIG=${HOME}/.kube/config
./target/debug/krustlet-wascc
--node-ip=<IP_ADDRESS>
--node-name=krustlet
--pfx-password=password
--pfx-path=./krustlet.pfx
--port=3000
Outputs:
[2020-05-08T17:36:50Z INFO  wascc_provider] configuring capability wascc:http_server
[2020-05-08T17:36:50Z INFO  wascc_host] Attempting to bind actor MA6DECXXYRIRPWYJAIKQT7ZBPUCJ7HRBLK3ZSDTGE7WWIJ6VU52PZOCI to default,wascc:http_server
[2020-05-08T17:36:50Z INFO  wascc_httpsrv] Received HTTP Server configuration for MA6DECXXYRIRPWYJAIKQT7ZBPUCJ7HRBLK3ZSDTGE7WWIJ6VU52PZOCI
[2020-05-08T17:36:50Z INFO  wascc_provider] configuring capability wascc:logging
thread '' panicked at 'called Result::unwrap() on an Err value: Os { code: 98, kind: AddrInUse, message: "Address already in use" }', /home/dazwilkin/.cargo/registry/src/github.com-1ecc6299db9ec823/wascc-httpsrv-0.6.0/src/lib.rs:92:26
note: run with RUST_BACKTRACE=1 environment variable to display a backtrace
It appears (!) to successfully use the wascc:http_server capability but
fail on wascc:logging.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/deislabs/krustlet/issues/239, or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADI4TINIUDVDH3NU6WYIDTTRQQ75TANCNFSM4M4KZ3XA
.

It could be the address in use message causing the failure and the logging bit is a red herring (check to make sure the wasm module is signed with that capability):
kind: AddrInUse, message: "Address already in use" }

Yes, I'm not yet convinced that my MicroK8s install is correctly installed but I'm somewhat reliant on the available demos to test it.
IIUC, I should not need to do anything in addition to the demos for them to run.
In this case, I assume I can wasm-to-oci pull the container from Azure and then run wascaps on it to confirm whether logging is enabled.

go run ./cmd pull webassembly.azurecr.io/hello-world-wascc-assemblyscript:v0.1.0
INFO[0002] Pulled: webassembly.azurecr.io/hello-world-wascc-assemblyscript:v0.1.0
INFO[0002] Size: 14010
INFO[0002] Digest: sha256:17455af5cb6c549ed8ae545b6cdae5e2331ba348e04e7ceb9983ffa38b97c2c0

And:
wascap caps ./module.wasm
╔════════════════════════════════════════════════════════════════════════╗
║                          Hello World - Module                          ║
╠═════════════╦══════════════════════════════════════════════════════════╣
║ Account     ║ AD35VWRBJ2DPYRZU3PG2JYFHIZOYT52MHVP5CAVQQBBNGNCF3WV7SIBF ║
╠═════════════╬══════════════════════════════════════════════════════════╣
║ Module      ║ MA6DECXXYRIRPWYJAIKQT7ZBPUCJ7HRBLK3ZSDTGE7WWIJ6VU52PZOCI ║
╠═════════════╬══════════════════════════════════════════════════════════╣
║ Expires     ║                                                    never ║
╠═════════════╬══════════════════════════════════════════════════════════╣
║ Can Be Used ║                                              immediately ║
╠═════════════╬══════════════════════════════════════════════════════════╣
║ Version     ║                                                 None (0) ║
╠═════════════╩══════════════════════════════════════════════════════════╣
║                              Capabilities                              ║
╠════════════════════════════════════════════════════════════════════════╣
║ HTTP Server                                                            ║
╠════════════════════════════════════════════════════════════════════════╣
║                                  Tags                                  ║
╠════════════════════════════════════════════════════════════════════════╣
║ None                                                                   ║
╚════════════════════════════════════════════════════════════════════════╝

This confirms the wasm module doesn't have permission to use the wascc:logging capability.

Yes.
So, IIUC, the demo author needs to resign it?
I remain unclear why I'm getting the address in use. I'm running Kubernetes and Krustlet on the same host. MicroK8s uses the host's :8080 but the Krustlet should be able to run a Pod that includes a container that uses this port. This shouldn't conflict when the host's ports.

This is caused due to merging #22. All actors are now bound with the wascc::logging capability regardless if they're authorized to use it or not.
There are two options we can do here:

we can re-sign the modules to consume wascc::logging, or
if the actor doesn't have permission to use a particular capability, then the waSCC provider shouldn't bind the actor to that capability. This had to be done in #192 for wascc::blobstore, for example.

My initial thoughts think it may be best to go the second route. This results in actors that are signed off on the bare minimum number of capabilities required to perform their work, and it'd be up to the runtime to bind those actors to the capabilities it has available or error out if it cannot provide a capability the actor requires. Do you agree @autodidaddict?

I think the latter is the safer approach. In some of the custom hosts I'm building, I never call bind unless the actor has that capability in its claims.


floor age and enforce zipcode as int

Title: Floor age and set zipcodes as int
Description

Category: bugfix
JIRA issue: MIC-3932
Research reference: na

Changes and notes
This PR does two simple things. When post-processing:

Force zipcodes to be integers (currently they are floats)
Modify the "real" age (which is a floag, eg 39.384623) to int (eg 39)

Verification and Testing
spot checked a bit. I'm re-running make_results on the full-pop sim that Jim ran last week.

Thank you!


New topic

this is a new troubleshooting topic

Hi @Antvgski, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!

It looks like you're a Microsoft contributor (Anthony van Gemert). If you're full-time, we DON'T require a Contribution License Agreement. If you are a vendor, please DO sign the electronic Contribution License Agreement. It will take 2 minutes and there's no faxing! https://cla.microsoft.com.

TTYL, MSBOT;

cancel this topic