FileNotFoundError on older Pythons

Recently and inexplicably, tests have started failing on Python 3.2 and earlier in Travis-CI, such as seen in this run.

I'm able to replicate this failure on my local workstation.

I can't tell when this issue started. It looks like there was a clean build 5 days ago, and the first failure happened about an hour ago, so something apparently changed in Travis-CI and on my machine in that period. I haven't run brew update this week. I've tried downgrading pip and tox and setuptools, but to no avail.

I can replicate the failure surgically running this command:
python -m tox -e py27 -- -k 'test_local_index and test_easy_install'

Even if I go back to the code where the last clean build happened, I get the error, so it's definitely something environmental triggering the failure. I noticed that pytest was recently updated to 3.0.4, so I tried downgrading pytest to 3.0.3, but that did not help.

I grabbed the requirements specifically from the list of requirements emitted in the last clean build (thanks pytest for reporting that information), and the test passes. Now I should be able to bisect those changes and find the offending package.

Installing flake8==3.2.1 and pyflakes==1.3.0 causes the failure whereas flake8==3.0.4 and pyflakes==1.2.3 does not.

It seems that with these later versions of flake8 and pyflakes installed, the setuptools module is getting picked up in the current directory with a file attribute that's relative to the current working directory. Here I've replicated the issue without setuptools source:
$ tree
.
├── setuptools
│   └── __init__.py
├── test_issue852.py
└── tox.ini

1 directory, 3 files
$ cat test_issue852.py
import setuptools

def test_path():
    assert setuptools.__file__.startswith('/')
$ cat tox.ini
[tox]
skipsdist = true

[testenv]
deps =
  pyflakes == 1.3.0
  flake8 == 3.2.0
  pytest-flake8
  pytest
commands =
  python -m pytest
$ python -m tox -e py27
py27 installed: configparser==3.5.0,enum34==1.1.6,flake8==3.2.0,mccabe==0.5.2,py==1.4.31,pycodestyle==2.2.0,pyflakes==1.3.0,pytest==3.0.4,pytest-flake8==0.8.1
py27 runtests: PYTHONHASHSEED='888178008'
py27 runtests: commands[0] | python -m pytest
====================================== test session starts =======================================
platform darwin -- Python 2.7.12, pytest-3.0.4, py-1.4.31, pluggy-0.4.0
rootdir: /Users/jaraco/issue-852, inifile:
plugins: flake8-0.8.1
collected 1 items

test_issue852.py F

============================================ FAILURES ============================================
___________________________________________ test_path ____________________________________________

    def test_path():
>       assert setuptools.__file__.startswith('/')
E       assert False
E        +  where False = <built-in method startswith of str object at 0x11048f9b0>('/')
E        +    where <built-in method startswith of str object at 0x11048f9b0> = 'setuptools/__init__.py'.startswith
E        +      where 'setuptools/__init__.py' = setuptools.__file__

test_issue852.py:4: AssertionError
==================================== 1 failed in 0.05 seconds ====================================
ERROR: InvocationError: '/Users/jaraco/issue-852/.tox/py27/bin/python -m pytest'
____________________________________________ summary _____________________________________________
ERROR:   py27: commands failed

And I've confirmed, running that same test with pyflakes 1.2.3 and flake8 3.0.4, the test passes.

Here are the differences in pyflakes and the differences in flake8.

One noticeable difference in flake8 is it now imports setuptools in flake8/main/debug.py. Indeed, if I comment out that import, the problem goes away.

Running pdb, I can see the stack when that import is invoked. It's early in the pytest setup:
$ python -m tox -e py27
py27 installed: configparser==3.5.0,enum34==1.1.6,flake8==3.2.1,mccabe==0.5.2,py==1.4.31,pycodestyle==2.2.0,pyflakes==1.3.0,pytest==3.0.4,pytest-flake8==0.8.1
py27 runtests: PYTHONHASHSEED='2843664332'
py27 runtests: commands[0] | python -m pytest
> /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/flake8/main/debug.py(8)<module>()
-> import setuptools
(Pdb) w
  /usr/local/Cellar/python/2.7.12_2/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py(174)_run_module_as_main()
-> "__main__", fname, loader, pkg_name)
  /usr/local/Cellar/python/2.7.12_2/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py(72)_run_code()
-> exec code in run_globals
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/pytest.py(17)<module>()
-> raise SystemExit(pytest.main())
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/_pytest/config.py(47)main()
-> config = _prepareconfig(args, plugins)
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/_pytest/config.py(132)_prepareconfig()
-> pluginmanager=pluginmanager, args=args)
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/_pytest/vendored_packages/pluggy.py(745)__call__()
-> return self._hookexec(self, self._nonwrappers + self._wrappers, kwargs)
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/_pytest/vendored_packages/pluggy.py(339)_hookexec()
-> return self._inner_hookexec(hook, methods, kwargs)
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/_pytest/vendored_packages/pluggy.py(334)<lambda>()
-> _MultiCall(methods, kwargs, hook.spec_opts).execute()
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/_pytest/vendored_packages/pluggy.py(613)execute()
-> return _wrapped_call(hook_impl.function(*args), self.execute)
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/_pytest/vendored_packages/pluggy.py(248)_wrapped_call()
-> call_outcome = _CallOutcome(func)
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/_pytest/vendored_packages/pluggy.py(265)__init__()
-> self.result = func()
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/_pytest/vendored_packages/pluggy.py(614)execute()
-> res = hook_impl.function(*args)
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/_pytest/config.py(882)pytest_cmdline_parse()
-> self.parse(args)
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/_pytest/config.py(1038)parse()
-> self._preparse(args, addopts=addopts)
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/_pytest/config.py(1001)_preparse()
-> self.pluginmanager.load_setuptools_entrypoints(entrypoint_name)
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/_pytest/vendored_packages/pluggy.py(510)load_setuptools_entrypoints()
-> plugin = ep.load()
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/pkg_resources/__init__.py(2291)load()
-> return self.resolve()
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/pkg_resources/__init__.py(2297)resolve()
-> module = __import__(self.module_name, fromlist=['__name__'], level=0)
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/_pytest/assertion/rewrite.py(212)load_module()
-> py.builtin.exec_(co, mod.__dict__)
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/py/_builtin.py(221)exec_()
-> exec2(obj, globals, locals)
  <string>(7)exec2()
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/pytest_flake8.py(6)<module>()
-> from flake8.main import application
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/flake8/main/application.py(14)<module>()
-> from flake8.main import options
  /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/flake8/main/options.py(3)<module>()
-> from flake8.main import debug
> /Users/jaraco/issue-852/.tox/py27/lib/python2.7/site-packages/flake8/main/debug.py(8)<module>()
-> import setuptools

In the context of the test, sys.path looks like: ['/Users/jaraco/issue-852', '', '/Users/jaraco/issue-852/.tox/py27/lib/python27.zip', .... So whatever is adding that absolute path before the '' path is what's allowing the tests to pass when setuptools wasn't imported during the plugin setup phase, but that initial value is not present at the time the plugins are initialized.

I notice that the issue does not occur on Python 3.3+ because import setuptools creates a setuptools.__file__ that's absolute, even when setuptools is resolved from a sys.path entry of ''.

This latest commit fixed most of the failures, but something is still failing on pypy3. Aah. It's support for Python 3.2 dropped from pip. Separate issue.


Support --rehydrate-priority on az storage blob copy start-batch

Related command
az storage blob copy start-batch
Is your feature request related to a problem? Please describe.
az storage blob copy start supports --rehydrate-priority for copying an archived blob with high priority. This functionality is missing from az storage blob copy start-batch.
Describe the solution you'd like
Add the same support to az storage blob copy start-batch.
Describe alternatives you've considered
Enumerate and copy.

Thank you for opening this issue, we will look into it.


Verify Vulkan 1.1 presence

When validating the adapterLuid in layer.cpp vkGetPhysicalDeviceProperties2 is used. This is a Vulkan 1.1 feature. The interop layer however does not verify that the user actually created a Vulkan 1.1 instance. When creating a Vulkan 1.0 instance with the interop layer, the error message given is very confusing. It tells the user that the incorrect graphics adapter is used, which is not the case. The correct graphics adapter is used, the user is just not creating a Vulkan 1.1 instance. The interop layer should check for Vulkan 1.1 presence and give a good error message in case it is not present.
Is seems that very recent nvidia drivers have become more strict. Previously they would allow a call to vkGetPhysicalDeviceProperties2 on a Vulkan 1.0 instance, now the function doesn't return any valid data. Repoing this issue is simple: On latest nvidia drivers, try to use the interop layer with vulkan 1.0.

Thanks, you are correct, I encountered and fixed this issue in another project that includes this code, but did not backport here!

Fixed by 0bf812c05c21fc5492709c5abf709295e72ec6ba.


3DTransforms: various labelling issues

https://developer.microsoft.com/en-us/microsoft-edge/testdrive/demos/3dtransforms/

Labels for sliders are table cells rather than labels. We probably want to replace with true range controls and labels to make it easier to make accessible.
Similar issue with label for radios
Buttons such as delete, move up and move down have no text or aria-label.

@dstorey @sarvaje This demo is external, namely, it's from https://testdrive-archive.azurewebsites.net/Graphics/hands-on-css3/hands-on_3d-transforms.htm.


[Feature] remove the use of sun.misc.Signal

Search before asking

[X] I had searched in the issues and found no similar feature requirement.

Problem Description
because of the jdk 11 will remove the sun.misc.Signal api,  linkis should remove the use of sun.misc.Signal
Description
no
Use case
no
solutions
use shudowHook to replace the use of Signal
Anything else
no
Are you willing to submit a PR?

[X] Yes I am willing to submit a PR!

finished


prevent both npm and yarn commands from being copied

This change isolates npm command and yarn command because if it is in the same shell code then both gets copied at the same time when copy button is clicked.

Thanks!


fix(docker): log split

avoid cloudwatch logevent limit

:tada: This PR is included in version 4.1.4 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Error: Cannot find module 'moment'

In version 0.4.1 the require of moment module is missing. Also, always is returned the following error message: "TypeError: Cannot read property 'email' of undefined" when I try to call the .login() function.

Hi @jpauloeti, thanks for you feedback.
Currently this module is in heavy development and the documentation is outdated :( In the meantime i can provide you some example code:
(Notice that all function now returns a Promise and there is no cb parameter.
If you have more questions you can contact me at: https://twitter.com/barczaG.
If you are interested in Contributing please also contact :)
const readline = require('readline')
const Fut = require('fut')
// const Promise = require('bluebird')
const co = require('co')
// const _ = require('underscore')
const storage = require('node-persist')
storage.initSync()

var rl = readline.createInterface({
  input: process.stdin,
  output: process.stdout
})

var fut = new Fut({
  email: '',
  password: '',
  secret: '',
  platform: '',
  captchaHandler: (captcha) => console.log('do something with the captcha'),
  tfAuthHandler: (send) => {
    rl.question('Enter your two factor code:', function (code) {
      send(code)
    })
  },
  // saveVariable: co.wrap(function * (key, val) {
  //   console.log('setting item', key, val)
  //   // storage.setItem(key, val)
  // }),
  saveVariable: (key, val) => {
    console.log('setting item', key)
    storage.setItem(key, val)
  },
  loadVariable: co.wrap(function * (key) {
    console.log('getting item', key)
    var item = storage.getItem(key)
    return item
    // return storage.getItem(key)
  })
})

co(function * () {
  yield fut.login()
  let resp = yield fut.getCredits()
  console.log(resp)
}).catch((e) => console.log(e.stack))

Wow this is great! I already were using promises with the old code.
Good job! ;)


ScanCode: use pinned dependency constraints

This PR fetches the requirements.txt from ScanCode repo
to use them as constraints in a pip installation command.
This guarantees that the dependency versions are tested
to work with the ScanCode version
Signed-off-by: Philippe Ombredanne<EMAIL_ADDRESS>

Unfortunately, this does not seem to solve the issue.

Unfortunately, this does not seem to solve the issue.

@pombredanne  The same change needs to be done in .github/workflows/build-and-test.yml because the failing test does not run in Docker.

@pombredanne Due to urgency I have updated #5691 with your changes and also tried to address the review comments from this PR.

Superseded by https://github.com/oss-review-toolkit/ort/pull/5691.


In Platform io, how to remove FirmwareUpdate configuration during compilation?

Sorry that your issue remained unanswered. I'm closing this assuming it's no longer relevant.


Update v1.7.0

Regenerated the Go client with the latest changes from dev for 1.7.0.
I've also improved our synchronization script a bit to edit files in-place with sed, rather than piping things around with grep.

needs a regen

@timvisee you still need to delete the generated snapshot files that you committed :)

sorry for the fat finger :sweat_smile:

sorry for the fat finger 😅

My bad. Fixed!


Lazy evaluation of dynamic menu items

JWM is sometimes used on old machines. Evaluating 'dynamic' menu items each time root menu gets activated might be a problem. It might cause an interruption, sort of jerky performance. Perhaps 'dynamics' might be evaluated only after parent container gets activated. IceWM seems to be working that way.
How could lazy evaluation help ? One might create a sub menu and put dynamic entry inside it. If it gets evaluated only when parent sub menu gets activated, one should experience no interruption in other branches of root menu.
It is not a big issue. I have replaced 'Dynamic' entry with a 'program' entry labeled 'refresh'. It creates a file which gets included using 'include' tag.

This should not be a problem unless you are using something like java to do the dynamic parts.  I wrote a menu generator that parses all of the .desktop files in /usr/share/applications, complete with localization, that executes on an old pentium in <0.2s.
FWIW the menu generator that puppy was using at the time was written in C and was 20x slower, but no, I'm not saying that shell script is faster than C.
See http://www.murga-linux.com/puppy/viewtopic.php?t=70238 for some good tips.
Basically, avoid making external calls to sed, grep, awk, etc... when there is a way to do it with shell builtins because the elf dynamic loading overhead far outweighs the benefits of using external utilities 99% of the time.
I have quite a few that would be useful to put up on github once I update them to the current state (or perhaps add a ./contrib directory to jwm's repo?).
Here is an example (busybox ash) script that I wrote for use as the StartupCommand
(Note the lack of any external commands - only shell builtins)
#!/bin/ash

matchDeskEnv(){
   ret=1; IFS=";"
   for Env in ${1}; do
      case ":${XDG_CURRENT_DESKTOP}:" in
         *":${Env}:"*)ret=0;break;;
      esac
   done
   return $ret
}

doDesktopFile(){
   EXEC="";EXECPATH="";BACK=$PWD
   while read LINE; do
      case "$LINE" in
         Exec=*)EXEC=${LINE#*=};;
         Path=*)EXECPATH=${LINE#*=};;
         Hidden=true*)return;;
         OnlyShowIn=*)matchDeskEnv ${LINE#*=} || return;;
         NotShowIn=*)matchDeskEnv ${LINE#*=} && return;;
      esac
   done < $1
   [ "$EXECPATH" ] && cd $EXECPATH
   [ "$EXEC" ] && $EXEC &
   [ "$EXECPATH" ] && cd $BACK
}

AUTOSTARTDIR=${XDG_CONFIG_HOME:-${HOME}/.config/}/autostart
for Entry in ${AUTOSTARTDIR}/*.desktop; do
   doDesktopFile $Entry
done

IFS=":"
for DIR in ${XDG_CONFIG_DIRS:-/etc/xdg}; do
   for Entry in ${DIR}/autostart/*.desktop; do
      #allow users to block/override system settings
      [ -f "${AUTOSTARTDIR}/${Entry##*/}" ] && continue
      [ -f "${Entry}" ] && doDesktopFile $Entry
   done
done

FWIW, I rewrote many of the old hotplug scripts using these same guidelines and they outperformed udev.


manage packages in generated project differently

use requirements.txt in projects instead of poetry to support conda and uv.
add a flag to use poetry, but default to reqs
resolves #40

Use pyproject.toml for easy conda support without any other package manager.

@the-praxs i'd definitely like to use pyproject.toml still but probably need to stop using the poetry tag for deps


Integration with Keystone

I'm doing:
Post.paginate({
    page: req.query.page || 1,
    perPage: 50,
    maxPages: 10
}).populate('comments','author content date')
.deepPopulate('author.name')

and i included the plugin like so:
var deepPopulate = require('mongoose-deep-populate');
Post.schema.plugin(deepPopulate);
Post.register();

But i still get the error:
TypeError: undefined is not a function

Anyone got it working with keystone?

I answered this here. You might want to send a question to KeystoneJS instead as I don't know how they wrap Mongoose.

Hi there,
I was having this problem recently and made a few discoveries.
Vykintas, your setup appears to be very similar to mine and should work, although you can put your 1st level population requests into the deepPopulate call and specify your projection in the Post.schema.plugin call.
I found that when 'deepPopulate' is installed it adds the latest version of mongoose as a dependency to your project if it isn't already specified, currently version 4.x but it can work with earlier releases.  Keystone also has mongoose as a dependency and uses version 3.8.x.  The two aren't compatible and when you use the plugin call, 'deepPopulate' doesn't end up where it's supposed to be and will fail when called.
To fix this simply add mongoose as a dependency to your package.json file at a version to match that found in Keystone (currently 3.8.x).
BTW, Thanks for a great module BN.

@AndrewFinlay great digging, thanks. This makes a lot of sense. If you can submit a PR for the README to highlight this, it's much appreciated.

I must still be missing something. I 've verified that both the keystone and mongoose-deep-populate package.json files refrence the same mongoose version:

  "peerDependencies": {
    "mongoose": "~3.8.24"
  },

and have verified that the plugin is registered as a method for the schema:

{ deepPopulate: [Function],
  getRelated: [Function],
  populateRelated: [Function],
  getUpdateHandler: [Function] }

Yet I still get:

TypeError: undefined is not a function

Any suggestions?

The key thing is that both this plugin and Keystone must work on the same instance of mongoose. From my cursory look at Keystone, it looks like Keystone will use its own instance due to the declaration of mongoose as dependency (instead of peerDependency). So when Keystone and this plugin use require to load mongoose, each will have a different instance.
There are 2 ways to fix this:

See if you can pass the mongoose instance "required" from your app to Keystone to use. I'm not sure if Keystone has an API for this. If it does, then the code might look something like this:

var mongoose = require('mongoose')
var keystone = require('keystone')
keystone.set('mongoose', mongoose)

Pass the mongoose instance used by Keystone to mongoose-deep-populate. You need to get code from the experimental 2.0 branch.

var mongoose = mongoose_instance_used_by_keystone
var deepPopulate = require('mongoose-deep-populate')(mongoose)

Thank you!
I used the second option:

var mongoose = (keystone.mongoose)
var deepPopulate = require('mongoose-deep-populate')(mongoose);

Works perfectly

Modify the readme and create a pr?.
From: razb<EMAIL_ADDRESS>Sent: Friday, 12 June 2015 8:54 AM
To: buunguyen/mongoose-deep-populate
Cc: AndrewFinlay
Subject: Re: [mongoose-deep-populate] Integration with Keystone (#18)
I must still be missing something. I 've verified that both the keystone and mongoose-deep-populate package.json files refrence the same mongoose version:
"peerDependencies": {
"mongoose": "~3.8.24"
},
and have verified that the plugin is registered as a method for the schema:
{ deepPopulate: [Function],
getRelated: [Function],
populateRelated: [Function],
getUpdateHandler: [Function] }
Yet I still get:
TypeError: undefined is not a function
Any suggestions?
—
Reply to this email directly or view it on GitHub https://github.com/buunguyen/mongoose-deep-populate/issues/18#issuecomment-111298745 .  https://github.com/notifications/beacon/ADhW3s1TWdK-LBVPhYs3X5QkWe5doFmAks5oSgjsgaJpZM4ET2PP.gif

@AndrewFinlay already in the experimental branch.

Released 2.0.0.

@buunguyen I'm a bit unclear, have you gotten this working? It's not working for me using the methods described above.


Ridiculously insecure bot

Go change your password

c.read gave me your password and bot token.

This was such a mistake.


Deprecate AzureDataFactoryRunPipelineOperatorAsync

Deprecate AzureDataFactoryRunPipelineOperatorAsync and
proxy it to its Airflow OSS provider's counterpart
related: #1412

Successful DAG run locally after these changes


Logs not displayed for webscoket connections

Hi team,
First of all thank you for the wonderful server. I am using Django + Channels for one web application. I want to use granian (granian==1.5.2) as server. Here, I do not see any logs for websocket requests.
My log config and command to run server is as below:
 granian --interface asgi myapp.asgi:application --access-log --access-log-fmt "%(time)s %(addr)s - %(method)s %(path)s %(protocol)s %(status)d %(dt_ms).3f %(query_string)s %(scheme)s"

Thank you

@gi0baro Thank you so much for the reply. Have a great weekend ahead.


feat: support python 3.10 union types

Resolves #46.

Thanks for contributing! It looks good - I'll test it a bit as well, and then I think we can merge this.

@roalonso I've released it as 0.1.22 - let me know if it doesn't work as expected. Thank you for your contribution!

It's working great. Thank you for reviewing, testing and merging on such short notice!


Sse2

added _mm_cvtsd_si64
added _mm_cvttsd_si64
fix #83

Thanks! I think the CI failure is not your fault, so I'm going to go ahead and merge


chore: Add Python Client examples [docs]

Part of apify/apify-web/issues/3616
Added multiple examples, consulted with @vdusek.
First three are the same as JavaScript ones, just reimplemented to Python. Last one is using Python-specific Pandas library for data analysis.

@vdusek Maybe I could explain differences in the paragraphs above code? I believe this particular examples makes sense with different sync/async approaches


No Indian phone numbers accepted while signing up

reported by @darthrider678:matrix.org
https://github.com/matrix-org/riot-android-rageshakes/issues/243

The indian phone numbers are not yet supported server side.
For example, +91<PHONE_NUMBER> does not work.

They should be considered valid by the libphonenumber library tho.
I filled an issue on the github page of the library.

It is not a libphonenumber issue but the matrix severs don't support the indian phonenumbers

Not an android issue


upgrade to v3: mention MR approvals syntax change

Related to #388 and #263

After a recent Gitlab instance upgrade I finally got around to upgrading Gitlabform too.
While porting the configs I've noticed that the current version doesn't like the approvals_before_merge outside of merge_requests_approval_rules (see below) so I'm proposing to mention this in the upgrade guide.
Processing section 'merge_requests_approvals'
Error: Setting the 'approvals_before_merge' in the 'merge_requests_approvals' sections is not allowed as it is not clear which rule does it apply to. Please set it inside the specific approval rules in the 'merge_requests_approval_rules' section.

Sure, why not. Thanks for the contribution, @weakcamel!


Online Inference Latency for XR-TRANSFORMER

hi！
When I use XR-TRANSFORMER for predict(per input), the online Inference lattency comes up to 400ms. this is why?
the system I use is ubtuntu18.04, and XR-TRANSFORMER are evaluated on a Nvidia Tesla V100 GPU.
Thanks!

What model (encoder, output space) are you running inference on? Could you provide sample code how you measure the latency?

the encoder is chinese-roberta-wwm-ext,the outspace is 1073 labels。the XR-TRANSFORMER model is embedded in Flask service。the measure method of the online Inference lattency is to send post http requeset method-post。the average of  the online Inference lattency of 100 instances is about 420ms。the running env that the Flask service is deployed is a docker container which has 8GPU, 16GBmemory, 1 V100  GPU
there is sample code:
import time
start = time.time()
for i, text in enumerate(X_text):
    if i >= 100:
        break
    payload={'text': text}
    r = requests.post(url_2, json=payload)
    res.append(r.json()["result"])
(time.time() - start) * 1000 / 100

Could you also look at the inference time on your local GPU machine (without http request)?

Sorry, I don't have a a local GPU machine, I can test the online Inference lattency  of XR-TRANSFORMER in a docker conotainer(I think the effect is the same as in a local GPU machine) based on k8s。
there is sample code:
import time

def predict(text):
    """
    Use the XR-Transformer model to predict on single text,and the predict time of single instance.

    args:
        text(str): the input text to predict on.

    return:
        pred_csr：instance to label prediction (csr_matrix, 1 * nr_labels).
        pred_time:the predict time of instance (unit: ms).

    """
    tokenized_text = ' '.join(HanLP(text))
    x = vectorizer.transform([tokenized_text])
    tfidf_x = tfidf_transformer.transform(x)
    tfidf_x.sort_indices()
    start_time = time.time()
    P_matrix = xtf.predict([text],X_feat=tfidf_x,use_gpu=True)
    pred_time = (time.time() - start_time) * 1000

    return P_matrix, pred_time

def test_online_inference_latency(corpus, n):
    """
    test the average online inference latency of XR-TRANSFORMER.

    args：
        corpus(List(str)):instance text list to predict on.
        n:num of ins for predict.

    return:
        average_time:the average online inference latency of sing instance.

    """
    total_time = 0
    for i, text in enumerate(corpus):
        if i == 0:
            _, _ = predict(text) # the first instance used for initializing XR-TRANSFORMER（copy to GPU）
            continue
        if i <= n:
            _, tmp = predict(text)
            total_time += tmp
        else:
            break
    return total_time / n

test_online_inference_latency(X_text, 100)

the average of the online Inference lattency of 100 instances is about 402ms.

Hi @xiaokening , the XRTransformer.predict is an API for batch inference (e.g. including dataset construction, batching, logging and etc). You can just XRTransformer.predict on the 100 data with batch_size=1 for an estimation of the realtime inference time. We are planning to enable a realtime inference API for XR-Transformer in later releases. Thanks.


static pre compiled assets gone after v1.1.19.

The pre-compiled assets are gone from all releases after v1.1.19. Please bring them back.

Fixed with release https://github.com/projectdiscovery/mapcidr/releases/tag/v1.1.14

This should be resolved with the most recent version! Thanks for the issue!
https://github.com/projectdiscovery/mapcidr/releases/tag/v1.1.14


test: Unit test for HasHoverables

Description

🚨 Unit test for HasHoverables

Checklist

[x] The title of my PR starts with a Conventional Commit prefix (fix:, feat:, docs: etc).
[x] I have followed the Contributor Guide when preparing my PR.
[ ] I have updated/added tests for ALL new/updated/fixed functionality.
[ ] I have updated/added relevant documentation in docs and added dartdoc comments with ///.
[ ] I have updated/added relevant examples in examples or docs.

Breaking Change?

[ ] Yes, this PR is a breaking change.
[x] No, this PR is not a breaking change.

Related Issues

Is there anything more left of #2017?

Is there anything more left of #2017?

This is not from event mixins. flame -> src -> events -> game_mixins already done.
This is from flame -> src -> game -> mixins. I am checking whole flame package and whatever is missing, writing test cases for that.

Is there anything more left of #2017?

This is not from event mixins (#2017 ). flame -> src -> events -> game_mixins already done.
This is from flame -> src -> game -> mixins. I am checking whole flame package and whatever is missing, writing test cases for that.

Super!


generalized linear Poisson regression with parameter constraints?

Is there an example to implement the generalized linear kernel described in http://users.iems.northwestern.edu/~armbruster/2007msande444/report1a.pdf section 1.5 ? It reminds me of a finite impulse response filter in signal processing. How would the constraints be handled?

Have you checked this Hawkes learner?
https://x-datainitiative.github.io/tick/auto_examples/plot_hawkes_em.html
It is not exactly identical but it allows you to fit kernels with random shapes. With this algorithm, positivity constraints are respected by design.

Interesting, I did see that.. I will give it a try. I notice the comment
says it doesn't scale well, but the paper I linked to mentions that
using a primal-dual interior point convex optimization algorithm has
very good performance, it will take me some time to determine how to
implement this though.. unless someone on the project has an idea about
that? The kernel form they mention there says it has a global optimum in
the likelihood surface, so thats a  nice feature of the method

I haven't checked closely but in my mind, they want to use primal-dual interior point convex optimization to satisfies their inequality constraints. It's not easy to understand how they use it though.
By the way, they say its optimization is fast compared to the one above which a Hawkes process with an exponential kernel and unknown decay. Because of the unknown decay, the loss is non-convex and you have local minima: a very bad scenario. I would be very surprised if they were arguing that it was optimized faster than the exponential kernel with a given decay which is, as far as I know, that one that scales the best in terms of the number of events and the number of nodes.

this thread has some relevant information ,
https://stats.stackexchange.com/questions/113872/under-what-circumstances-is-the-log-likelihood-function-of-a-point-process-conca
On May 16, 2017 11:16 AM, "Martin"<EMAIL_ADDRESS>wrote:

I haven't checked closely but in my mind, they want to use primal-dual
interior point convex optimization to satisfies their inequality
constraints. It's not easy to understand how they use it though.
By the way, they say its optimization is fast compared to the one above
which a Hawkes process with an exponential kernel and unknown decay.
Because of the unknown decay, the loss is non-convex and you have local
minima: a very bad scenario. I would be very surprised if they were arguing
that it was optimized faster than the exponential kernel with a given decay
which is, as far as I know, that one that scales the best in terms of the
number of events and the number of nodes.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/X-DataInitiative/tick/issues/18#issuecomment-301834349,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AWYZJmX146_VwR_5TKMP56YQAI_4HTSJks5r6cvMgaJpZM4NaNXl
.

here is some matlab code which implements generalized linear Hawkes process which uses the convex optimization library CVX for matlab at http://cvxr.com/cvx/

http://ask.cvxr.com/t/robust-estimation-of-self-exciting-index-exceeds-matrix-dimensions-running-example/4183


chore(deps): upgrade dev dependencies

Upgrades project dependencies. See details in workflow run.

Automatically created by projen via the "upgrade-dev-dependencies-1.x" workflow

⚪ Backport skipped
The pull request was not backported as there were no branches to backport to. If this is a mistake, please apply the desired version labels or run the backport tool manually.
Manual backport
To create the backport manually run:
backport --pr 1785

Questions ?
Please refer to the Backport tool documentation


[1.4.4] Invalid urls after vulcanize --inline-css

Hey,
The CSS of my components are linked inside their dom-module with a <link rel="import" type="css">.
<dom-module id="my-component">
  <link rel="import" type="css" href="my-component.css">
  <template>

  </template>
</dom-module>

If the externalized CSS contains a reference to another asset...
.outer {
  background: url(image.svg);
}

...then its path is not rewritten and l end up w/ a 404.
If I embed the the stylesheet inside the dom-module with a


Update Ant Design with Less example

Current with-ant-design-less example quite differs from with-ant-design so I made them look the same + updated @zeit/next-less plugin and removed transform-decorators-legacy.

@yakovlevyuri Hey, when I add a few more pages to the with-ant-design-less example I get this webpack error using latest next.js. Since you are making changes to the ant example I figured I would see if you have any idea?  I would like to get this sorted before any new users come along and hit a brick wall trying to extend the example:
https://github.com/zeit/next.js/pull/5212

@Enalmada hm, I've added few more pages and everything seems fine, no errors/warnings.
What OS/node version do you have?
I use macos 10.13.6, node 10.10.0

@yakovlevyuri Just to confirm...you have a few more pages each with different antd components not from the original page and clicking the pages all work fine?  OMG that is so unfair!  I am on Windows 10 with node 10.9 and also tried 10.11.0 with same issue.  I also tried WSL Ubuntu with node 10.10.0.   Kudos though...trying newer node was a good idea.  I will try macos now to rule that out.
If I remove the "import" plugin from .babelrc I no longer get the error but my browser file sizes are obviously massive without the modular import.  If I hit refresh after the error everything actually seems to work fine...I can click around.  It also seems like it might be a dev only issue...I tried build/start with NODE_ENV=production and can't get the error.

@yakovlevyuri Side note...I also noticed that the antd component colors are different in dev and production settings.   Does that happen to you too?
dev

prod

You are right that the problem is more than just any components on multiple pages...I don't get the issue at all with some components and I get it more frequently with others like calendar (List, Tooltip, Table also caused the crash consistently as I added them but it is unclear if it is the raw components or the interaction with stuff on the index page).
@yakovlevyuri Could you humor me and try adding a page with a calendar and another page with a card exactly like my example?  Restart development mode from homepage and click the calendar link.

@Enalmada I have a side project and I'm getting the same warnings/errors using @zeit/next-css as well. I'm going to have a deeper look into this on weekend.

@yakovlevyuri Interesting...thanks for letting me know.  I was feeling crazy.  If you can figure out how to or who could help fix it the next.js/antd community is in your debt.  I tried my best but it is way over my head at the moment.
A workaround might be to have a different .babelrc in dev (without the import) and build with it only.  In my more advanced example though on Next 7 I can't click on any link pointing to a page that imports less.  I can hit the page manually though so server side rendering of it works.  I am hoping the root cause is similar.  Something is funny with next 7 and less/css. :(

I'm going to close this as the PR is stale and has merge conflicts. Thank you very much for your contribution 🙏:pray:


incomplete npm package published

There are only minified versions of files in the npm, see
<EMAIL_ADDRESS>This package is making issues when importing to webpack bundle. Please upload complete repo to to the npm so bundles can be properely optimized :)

cloning this repo to web-animations-js folder in node_modules solves the problem, proving above

Thanks for reporting the issue.

FYI the fix is now live<EMAIL_ADDRESS>


feat: add post by azeen3003

Added a post and updated authors.ts

Done!

Thank you @oyepriyansh 😊


Fix SPARQLgraph CONSTRUCT broken on firefox

problem seems to be with div.scrollIntoViewIfNeeded() in firefox.

Kevin sees this problem when clicking the UI link to SPARQLgraph

With the latest dev build, I'm still seeing an error immediately when opening SPARQLgraph from the RackUI:
Error: Error: Script error for: sparqlgraph/js/cookiemanager
http://requirejs.org/docs/errors.html#scripterror
url: http://localhost:8080/iidx-oss/components/requirejs/require.js
line: 166
undefined
column: 17
error: Error: Script error for: sparqlgraph/js/cookiemanager
http://requirejs.org/docs/errors.html#scripterror

I see this only with Firefox, but not with Brave or Vivaldi (or Chrome), so perhaps this is just a local Firefox install issue.

Paul refuses to take responsibility for the internet


copyIndex error "The provided copy name '' doesn't exist in the resource" when using triple FOR-loops for the same array

Bicep version
0.4.63
Describe the bug
When you are using in a variable with FOR-loop a copyIndex to refer to a certain child resource reference in another FOR-loop for the same array of objects which also uses an index to retrieve its parent that is also in another FOR-loop for the same set of objects, then in the autogenerated ARM template, all the translated copyIndexes for the parent in the copy variable get blanked out.
To Reproduce
Deploy AKS Cluster with the following code for agent pool profiles. For example purpose, only 'name' and the here relevant property 'vnetSubnetID' are listed. The properties of both the resource references and of the variable 'agentPoolProfiles' are all populated using the same array [for agentPool in aksCluster.agentPools].
// Get existing vnets
resource virtualNetworks 'Microsoft.Network/virtualNetworks@2021-02-01' existing = [for agentPool in aksCluster.agentPools: {
  name: union(defaultAgentPoolObject, agentPool).virtualNetwork.virtualNetworkName
  scope: resourceGroup(union(defaultAgentPoolObject, agentPool).virtualNetwork.subscriptionId, union(defaultAgentPoolObject, agentPool).virtualNetwork.resourceGroup)
}]

// Get existing subnets
resource subnets 'Microsoft.Network/virtualNetworks/subnets@2021-02-01' existing = [for (agentPool, i) in aksCluster.agentPools: {
  name: union(defaultAgentPoolObject, agentPool).virtualNetwork.subnetName
  parent: virtualNetworks[i]
}]

var agentPoolProfiles = [for (agentPool, i) in aksCluster.agentPools: {
  name: agentPool.name
  vnetSubnetID: aksCluster.network.plugin =~ 'azure' ? subnets[i].id : null
}]

When deploying, this generates error:
An error occurred while deploying this offering. Error:
InvalidTemplate - Long running operation failed with status
'Failed'. Additional Info:'Deployment template language
expression evaluation failed: 'The template language function
'copyIndex' has an invalid argument. The provided copy name ''
doesn't exist in the resource. Please see
https://aka.ms/arm-copy for usage details.'. Please see
https://aka.ms/arm-template-expressions for usage details.'

When examining the autogenerated ARM template, the cause is clear: in the variable, the copyIndex() where a property of the parent resource is called, is always empty. It should be copyIndex('agentPoolProfiles').
"copy": [
      {
        "name": "agentPoolProfiles",
        "count": "[length(parameters('aksCluster').agentPools)]",
        "input": {
          "name": "[parameters('aksCluster').agentPools[copyIndex('agentPoolProfiles')].name]",
          "vnetSubnetID": "[if(equals(toLower(parameters('aksCluster').network.plugin), toLower('azure')), extensionResourceId(format('/subscriptions/{0}/resourceGroups/{1}', union(variables('defaultAgentPoolObject'), parameters('aksCluster').agentPools[copyIndex()]).virtualNetwork.subscriptionId, union(variables('defaultAgentPoolObject'), parameters('aksCluster').agentPools[copyIndex()]).virtualNetwork.resourceGroup), 'Microsoft.Network/virtualNetworks/subnets', union(variables('defaultAgentPoolObject'), parameters('aksCluster').agentPools[copyIndex()]).virtualNetwork.virtualNetworkName, union(variables('defaultAgentPoolObject'), parameters('aksCluster').agentPools[copyIndex('agentPoolProfiles')]).virtualNetwork.subnetName), null())]"
        }

Additional context
N/A

Btw, found the following workaround to be valid:
// Get existing subnets
resource subnets 'Microsoft.Network/virtualNetworks/subnets@2021-02-01' existing = [for agentPool in aksCluster.agentPools: if (aksCluster.network.plugin =~ 'azure') {
  name: '${agentPool.virtualNetwork.virtualNetworkName}/${agentPool.virtualNetwork.subnetName}'
}]

+1

here is the simple (standalone) repro for this... removing any complexity of the AgentPools or AKS.

Looping through VNETS and then looping through Subnets while referencing the VNET (loop) for the Parent.

var agentPools = [
  {
    name: 'NodePool1'
    virtualNetwork: {
      virtualNetworkName: 'vnet1'
      subnetName: 'subnet1'
    }
  }
]

resource virtualNetworks 'Microsoft.Network/virtualNetworks@2021-02-01' existing = [for agentPool in agentPools: {
  name: agentPool.virtualNetwork.virtualNetworkName
}]

resource subnets 'Microsoft.Network/virtualNetworks/subnets@2021-02-01' existing = [for (agentPool, index) in agentPools: {
  name: agentPool.virtualNetwork.subnetName
  parent: virtualNetworks[index]
}]

var agentPoolProfiles = [for (agentPool, index) in agentPools: {
  name: agentPool.name
  vnetSubnetID: subnets[index].id
}]

output agentPoolProfiles array = agentPoolProfiles

Expected compiled:
"vnetSubnetID": "[resourceId('Microsoft.Network/virtualNetworks/subnets', variables('agentPools')[copyIndex('agentPoolProfiles')].virtualNetwork.virtualNetworkName, variables('agentPools')[copyIndex('agentPoolProfiles')].virtualNetwork.subnetName)]"

Actually compiled:
"vnetSubnetID": "[resourceId('Microsoft.Network/virtualNetworks/subnets', variables('agentPools')[copyIndex()].virtualNetwork.virtualNetworkName, variables('agentPools')[copyIndex('agentPoolProfiles')].virtualNetwork.subnetName)]"

Thanks for the self-contained repro @brwilkinson. It looks like the root cause is that we're not doing index replacement correctly when a loop variable gets in-lined into a resource body.

what is the status of this? I'm facing this issue as well.

very annoying bug that for me shouldn't be hard to fix. It quite common among many resources as in many cases you have to reference subnet IDs

@alex-frankel I saw the mention on the community call as well, that's already good news ;-) Thanks

this seems to keep moving to vnext, any update on this?

I'm currently investigating this issue. There's a deeper problem with index expression substitution, which makes this more complicated to fix unfortunately.

could we possibly get an update on this during the community call? it's quite an essential part of using references to another resource which is now not working for certain resources in our scripts. we are awaiting a fix to be able to use bicep for some of our script deployments.

We are working on a new JSON format that exposes the concepts of symbolic names and existing resources in the JSON. You can enable it in Bicep by setting the BICEP_SYMBOLIC_NAME_CODEGEN_EXPERIMENTAL environment variable to true. (For best experience, should be enabled for both Bicep CLI and VS code.)
I tested it with the @brwilkinson's template and it seemed to produce correct JSON, but I haven't tried deploying it. Can you try turning in on and see if it helps?

@majastrz can you point me to the document how to set environment variable. I have not done this before and I have not found such reference on internet.

We don't have any docs that cover this specifically for Bicep. These are just normal system environment variables. Depending on how you're invoking Bicep, the following options may work for you. In a Windows .bat or .cmd file:
set BICEP_SYMBOLIC_NAME_CODEGEN_EXPERIMENTAL=true

In PowerShell:
$env:BICEP_SYMBOLIC_NAME_CODEGEN_EXPERIMENTAL = "true"

In GitHub actions or ADO yaml:
env:
  BICEP_SYMBOLIC_NAME_CODEGEN_EXPERIMENTAL: true

Overtime, we will be adding more experimental features that can be enabled. To make it easier to use them, @jeskew will expose settings to turn on experimental Bicep features in .bicepconfig, but it's not available yet.
For best experience, you should set the env var before opening VS code and before running any Bicep CLI commands. This way the experience will be consistent.

@majastrz thanks for the help. I was suspecting that might be the way but I wanted to be sure. I have managed to enable the setting but unfortunately without result. Bellow
WARNING: Symbolic name support in ARM is experimental, and should be enabled for testing purposes only. Do not enable this setting for any production usage, or you may be unexpectedly broken at any time!
D:\dev\Sentia\lz\lz-kubernetes\test.bicep(25,5) : Warning no-unused-vars: Variable "agentPoolProfiles" is declared but never used. [https://aka.ms/bicep/linter/no-unused-vars]
Unhandled exception. System.NotImplementedException: Mismatch between count of index expressions and inaccessible symbols during array access index replacement.
   at Bicep.Core.Emit.ExpressionConverter.CreateConverterForIndexReplacement(SyntaxBase nameSyntax, SyntaxBase indexExpression, SyntaxBase newContext) in C:\__w\1\s\bicep\src\Bicep.Core\Emit\ExpressionConverter.cs:line 207
   at Bicep.Core.Emit.ExpressionEmitter.EmitExpression(SyntaxBase resourceNameSyntax, SyntaxBase indexExpression, SyntaxBase newContext) in C:\__w\1\s\bicep\src\Bicep.Core\Emit\ExpressionEmitter.cs:line 98
   at Bicep.Core.Emit.ScopeHelper.<>c__DisplayClass7_0.<EmitResourceOrModuleScopeProperties>b__0() in C:\__w\1\s\bicep\src\Bicep.Core\Emit\ScopeHelper.cs:line 367
   at Bicep.Core.Emit.PositionTrackingJsonTextWriter.WritePropertyWithPosition(SyntaxBase keyPosition, String name, Action valueFunc) in C:\__w\1\s\bicep\src\Bicep.Core\Emit\PositionTrackingJsonTextWriter.cs:line 108
   at Bicep.Core.Emit.ExpressionEmitter.EmitPropertyInternal(LanguageExpression expressionKey, Action valueFunc, SyntaxBase location, Boolean skipCopyCheck) in C:\__w\1\s\bicep\src\Bicep.Core\Emit\ExpressionEmitter.cs:line 451
   at Bicep.Core.Emit.ExpressionEmitter.EmitProperty(String name, Action valueFunc) in C:\__w\1\s\bicep\src\Bicep.Core\Emit\ExpressionEmitter.cs:line 429
   at Bicep.Core.Emit.ScopeHelper.EmitResourceOrModuleScopeProperties(SemanticModel semanticModel, ScopeData scopeData, ExpressionEmitter expressionEmitter, SyntaxBase newContext) in C:\__w\1\s\bicep\src\Bicep.Core\Emit\ScopeHelper.cs:line 367
   at Bicep.Core.Emit.ScopeHelper.EmitResourceScopeProperties(SemanticModel semanticModel, ScopeData scopeData, ExpressionEmitter expressionEmitter, SyntaxBase newContext) in C:\__w\1\s\bicep\src\Bicep.Core\Emit\ScopeHelper.cs:line 327
   at Bicep.Core.Emit.TemplateWriter.<>c__DisplayClass21_0.<EmitResource>b__0() in C:\__w\1\s\bicep\src\Bicep.Core\Emit\TemplateWriter.cs:line 509
   at Bicep.Core.Emit.PositionTrackingJsonTextWriter.WriteObjectWithPosition(SyntaxBase sourcePosition, Action propertiesFunc) in C:\__w\1\s\bicep\src\Bicep.Core\Emit\PositionTrackingJsonTextWriter.cs:line 97
   at Bicep.Core.Emit.TemplateWriter.EmitResource(PositionTrackingJsonTextWriter jsonWriter, DeclaredResourceMetadata resource, ExpressionEmitter emitter) in C:\__w\1\s\bicep\src\Bicep.Core\Emit\TemplateWriter.cs:line 400
   at Bicep.Core.Emit.TemplateWriter.EmitResources(PositionTrackingJsonTextWriter jsonWriter, ExpressionEmitter emitter) in C:\__w\1\s\bicep\src\Bicep.Core\Emit\TemplateWriter.cs:line 358
   at Bicep.Core.Emit.TemplateWriter.GenerateTemplateWithoutHash(PositionTrackingJsonTextWriter jsonWriter) in C:\__w\1\s\bicep\src\Bicep.Core\Emit\TemplateWriter.cs:line 137
   at Bicep.Core.Emit.TemplateWriter.Write(SourceAwareJsonTextWriter writer) in C:\__w\1\s\bicep\src\Bicep.Core\Emit\TemplateWriter.cs:line 103
   at Bicep.Core.Emit.TemplateEmitter.<>c__DisplayClass8_0.<Emit>b__0() in C:\__w\1\s\bicep\src\Bicep.Core\Emit\TemplateEmitter.cs:line 68
   at Bicep.Core.Emit.TemplateEmitter.EmitOrFail(Func`1 write) in C:\__w\1\s\bicep\src\Bicep.Core\Emit\TemplateEmitter.cs:line 123
   at Bicep.Core.Emit.TemplateEmitter.Emit(Stream stream) in C:\__w\1\s\bicep\src\Bicep.Core\Emit\TemplateEmitter.cs:line 59
   at Bicep.Cli.Services.CompilationWriter.ToFile(Compilation compilation, String outputPath) in C:\__w\1\s\bicep\src\Bicep.Cli\Services\CompilationWriter.cs:line 27
   at Bicep.Cli.Commands.BuildCommand.RunAsync(BuildArguments args) in C:\__w\1\s\bicep\src\Bicep.Cli\Commands\BuildCommand.cs:line 69
   at Bicep.Cli.Program.RunAsync(String[] args) in C:\__w\1\s\bicep\src\Bicep.Cli\Program.cs:line 78
   at Bicep.Cli.Program.Main(String[] args) in C:\__w\1\s\bicep\src\Bicep.Cli\Program.cs:line 65
   at Bicep.Cli.Program.<Main>(String[] args)

The minimum code to reproduce it:

param aksCluster object

var defaultAgentPool = {
  virtualNetwork: {
    subscriptionId: subscription().subscriptionId
    resourceGroup: 'dummy'
    virtualNetworkName: ''
    subnetName: ''
  }
}

resource virtualNetworks 'Microsoft.Network/virtualNetworks@2021-08-01' existing = [for agentPool in aksCluster.agentPools: {
  name: union(defaultAgentPool, agentPool).virtualNetwork.virtualNetworkName
  scope: resourceGroup(union(defaultAgentPool, agentPool).virtualNetwork.subscriptionId, agentPool.virtualNetwork.resourceGroup)
}]

// // Get existing subnets
resource subnets 'Microsoft.Network/virtualNetworks/subnets@2021-08-01' existing = [for (agentPool, i) in aksCluster.agentPools: {
  name: union(defaultAgentPool, agentPool).virtualNetwork.subnetName
  parent: virtualNetworks[i]
}]

var agentPoolProfiles = [for (agentPool, i) in aksCluster.agentPools: {
  // only agentPoolProfiles has name as property, agentPools do not have it
  nameProperty: {
    name: agentPool.name
  }
  commonProperties: {
    vnetSubnetID: empty(union(defaultAgentPool, agentPool).virtualNetwork.subnetName) ? null : subnets[i].id
  }
}]

@majastrz have you managed to look why the new method gives error on this case?

Yes, we're not picking up the index expression from the parent property which fails an assertion in loop code generation. I'm working on the fix.

+1

@majastrz was anything done in recent versions of Bicep to fix this? When I use the latest sample for reproduction and generate the ARM template it seems that copyIndex() has parameter now so it seems fixed. I am yet to test it with actual deployment but if the ARM code is correct there should not be a problem.

I think @jeskew made a change that fixed loop codegen with indexed scopes. I will double check.

I have done some tests and they show that it is fixed now.

Thanks for confirming. I will also add your repro as a test case, so it doesn't regress in the future.

Closing since it appears this is resolved.

Hello, I am reproducing a very issue today with Bicep CLI version 0.28.1
Bicep CLI version 0.28.1 (ba1e9f8c1e)
I define variables with the objects for the private endpoints that the AVM modules require. The "subnetResourceId" property adequately takes the copyIndex('storageAccountPrivateEndpoints') value but the privateDnsZoneResourceIds only says copyIndex() so I get "The provided copy name '' doesn't exist in the resource" error when deploying.
Attaching reproduction files.
simple.bicep.txt
simple.json.txt
Bicep:
var storageAccountPrivateEndpoints = [
  for (config, i) in stampConfigs: {
    subnetResourceId: privateEndpointSubnets[i].id
    location: config.location
    service: 'blob'
    privateDnsZoneGroupName: 'privatelink.blob.${environment().suffixes.storage}'
    privateDnsZoneResourceIds: [
      storageBlobPrivateDnsZones[i].id
    ]
  }
]

Expected:
"variables": {
    "copy": [
      {
        "name": "storageAccountPrivateEndpoints",
        "count": "[length(parameters('stampConfigs'))]",
        "input": {
          "subnetResourceId": "[extensionResourceId(format('/subscriptions/{0}/resourceGroups/{1}', subscription().subscriptionId, format('rg-{0}-{1}-{2}', parameters('networkWorkloadName'), parameters('stampConfigs')[copyIndex('storageAccountPrivateEndpoints')].location, parameters('stampConfigs')[copyIndex('storageAccountPrivateEndpoints')].stamp)), 'Microsoft.Network/virtualNetworks/subnets', split(format('vnet-apps-{0}-{1}-{2}/{3}', parameters('networkWorkloadName'), parameters('stampConfigs')[copyIndex('storageAccountPrivateEndpoints')].shortLocation, parameters('stampConfigs')[copyIndex('storageAccountPrivateEndpoints')].stamp, variables('privateEndpointsSnetName')), '/')[0], split(format('vnet-apps-{0}-{1}-{2}/{3}', parameters('networkWorkloadName'), parameters('stampConfigs')[copyIndex('storageAccountPrivateEndpoints')].shortLocation, parameters('stampConfigs')[copyIndex('storageAccountPrivateEndpoints')].stamp, variables('privateEndpointsSnetName')), '/')[1])]",
          "location": "[parameters('stampConfigs')[copyIndex('storageAccountPrivateEndpoints')].location]",
          "service": "blob",
          "privateDnsZoneGroupName": "[format('privatelink.blob.{0}', environment().suffixes.storage)]",
          "privateDnsZoneResourceIds": [
            "[extensionResourceId(format('/subscriptions/{0}/resourceGroups/{1}', subscription().subscriptionId, format('rg-{0}-{1}-{2}', parameters('networkWorkloadName'), parameters('stampConfigs')[copyIndex('storageAccountPrivateEndpoints')].location, parameters('stampConfigs')[copyIndex('storageAccountPrivateEndpoints')].stamp)), 'Microsoft.Network/privateDnsZones', format('privatelink.blob.{0}', environment().suffixes.storage))]"
          ]
        }
      }
    ],
...

Actual:
"variables": {
    "copy": [
      {
        "name": "storageAccountPrivateEndpoints",
        "count": "[length(parameters('stampConfigs'))]",
        "input": {
          "subnetResourceId": "[extensionResourceId(format('/subscriptions/{0}/resourceGroups/{1}', subscription().subscriptionId, format('rg-{0}-{1}-{2}', parameters('networkWorkloadName'), parameters('stampConfigs')[copyIndex('storageAccountPrivateEndpoints')].location, parameters('stampConfigs')[copyIndex('storageAccountPrivateEndpoints')].stamp)), 'Microsoft.Network/virtualNetworks/subnets', split(format('vnet-apps-{0}-{1}-{2}/{3}', parameters('networkWorkloadName'), parameters('stampConfigs')[copyIndex('storageAccountPrivateEndpoints')].shortLocation, parameters('stampConfigs')[copyIndex('storageAccountPrivateEndpoints')].stamp, variables('privateEndpointsSnetName')), '/')[0], split(format('vnet-apps-{0}-{1}-{2}/{3}', parameters('networkWorkloadName'), parameters('stampConfigs')[copyIndex('storageAccountPrivateEndpoints')].shortLocation, parameters('stampConfigs')[copyIndex('storageAccountPrivateEndpoints')].stamp, variables('privateEndpointsSnetName')), '/')[1])]",
          "location": "[parameters('stampConfigs')[copyIndex('storageAccountPrivateEndpoints')].location]",
          "service": "blob",
          "privateDnsZoneGroupName": "[format('privatelink.blob.{0}', environment().suffixes.storage)]",
          "privateDnsZoneResourceIds": [
            "[extensionResourceId(format('/subscriptions/{0}/resourceGroups/{1}', subscription().subscriptionId, format('rg-{0}-{1}-{2}', parameters('networkWorkloadName'), parameters('stampConfigs')[copyIndex()].location, parameters('stampConfigs')[copyIndex()].stamp)), 'Microsoft.Network/privateDnsZones', format('privatelink.blob.{0}', environment().suffixes.storage))]"
          ]
        }
      }
    ],

Update:
it seems my issue stemps from using fixed values for the private DNS zone names. The copyIndex('...') value is not populate when I do not reference the objects of the iterated array in the name.
This does not work:
resource storageBlobPrivateDnsZones 'Microsoft.Network/privateDnsZones@2020-06-01' existing = [
  for (config, i) in stampConfigs: {
    name: 'privatelink.blob.${environment().suffixes.storage}' // NOTE THE FIXED VALUE FOR ALL ITEMS IN ARRAY
    scope: resourceGroup('rg-${networkWorkloadName}-${config.location}-${config.stamp}')
  }
]

This works:
var networkResources = [for (config, i) in stampConfigs: {
  rg: 'rg-${networkWorkloadName}-${config.location}-${config.stamp}'
  storageBlobPrivateDnsZoneName: 'privatelink.blob.${environment().suffixes.storage}'
}]

resource storageBlobPrivateDnsZones 'Microsoft.Network/privateDnsZones@2020-06-01' existing = [
  for r in networkResources: {
    name: r.storageBlobPrivateDnsZoneName // NOTE NAME REFERENCES SOMETHING IN THE ITERATED ARRAY
    scope: resourceGroup(r.rg)
  }
]


fix bugs in utilities helper class, notebook naming, m4 README

Issue #, if available:
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Ran all modules for end-to-end; only single error in module 08, but it relates to past Feature Group not found, assuming it was deleted during cleanup. Asserted that the new image for git submodule command is part of the PR.


Add virtual folders

It should be possible to add files to folders (file groups) and give them extra access rights for non logged in users.
Like YouTube and there playlists.

Done


Use Activity.Current.Id

What issue does this PR address?

Use Activity.Current.Id  #4725

Does this PR introduce a breaking change?
Yes
Please check if the PR fulfills these requirements

[ ] The commit follows our guidelines
[ ] Unit Tests for the changes have been added (for bug fixes / features)

Thanks for your contribution!
IdentityServer4 is feature complete.
All new feature work will happen in our new organization. The new Duende IdentityServer is available under both a FOSS (RPL) and a commercial license. Development and testing is always free. Contact us for more information.
This repo will be maintained with bug fixes and security updates until November 2022.


Introduce APIService resource to Rancher

Problem:
The custom metrics server associated with pod/object/external
types is not available by default, we need a way to tell UI we don't
support those kind of metrics for now.
Solution:
Introduce apiservice.apiregistration.k8s.io resource into Rancher.
This API can tell which api service is current available.
Related issue:
https://github.com/rancher/rancher/issues/20693
Related PR:
https://github.com/rancher/types/pull/857

Update vendor and rebase to master

LGTM


operator opentelemetry-operator (0.59.0)

Signed-off-by: Yuri Sa<EMAIL_ADDRESS>Thanks for submitting your Operator. Please check the below list before you create your Pull Request.
New Submissions

[x] Are you familiar with our contribution guidelines?
[x] Have you packaged and deployed your Operator for Operator Framework?

[x] Have you considered whether you want to use semantic versioning order?
[x] Is your submission signed?
[x] Is operator icon set?

Updates to existing Operators

[x] Did you create a ci.yaml file according to the update instructions?
[x] Is your new CSV pointing to the previous version with the replaces property if you chose replaces-mode via the updateGraph property in ci.yaml?
[x] Is your new CSV referenced in the appropriate channel defined in the package.yaml or annotations.yaml ?
[x] Have you tested an update to your Operator when deployed via OLM?
[x] Is your submission signed?

Your submission should not

[x] Modify more than one operator
[x] Modify an Operator you don't own
[x] Rename an operator - please remove and add with a different name instead
[x] Modify any files outside the above mentioned folders
[x] Contain more than one commit. Please squash your commits.

Operator Description must contain (in order)

[x] Description of the managed Application and where to find more information
[x] Features and capabilities of your Operator and how to use it
[x] Any manual steps about potential pre-requisites for using your Operator

Operator Metadata should contain

[x] Human readable name and 1-liner description about your Operator
[x] Valid category name1
[x] One of the pre-defined capability levels2
[x] Links to the maintainer, source code and documentation
[x] Example templates for all Custom Resource Definitions intended to be used
[x] A quadratic logo

Remember that you can preview your CSV here.
--
1 If you feel your Operator does not fit any of the pre-defined categories, file an issue against this repo and explain your need
2 For more information see here

/retest

/test all

@yuriolisa plea check - Operator 'opentelemetry-operator with version 0.59.0' has different version name defined in '/tmp/operator-test/operators/opentelemetry-operator/0.59.0/manifests/opentelemetry-operator.clusterserviceversion.yaml' as 'spec.version'

Hi @J0zi, Thank you for the heads-up. I've just fixed it.

/merge possible

/test 4.11-deploy-operator-on-openshift

/test 4.11-deploy-operator-on-openshift

/merge possible


get_multi is not typed

Describe the bug or question
This is both an issue and a suggestion that will make breaking changes.
Issue: The returned dict from get_multi is not typed properly. For example,
artist_urls = await artist_url_crud.get_multi(
    db=db_session,
    limit=None,
    return_total_count=False,
    return_as_model=True,
    schema_to_select=ArtistURL,
    artist_id=artist.id,
    source_id=None,
)
for artist_url in artist_urls["data"]: #artist_url is not typed as list[ArtistURL] but 'any'

Request: Also, when return_total_count is False and return_as_model is True, I don't see any reason why the returned object has to be wrapped with a 'data' key. While this works great when returned with FastAPI's API endpoint directly, I also use it in a lot of async functions and this is bugging me.
artist_urls = await artist_url_crud.get_multi(
    db=db_session,
    limit=None,
    return_total_count=False,
    return_as_model=True,
    schema_to_select=ArtistURL,
    artist_id=artist.id,
    source_id=None,
)
for artist_url in artist_urls: # Why can we not do this?

Describe the bug or question This is both an issue and a suggestion that will make breaking changes.
Issue: The returned dict from get_multi is not typed properly. For example,
artist_urls = await artist_url_crud.get_multi(
    db=db_session,
    limit=None,
    return_total_count=False,
    return_as_model=True,
    schema_to_select=ArtistURL,
    artist_id=artist.id,
    source_id=None,
)
for artist_url in artist_urls["data"]: #artist_url is not typed as list[ArtistURL] but 'any'

I'll work on it

Request: Also, when return_total_count is False and return_as_model is True, I don't see any reason why the returned object has to be wrapped with a 'data' key. While this works great when returned with FastAPI's API endpoint directly, I also use it in a lot of async functions and this is bugging me.
artist_urls = await artist_url_crud.get_multi(
    db=db_session,
    limit=None,
    return_total_count=False,
    return_as_model=True,
    schema_to_select=ArtistURL,
    artist_id=artist.id,
    source_id=None,
)
for artist_url in artist_urls: # Why can we not do this?

What exactly is the issue of doing
for artist_url in artist_urls["data"]

instead?
I guess we could add a parameter for raw returns, but it will add some complexity to the code when a simple artist_urls["data"] could be used

Closed by #190


Make it possible to enable breadcrumbs per page

This is an enhancement or feature.

Summary

Makes it possible to enable breadcrumbs on a per page basis. That will make it possible to disable breadcrumbs for an entire colletion alos by only editing the _config.yml.
Context

Changed logic so it is possible to enable instead of disable.


ESLint: Re-enable rule jsx-curly-brace-presence

SUMMARY
Re-enable ESLint rule jsx-curly-brace-presence, which was disabled in PR #10839. Code was refactored to fix the errors raised by the rule.
TEST PLAN
Run npm run lint, verify that there are no new Javascript/Typescript errors.
ADDITIONAL INFORMATION

[ ] Has associated issue:
[ ] Changes UI
[ ] Requires DB Migration.
[ ] Confirm DB Migration upgrade and downgrade tested.
[ ] Introduces new feature or API
[ ] Removes existing feature or API

Codecov Report

Merging #10869 into master will increase coverage by 0.01%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master   #10869      +/-   ##
==========================================
+ Coverage   61.33%   61.34%   +0.01%
==========================================
  Files         380      380
  Lines       24068    24068
==========================================
+ Hits        14762    14765       +3
+ Misses       9306     9303       -3

Flag
Coverage Δ

#python
61.34% <ø> (+0.01%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

superset/db_engine_specs/presto.py
82.28% <0.00%> (+0.67%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8a774d5...a2db4ec. Read the comment docs.


how to go to full screen video view if the loaded website have go to full screen option?

What about this? https://github.com/delight-im/Android-AdvancedWebView/issues/84


feat(datasets): simplify load flow from hf datasetswith no rb format

With this PR you can convert hf datasets to rubrix datasets as follow:

import datasets
amazon_reviews = datasets.load_dataset("amazon_reviews_multi", "es", split="train")
rb_ds = rb.DatasetForTextClassification.from_datasets(
    amazon_reviews,
    inputs=["review_title","review_body"],
    annotation="stars"
)
# Here you can just log the dataset
rb.log(rb_ds, name="amazon-reviews")

We can define similar approach for metadata or text for the  other tasks, or tags for token classification
@dcfidalgo @dvsrepo any suggestion?

With this PR you can convert hf datasets to rubrix datasets as follow:
import datasets
amazon_reviews = datasets.load_dataset("amazon_reviews_multi", "es", split="train")
rb_ds = rb.DatasetForTextClassification.from_datasets(
    amazon_reviews,
    inputs=["review_title","review_body"],
    annotation="stars"
)
# Here you can just log the dataset
rb.log(rb_ds, name="amazon-reviews")

We can define similar approach for metadata or text for the other tasks, or tags for token classification
@dcfidalgo @dvsrepo any suggestion?

This is looking good!
For text it should be straightforward, for metadata there are some dataset which contain json objects in some fields.
For token classification we need at least tokens and tags and then generate stand-off annotations with that, right?

Nice shortcut, will definitely be helpful. Just as a side note, for token classification datasets on the Hub, often only tokens are provided, so we must reconstruct the text input for the TokenClassificationRecords.

Nice shortcut, will definitely be helpful. Just as a side note, for token classification datasets on the Hub, often only tokens are provided, so we must reconstruct the text input for the TokenClassificationRecords.

Yes, we can recompose text field in terms of tokens field by assuming white spaces between tokens

For token classification we need at least tokens and tags and then generate stand-off annotations with that, right

Agree with this. Although it would also take that logic to the creation of a token classification record
record = TokenClassificationRecord(tokens=....,tags=.....)

I've included a workaround to fix the test. The token classification model will try to build the text field from tokens if no char-level span is provided.
But in general, operating with None annotation/prediction lists could raise errors related to issue: https://github.com/huggingface/datasets/issues/3676


Undefined symbol: OBJC_CLASS$_FIRRemoteConfig

I have integrated Remote Config in my shared module but I am getting following errors on iOS side,
Undefined symbol: _OBJC_CLASS_$_FIRRemoteConfig
Undefined symbol: _OBJC_CLASS_$_FIRRemoteConfigSettings
As far as I have checked, Firebase has moved Remote Config implementation from FIRRemoteConfig to just RemoteConfig, but in your latest update it is still FIRRemoteConfig.
Can you please look in to it, and make the required changes... Thanks.

@Kashifmasood07 Could you please explain this a bit more? I'm facing the same issue with a lot of error messages like:
Undefined symbol: _OBJC_CLASS_$_FIRActionCodeInfo
Undefined symbol: _OBJC_CLASS_$_FIRActionCodeSettings
Undefined symbol: _OBJC_CLASS_$_FIRApp
Undefined symbol: _OBJC_CLASS_$_FIRAuth
Undefined symbol: _OBJC_CLASS_$_FIRAuthDataResult
Undefined symbol: _OBJC_CLASS_$_FIRAuthTokenResult
Undefined symbol: _OBJC_CLASS_$_FIREmailAuthProvider
Undefined symbol: _OBJC_CLASS_$_FIRFacebookAuthProvider
Undefined symbol: _OBJC_CLASS_$_FIRGitHubAuthProvider
Undefined symbol: _OBJC_CLASS_$_FIRGoogleAuthProvider
Undefined symbol: _OBJC_CLASS_$_FIRMultiFactorInfo
Undefined symbol: _OBJC_CLASS_$_FIRMultiFactorSession
Undefined symbol: _OBJC_CLASS_$_FIROAuthProvider
Undefined symbol: _OBJC_CLASS_$_FIROptions
Undefined symbol: _OBJC_CLASS_$_FIRPhoneAuthProvider
Undefined symbol: _OBJC_CLASS_$_FIRTwitterAuthProvider
Undefined symbol: _OBJC_CLASS_$_FIRUser
My project's shared build.gradle.kts looks like this:
plugins {
    kotlin("multiplatform")
    kotlin("native.cocoapods")
    id("com.android.library")
}

kotlin {
    android()
    iosX64()
    iosArm64()
    iosSimulatorArm64()
    js { browser() }

    cocoapods {
        summary = "Some description for the Shared Module"
        homepage = "Link to the Shared Module homepage"
        version = "1.0"
        ios.deploymentTarget = "14.1"
        podfile = project.file("../ios/Podfile")
        framework {
            baseName = "shared"
            isStatic = true
        }
    }

    val koinVersion = "3.2.0"

    sourceSets {
        val commonMain by getting {
            dependencies {
                implementation("dev.gitlive:firebase-common:1.6.2")
                implementation("dev.gitlive:firebase-auth:1.6.2")
                implementation("io.insert-koin:koin-core:$koinVersion")
                implementation("org.jetbrains.kotlinx:kotlinx-coroutines-core:1.6.4")
                implementation("com.arkivanov.decompose:decompose:1.0.0-beta-02")
            }
        }
        val commonTest by getting {
            dependencies {
                implementation(kotlin("test"))
                implementation("io.insert-koin:koin-test:$koinVersion")
            }
        }
        val androidMain by getting {
            dependencies {
                api("io.insert-koin:koin-android:$koinVersion")
                implementation("org.jetbrains.kotlinx:kotlinx-coroutines-android:1.6.4")
            }
        }
        val androidTest by getting
        val iosX64Main by getting
        val iosArm64Main by getting
        val iosSimulatorArm64Main by getting
        val iosMain by creating {
            dependsOn(commonMain)
            iosX64Main.dependsOn(this)
            iosArm64Main.dependsOn(this)
            iosSimulatorArm64Main.dependsOn(this)
        }
        val iosX64Test by getting
        val iosArm64Test by getting
        val iosSimulatorArm64Test by getting
        val iosTest by creating {
            dependsOn(commonTest)
            iosX64Test.dependsOn(this)
            iosArm64Test.dependsOn(this)
            iosSimulatorArm64Test.dependsOn(this)
        }
        val jsMain by getting
        val jsTest by getting
    }
}

android {
    namespace = "com.playtogether.kmp"
    compileSdk = 33
    defaultConfig {
        minSdk = 21
        targetSdk = 33
    }
}

Any help would be appreciated.


Use bind_to if wagtail 2.5 or later

Fixes #11

Thanks for the pull request, it might be time to bite the bullet and make the new minimum version of wagtail 2.5 for this package but this will do in the meantime :smiley:

Released in 0.5.2


Please invite me to the community

Name
Leon
Discord Username (if applicable)
dev_biggie
Additional Context
I heard this community from my friend "JK".
I would like to learn and improve professionally by joining this community

I would like to learn and improve professionally by joining this community


Fix pluginRoot option

Right now the option tsserver.pluginRoot is not working. This patch fixes it.

Fixed by use tsserver.pluginPaths like vscode


overheating

first of all, I love my atom text editor but recently it has been overheating and lagging. i have the latest version of atom. i have tried to uninstall and install it back but i cant the application file. i need help. thanks
Prerequisites

[ x] Put an X between the brackets on this line if you have done all of the following:

Reproduced the problem in Safe Mode: http://flight-manual.atom.io/hacking-atom/sections/debugging/#using-safe-mode
Followed all applicable steps in the debugging guide: http://flight-manual.atom.io/hacking-atom/sections/debugging/
Checked the FAQs on the message board for common solutions: https://discuss.atom.io/c/faq
Checked that your issue isn't already filed: https://github.com/issues?utf8=✓&q=is%3Aissue+user%3Aatom
Checked that there is not already an Atom package that provides the described functionality: https://atom.io/packages

Description
[Description of the issue]
Steps to Reproduce

[First Step]
[Second Step]
[and so on...]

Expected behavior: [What you expect to happen]
Actual behavior: [What actually happens]
Reproduces how often: [What percentage of the time does it reproduce?]
Versions
You can get this information from copy and pasting the output of atom --version and apm --version from the command line. Also, please include the OS and what version of the OS you're running.
Additional Information
Any additional information, configuration or data that might be necessary to reproduce the issue.

Thanks for reaching out - if you can fill out the rest of the issue template we can re-open the issue.  E.g. the Versions section tells us what OS and version of Atom you're running and you can use the Steps to Reproduce section to explain how to reproduce the behavior you're seeing.

We require the template to be filled out on all new issues and pull requests so if you can open a new issue with the template filled out, that would be helpful for us. We do this so that we can be certain we have all the information we need to address your submission efficiently. This allows the maintainers to spend more time fixing bugs, implementing enhancements, and reviewing and merging pull requests.
Thanks for understanding and meeting us half way :grinning:


Only able to run nxpm-stack lint through NPX

I want add a pre-commit hook to run @nxpm/stack lint on my Nx project. I have installed it as a development dependency.
When I run it through NPX, as in npx nxpm-stack lint, it works just fine.
However, if I try to run it with nxpm-stack lint, it throws "nxpm-stack is not recognized...". I even installed the library globally, but I still get same error.
Do you know how can I fix this, so I don't have to run the script from NPX on every commit, but instead have it installed in my machine?

@ajsaraujo maybe is a bit late (sorry about that), do you have any repository where I can reproduce this issue?


Typo in Field Name

It's "MessageInterrupt.Raw" not "InterruptMessage.Raw", as in:
                PCM_PARTIAL_RESOURCE_DESCRIPTOR resourceRaw;

                resourceRaw = WdfCmResourceListGetDescriptor(Resources, i);
                CvaTracePrint(INFO, "\t\t Messages Allocated: %d\n", resourceRaw->u.MessageInterrupt.Raw.MessageCount);

Thanks, @PeterGV
Appreciate the PR on this.
Eliot


Vertical Overdraw: End of text

When implementing a "console" like scenario using this, it would be simpler if we have an option to show the last characters rather than the first few when drawing.
For example, if the string is "1 2 3 4 5 ..... 100", today it would produce "1 2 3 4 .. 50" if the space is not enough. We might also want to show "51 52 53... 100" as on option so that we can keep on having a tail like command.
As an alternative, it would suffice that the struct return a "number of characters that would fit in the view" so that the user can remove the prefix (1 2 .. 50 in above example) as needed.

This is a good idea indeed! Technically, you should be able to implement it without modifying e-t, but since the crate is stuck in a limbo between a rich textbox and a half-baked terminal emulator, it's a feature that has it's place.
There's a bit of complication with regards to different vertical alignments, that may be somewhat non-trivial. For example, what behaviour would you expect from this mode, when the text is vertically centered?

Yes, there are some unknows as you mention. The ideal take would be like an overflow: scroll with the scrollbar removed. Implementation could unfortunately be quite complicated though.
For the initial release, it can be forced that the align is left only.

@vinaychandra does this looks something like you want?

That looks exactly as i expected. Thanks!

Then it shall arrive with the next release :) Thanks for the idea!

Just a heads-up that this feature will be changed in the future. Instead of an alignment option, you'll need to use the Tail plugin. I'm hoping the new solution will be a bit more flexible (i.e. it would even work with vertically centered text).


Browser gets frozen when a command outputs too much data

When we type a command that outputs too much (or unlimited) data, for example find /proc or yes, the browser (Firefox, even Chrome) will be very slow or gets frozen. This performance issue is due to the algorithm you use when rendering output on screen : you first write the entire data into a buffer and then you display it. This means : the data is read twice.
I know this is not quite simple, but I wonder is it possible to do better to get higher performance so that the browser will not get frozen at least.

Any input on this performance issue @chjj , thanks ?

I've personally never run into this. I just tested it in my terminal (as a blessed widget, which could conceivably have even worse performance issues especially if the terminal is not full screen). I ran yes, find /, and cmatrix and noticed no performance issues. I'll have to test it in the browser.
I've tried to optimize the browser renderer a number of times in the past. I always ended up scrapping it due to its complexity and headaches. I've never heard of it actually freezing though (the freezing might be a different issue, it should never freeze completely just because it takes a while to render something).

@chjj i also believe the bug is not related to data stream size. Wherever, if i get it right, term.js remove all child html elements from the terminal element and writes new ones for every update. That is surely not the best approach. :-) Did you think about to have one <span> for each screen position and update only the innerText with the right char and the style attribute with the local term style?

@aurium Personally I think it would be better.
@chjj Actually what I mean "frozen" is just like you said : it takes long time to render something, and that may give impression that the browser is frozen. And when it outputs, for example find /proc, and I hit Ctrl+Cto stop it, it may fail (It continues to output results). That's we have experienced after tens of tests.

try 'yes blah'. it will freeze. In my implementation, i managed to hack it with a buffer, and a rate of data bursts, so that browser has only a few things to render at a time. when the buffers got filled, i had to remove the characters yet to be sent, and that sometimes distorts things for graphic heavy apps

@sagarchandarana123 thanks to confirm this issue. Could you share your workaround source code ?

@crevete https://github.com/bitfusionio/term.js-implementation


[Event Change] table 83 "Item Journal Line" - OnAfterCalcBaseQty

In the past Event OnAfterCalcBaseQty was made as an event to procedure CalcBaseQty.
There are four calls changed in T83 to accommodate for extra parameters to event OnAfterCalcBaseQty :
"Quantity (Base)" := CalcBaseQty(Quantity, FieldCaption(Quantity), FieldCaption("Quantity (Base)"));
"Invoiced Qty. (Base)" := CalcBaseQty("Invoiced Quantity", FieldCaption(Quantity), FieldCaption("Quantity (Base)"));
"Output Quantity (Base)" := CalcBaseQty("Output Quantity", FieldCaption("Output Quantity"), FieldCaption("Output Quantity (Base)"));
"Scrap Quantity (Base)" := CalcBaseQty("Scrap Quantity", FieldCaption("Scrap Quantity"), FieldCaption("Scrap Quantity (Base)"));
You can see that the call to "Invoiced Qty. (Base)" is incorrect (possibly a copy paste edit error), because it is not using the correct FieldCaption. It should be changed as follows:
"Invoiced Qty. (Base)" := CalcBaseQty("Invoiced Quantity", FieldCaption("Invoiced Quantity"), FieldCaption("Invoiced Qty. (Base)"));

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. Please do not reply to this, as we do not monitor closed issues. If you have follow-up questions or requests, please create a new issue where you reference this one.
Build ID: 10481.


Storage File attribute management

[closes #92, #278, #280]

@blowmage This PR is ready for review, and if it looks good, merging.


How to liberate the gpt2 from reference model?

Hi,
We know that KL is used in the loss as a constraint for the difference between the original gpt2 and the active gpt2 which produces responses for rewards feedbacks.
How can I can tune the parameters to mitigate this constraint? I mean I want the active gpt2 can deviate much from the original reference gpt2, as I find in my experiments that the rewards do not improve as expected, possibly due to this constraint.
I am new to PPO. Hoping for some suggestions.
Thanks.

You could set the init_kl_coeff=0 (see here).

You could set the init_kl_coeff=0 (see here) to liberate the model from the reference completely or increase the KL target target (which is 6 by default).

Thanks.

By the way, do you have investigations on how to tune the txt_in_len, txt_out_len  to better sever the topic/sentiment preservation of the generated texts?
Currently, I find that fine-tuning the GPT2 before applying it into generation makes difference, although I have tried use the original GPT2 without fine-tuning and at the same time relax the KL constraint such as reduce the init_kl_coeff or increase cliprange.

No, I have not experimented much with these parameters. The main motivations for using input text at all is to force some variations in the generation.
Yes, I suspect one gets the best (or rather quickest) performance gains when first using supervised training to bring the initial LM distribution as close to the desired target distribution. This also makes the KL constrained better defined as you measure it against a LM on the same domain.

@lvwerra Hi, I recently find you that you added a simple code demo here https://lvwerra.github.io/trl//
where ppo_config = {'batch_size': 1, 'forward_batch_size': 1}
I suppose this is single sample mode, rather than batch.
Based on your experience, did you find any difference on performance between single and batch mode?
Is there any other cautions when using single mode to update the GPT2?
Thanks in advance.

Hi @yananchen1989, the simple code demo is just a proof of concept demo and I never used that config for the actual training. I did not run many experiments changing these settings and just sticked to the settings from the original paper

Hi @yananchen1989, the simple code demo is just a proof of concept demo and I never used that config for the actual training. I did not run many experiments changing these settings and just sticked to the settings from the original paper

@lvwerra Thanks.
I find that it is so crucial to design a good reward feedback module that can return a reward with positive or negative value. And the reference GPT also need to be fine-tuned on some related corpus.
There two points make it very unpractical.
During my trials, if I do not fine-tune the reference GPT to some texts, (as there are no appropriate texts for finetuning), or only has a reward classifier which only give positive feedbacks, for example, if the generated text is not much like a politics article, the reward module would just score it to, say, 0.001; or on the contrary, if it is much like a politics news, the score would be 0.973,
then the generated texts after several iterations of PPO training would deteriorate, ending up into repetitive snippets or meaningless results, even though I have tuned the parameters such as kl coefficients, etc.

I think the fine-tuning is not a necessary step but improves stability and convergence. For the reward function, I don't see the point for a strictly positive reward. What would you try to learn from it?


Remove version: Tableau.Reader version 24.1.1132

[Automated] It returns code over 400 in all urls
Microsoft Reviewers: Open in CodeFlow

URL: https://downloads.tableau.com/tssoftware/TableauReader-64bit-2024-1-3.exe
Response status code does not indicate success: 403 (Forbidden).
(Automated message - build 896)

Close with reason: Package still available.;


Adds documentation to the layering examples

@Hixie

maybe the raw/hello_world should be rename raw/touch_input and we should try to make it as similar to rendering's touch_input as possible (possibly by modifying both accordingly).
then we could have a raw/hello_world that is actually identical to the rendering and widget layer ones.
I think in general we should aim for having identically named examples be identical.

I'm going to address the comments about renaming/creating new examples in a subsequent patch because those pieces of feedback are beyond the scope of adding comments explaining what these examples are doing.  :)


ISPN-11231 Transcoder lookup is inefficient

https://issues.redhat.com/browse/ISPN-11231

Register transcoder adapter for global marshaller only once
Cache transcoders in a map by source and target media type
Look up encoders and wrappers directly by id
Don't allow injection in the static encoders

Thanks @danberindei

@ryanemerson https://github.com/infinispan/infinispan/pull/7820


leaderboard: metrics don't update after pushing changes to model

leaderboard doesn't appear to update scores when pushing changes to an existing model. I'm guessing this is due to line 105 in app.py, and should be changed to allow score updates.

Hey there! Now you can open PRs on the Hub! Would you be interested in submitting a fix for it?

@chrisemezue might be able to provide more context here :smile:

I don't think I have suitable context around why line 105 is the way it is. Will it cause any problems to change it to model_ids = [x for x in get_model_ids(rl_env)]?

thank you for bringing this up, and sorry about the inconvenience. I added the extra constraint in line 105 to save inference time by preventing re-loading previous model metadata. I will work on it now to make sure it takes pushes to existing models into consideration.


Add a warning for Internet connection requirement in Dictation Handler doc

Describe the Issue
I'm currently working on an application which will be used without an internet connection. I wanted to use Dictation and it took me a long time to understand that an internet connection is required for Dictation to work.
Feature Area
Please can you add a warning on the documentation about the internet connection requirement?
Existing Doc Link
https://microsoft.github.io/MixedRealityToolkit-Unity/Documentation/Input/Dictation.html?q=dictation

@Kent1LG definitely - I was checking out the Unity docs for this and they also don't mention this which is weird, but looking at https://docs.microsoft.com/en-us/windows/mixed-reality/voice-input-in-unity, this is mentioned there.
I'll update this to make sure that others don't have to go through your pain


Add link to @mbacarella's dune/ctypes blog post

Add a link to Building C libraries in OCaml with the dune ctypes stanza.

The Windows CI build is failing, so I've sent a fix upstream: https://github.com/ocaml/opam-repository/commits/master/packages/lwt/lwt.5.5.0/opam


Update navbar blur in every page

I want to change navbar blur in all the pages. Assign me this issue , Thanks
some page with blur

some without

@akshathar-navada kindly look into this issue and assign me this

Yes sure, go ahead @Git21221

Someone already changed :(


Add ListHeaderComponent and ListEmptyComponent to MetroListView

Motivation
The new lists have a legacyImplementation prop that uses MetroListView instead of the newer implementations (VirtualizedList). This is useful for certain types of lists where the new implementation does not satisfy users performance-wise. It's also useful for react-native-web, since it currently does not support VirtualizedList.
ListHeaderComponent and ListEmptyComponent props were lacking in this legacy implementation.
 Will ship on monday.

@facebook-github-bot shipit

@janicduplessis, the bot failed to import. I rebased. Should I do something else?

@janicduplessis Is there any way for you to be relaunching the tests? :) The PR was about to be landed but got stuck because of the failing tests. 😢


Use stacklevel=2 for declarative field warning

Problem
The warning added in #1930 shows up in declarative.py, not the user code.
Solution
Use stacklevel=2 to skip out of the __new__ method to the class declaration.
See https://www.youtube.com/watch?v=CtFdXBEwYfk for an explanation.
Install flake8-bugbear for its B028 rule to catch this in the future.
Acceptance Criteria
I edited my local install like this in order to fix the warnings after upgrading 4.1.1 -> 4.3.3.

coverage: 100.0%. remained the same
when pulling 91e6542d5d05d7294f96b3a97db76e10be68cefb on adamchainz:stacklevel
into 881229d0449605686124716fcaabde191e5c54a6 on django-import-export:main.

Thank you @adamchainz !


docs: make the documentation site crawlable

With Jekyll, Nuxt.js or whatever else. This will make it easier to search through documentation, e.g., with Algolia or Google Custom Search.

will be done on next branch


@google/chatbase integration

Integrate chatbase. The new platform for analytics and optimization. Docs for chatbase are also added to /docs.

This should be integrated as a middleware plugin versus being part of the main Botkit project:
https://github.com/howdyai/botkit/blob/master/docs/readme-middlewares.md#statistics-metrics-and-crm-1
I would take a look those above linked projects, publish your plugin to Github and then add your integration to the link as a new PR.


Prevent crashes when removing Viewport from scene tree in event handler

Fixes #77752
~These checks were removed by https://github.com/godotengine/godot/pull/77452, only the is_inside_tree is strictly necessary to fix the crash, I re-added the other two just to be on the safe side, I don't think any other the checks in push_unhandled_input can have changed since push_input has checked them.~
If during the processing of an event, some event handler removes the viewport associated with the event from the scene tree without marking the event as handled, when the event processing continues it will try to access the tree and crash. This makes this an error instead of an crash.

CC @Sauermann

A few lines above, the is_inside_tree check is already performed:
https://github.com/godotengine/godot/blob/621d68e4129e7e343ff21eb3a5f4e8c1d6bbf456/scene/main/viewport.cpp#L2956
So it looks more like a problem that an event is not set as handled.

In fact, all three of these checks are performed before that line. Unless they can mutate in the process, this doesn't seem correct.

Unless they can mutate in the process

That is exactly the problem here, as the event handlers can have arbitrary effects, including those that violate preconditions of further handling of events.
This PR tries to prevent the further handling by re-checking the preconditions, while #77765 tries to be more specific and stops further processing in just this case by marking the event as handled after hiding the dialog.

Unless they can mutate in the process

If an event leads to the mutation of these states, then the event was processed and should be set to as handled.

This PR tries to prevent the further handling by re-checking the preconditions

If that should be the way, then it would be prudent to perform the inside_tree-check (and the other checks) between all input event processing steps.
Currently it is only checked at the beginning of event processing.
With this PR, checking additionally also happens before shortcut input event processing.
The logical conclusion would be to:

additionally check before gui input processing
additionally check before unhandled input processing
additionally check before unhandled key input processing
additionally check before physics picking

This PR now tries to prevent crashes like #77752 in general by rechecking if the viewport is still in the tree every time when attempting to access the tree after executing arbitrary event handlers. This should stop things from crashing if any other (user) code makes an error like this as well.
https://github.com/godotengine/godot/pull/77765 then fixes AcceptDialog specifically and prevents it from triggering these errors.

If these trigger it will crash anyways, so there is no point in making these DEV_ASSERTs and crashing in the assert. I could maybe wrap them in #ifdef DEBUG_ENABLED, but personally I would either add this safety net for all build or just leave it as-is and just close the PR entirely.

ERR_FAIL makes sense, because the crash can be triggered by user code, e.g.
func _input(event: InputEvent) -> void:
	get_viewport().get_parent().remove_child(get_viewport())

is_inside_tree() is inlined bool check, so the performance impact is super minimal.

ERR_FAIL makes sense, because the crash can be triggered by user code, e.g.

Godot doesn't catch all possible crashes, that can be caused by user code. In this case the crash can be prevented by the user simply by accepting the event with the following change:
func _input(event: InputEvent) -> void:
	get_viewport().get_parent().remove_child(get_viewport())
	get_viewport().set_input_as_handled()

Godot doesn't catch all possible crashes, that can be caused by user code.

Well, we try to when presented with a repro case. If you end up with this code from KoBeWi and experience the crash, there is no way to know that you can fix it as you describe. So that shouldn't happen.

Thanks!