The search procedure is slow

Hi @D-X-Y ,  thanks for sharing your excellent work. I found your work is very interesting, and I want to try your code.
However,  I found the search is not as fast as the paper said. Specifically, I run the command
"CUDA_VISIBLE_DEVICES=0 bash ./scripts-cnn/train-cifar.sh GDAS_F1 cifar10  cut"
on the PC with a Nvidia TITAN X (Pascal) 12GB,  and it eventually takes 27 hours to find a network with the top-1 error rate of 3.31. The following are some logs:
 train[2019-05-13-06:15:55] Epoch: [486][000/521] Time 0.62 (0.62) Data 0.26 (0.26) Loss 0.033 (0.033)  Prec@1 100.00 (100.00) Prec@5 100.00 (100.00)
 train[2019-05-13-06:16:31] Epoch: [486][100/521] Time 0.36 (0.37) Data 0.00 (0.00) Loss 0.129 (0.083)  Prec@1 96.88 (98.62) Prec@5 100.00 (100.00)
 train[2019-05-13-06:17:08] Epoch: [486][200/521] Time 0.38 (0.37) Data 0.00 (0.00) Loss 0.142 (0.084)  Prec@1 95.83 (98.57) Prec@5 100.00 (100.00)
 train[2019-05-13-06:17:45] Epoch: [486][300/521] Time 0.38 (0.37) Data 0.00 (0.00) Loss 0.024 (0.084)  Prec@1 100.00 (98.58) Prec@5 100.00 (100.00)
 train[2019-05-13-06:18:22] Epoch: [486][400/521] Time 0.37 (0.37) Data 0.00 (0.00) Loss 0.057 (0.085)  Prec@1 100.00 (98.54) Prec@5 100.00 (99.99)
 train[2019-05-13-06:19:00] Epoch: [486][500/521] Time 0.36 (0.37) Data 0.00 (0.00) Loss 0.098 (0.087)  Prec@1 95.83 (98.46) Prec@5 100.00 (99.99)
 train[2019-05-13-06:19:07] Epoch: [486][520/521] Time 0.32 (0.37) Data 0.00 (0.00) Loss 0.084 (0.087)  Prec@1 98.75 (98.45) Prec@5 100.00 (99.99)
[2019-05-13-06:19:07] **train** Prec@1 98.45 Prec@5 99.99 Error@1 1.55 Error@5 0.01 Loss:0.087
 test [2019-05-13-06:19:07] Epoch: [486][000/105] Time 0.34 (0.34) Data 0.26 (0.26) Loss 0.104 (0.104)  Prec@1 96.88 (96.88) Prec@5 100.00 (100.00)
 test [2019-05-13-06:19:16] Epoch: [486][100/105] Time 0.09 (0.09) Data 0.00 (0.00) Loss 0.032 (0.139)  Prec@1 98.96 (96.49) Prec@5 100.00 (99.94)
 test [2019-05-13-06:19:16] Epoch: [486][104/105] Time 0.03 (0.09) Data 0.00 (0.00) Loss 0.048 (0.140)  Prec@1 93.75 (96.44) Prec@5 100.00 (99.93)
[2019-05-13-06:19:16] **test** Prec@1 96.44 Prec@5 99.93 Error@1 3.56 Error@5 0.07 Loss:0.140
----> Best Accuracy<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>----> Save into ./output/NAS-CNN/GDAS_F1-cifar10-cut-E600/seed-166-checkpoint-cifar10-model.pth

==>>[2019-05-13-06:19:17] [Epoch=487/600] [Need: 06:21:40] LR=0.0022 ~ 0.0022, Batch=96
 train[2019-05-13-06:19:17] Epoch: [487][000/521] Time 0.69 (0.69) Data 0.31 (0.31) Loss 0.071 (0.071)  Prec@1 98.96 (98.96) Prec@5 100.00 (100.00)
 train[2019-05-13-06:19:54] Epoch: [487][100/521] Time 0.37 (0.37) Data 0.00 (0.00) Loss 0.069 (0.087)  Prec@1 97.92 (98.39) Prec@5 100.00 (99.99)
 train[2019-05-13-06:20:31] Epoch: [487][200/521] Time 0.36 (0.37) Data 0.00 (0.00) Loss 0.125 (0.086)  Prec@1 96.88 (98.45) Prec@5 100.00 (99.99)
 train[2019-05-13-06:21:08] Epoch: [487][300/521] Time 0.37 (0.37) Data 0.00 (0.00) Loss 0.212 (0.086)  Prec@1 94.79 (98.49) Prec@5 100.00 (99.99)
 train[2019-05-13-06:21:45] Epoch: [487][400/521] Time 0.36 (0.37) Data 0.00 (0.00) Loss 0.090 (0.087)  Prec@1 98.96 (98.49) Prec@5 100.00 (99.99)
 train[2019-05-13-06:22:22] Epoch: [487][500/521] Time 0.38 (0.37) Data 0.00 (0.00) Loss 0.150 (0.088)  Prec@1 96.88 (98.44) Prec@5 100.00 (99.99)
 train[2019-05-13-06:22:29] Epoch: [487][520/521] Time 0.31 (0.37) Data 0.00 (0.00) Loss 0.078 (0.088)  Prec@1 97.50 (98.46) Prec@5 100.00 (99.99)
[2019-05-13-06:22:29] **train** Prec@1 98.46 Prec@5 99.99 Error@1 1.54 Error@5 0.01 Loss:0.088
 test [2019-05-13-06:22:29] Epoch: [487][000/105] Time 0.32 (0.32) Data 0.24 (0.24) Loss 0.059 (0.059)  Prec@1 96.88 (96.88) Prec@5 100.00 (100.00)
 test [2019-05-13-06:22:38] Epoch: [487][100/105] Time 0.09 (0.09) Data 0.00 (0.00) Loss 0.029 (0.141)  Prec@1 98.96 (96.42) Prec@5 100.00 (99.93)
 test [2019-05-13-06:22:38] Epoch: [487][104/105] Time 0.03 (0.09) Data 0.00 (0.00) Loss 0.001 (0.140)  Prec@1 100.00 (96.43) Prec@5 100.00 (99.93)
[2019-05-13-06:22:38] **test** Prec@1 96.43 Prec@5 99.93 Error@1 3.57 Error@5 0.07 Loss:0.140
----> Best Accuracy<EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS><EMAIL_ADDRESS>----> Save into ./output/NAS-CNN/GDAS_F1-cifar10-cut-E600/seed-166-checkpoint-cifar10-model.pth

Since I am fresh to NAS,  I cannot figure out what I have missed?
Any suggestions/help are greatly appreciated! Thanks.

Thanks for your interest.
The above script is used to train the searched model, GDAS_F1 indicates one of our searched CNN. We did not include the searching codes in this repo since an extension version is under review.

@D-X-Y So, the script is only to train a searched model rather than to search a model? (Sigh~).

Yes, it is mainly used to compare with other NAS searched models, since different papers have different hyper-parameters. Sorry for the inconvenience. If you have any questions w.r.t. the searching procedure, I'm glad to help solve your problems.

@D-X-Y I am glad to hear that. Anyway, thanks for your kind help.

@ganji15 You are welcome~

Yes, it is mainly used to compare with other NAS searched models, since different papers have different hyper-parameters. Sorry for the inconvenience. If you have any questions w.r.t. the searching procedure, I'm glad to help solve your problems.

I was wondering whether you are going to release codes for model searching. If so, when are you going to do so?
Thanks

@Catosine We plan to release the searching codes upon the acceptance of our extension version. Thanks for your comprehension.

There still isn't searching model code in this repo, I wanna know when will U release,? Thx.

@Randylcy We plan to release the searching codes upon the acceptance of our extension version. Thanks for your comprehension. And we would like to let you know as soon as when we release.

@Randylcy Please find searching scripts here https://github.com/D-X-Y/NAS-Projects#usage-2


Optionally reset cache

Say for instance that instead of just running the model, we want to make a phase plot. In this case, we might try code such as:
model.set_state(0, {'angular_position':ap,
                    'angular_velocity':av})
return (model.components.change_in_angular_position(),
        model.components.change_in_angular_velocity())

In this case, the time doesn't change between calls to the various functions, and so they return their cached value.
We can get around this by running the model forward a step each time, but that requires firing up the integrator, and has a lot of overhead:
model.run(params={'angular_position':ap,
                  'angular_velocity':av},
          return_timestamps=[0,1],
          return_columns=['change_in_angular_position',
                          'change_in_angular_velocity'])

Ideally, we'd have a single function that you could call to clear all of the cache values, and whenever the state is modified externally to the integrator, it gets called.

Addressed in https://github.com/JamesPHoughton/pysd/pull/98 with syntax:
model.clear_caches()


Add null-checks when stopping server

Undertow should not throw a NullPointerException if stopping a server
that is not correctly started.

Adding this to 1.4.x as well.

Can one of the admins verify this patch?

This was already cherry picked to 1.4.x


[nginx] VTS metrics breaks prometheus endpoint :10254/metrics (0.9.0-beta.3)

After deploying 0.9.0-beta.3 and enabling vts the metrics endpoint is broken.
Going to :10245/metrics throws 500 with following text:
An error has occurred during metrics gathering:

1120 error(s) occurred:
* collected metric nginx_nginx_all_upstream_responses_total label:<name:"server" value:"<IP_ADDRESS>:4000" > label:<name:"status_code" value:"1xx" > label:<name:"upstream" value:"redacted-redacted-staging-redacted" > counter:<value:0 >  was collected before with the same name and label values
* collected metric nginx_nginx_all_upstream_responses_total label:<name:"server" value:"<IP_ADDRESS>:4000" > label:<name:"status_code" value:"2xx" > label:<name:"upstream" value:"redacted-redacted-staging-redacted" > counter:<value:0 >  was collected before with the same name and label values
* collected metric nginx_nginx_all_upstream_responses_total label:<name:"server" value:"<IP_ADDRESS>:4000" > label:<name:"status_code" value:"3xx" > label:<name:"upstream" value:"redacted-redacted-staging-redacted" > counter:<value:0 >  was collected before with the same name and label values
* collected metric nginx_nginx_all_upstream_responses_total label:<name:"server" value:"<IP_ADDRESS>:4000" > label:<name:"status_code" value:"4xx" > label:<name:"upstream" value:"redacted-redacted-staging-redacted" > counter:<value:0 >  was collected before with the same name and label values
* collected metric nginx_nginx_all_upstream_responses_total label:<name:"server" value:"<IP_ADDRESS>:4000" > label:<name:"status_code" value:"5xx" > label:<name:"upstream" value:"redacted-redacted-staging-redacted" > counter:<value:0 >  was collected before with the same name and label values

... snip ... (they're all the same error, just different values)

Possible related people: @gianrubio @aledbf
Could it be that that particular Ingress has somewhat complex setup?
Heavily redacted Ingress resource in question:
apiVersion: extensions/v1beta1
kind: Ingress
metadata:
  name: redacted-staging
  namespace: redacted
  labels:
    environment: staging
    project: redacted
  annotations:
    kubernetes.io/tls-acme: "true"
    kubernetes.io/ingress.class: "nginx"
spec:
  tls:
    - hosts:
        - host1.redacted.com
        - host2.redacted.com
        - host3.redacted.com
        - host4.redacted.com
        - host5.redacted.com
        - host6.redacted.com
      secretName: redacted-tls
  rules:
    - host: host1.redacted.com
      http:
        paths:
          - path: /
            backend:
              serviceName: redacted-staging
              servicePort: port-1
          - path: /admin
            backend:
              serviceName: redacted-staging
              servicePort: port-1-admin
    - host: host2.redacted.com
      http:
        paths:
          - path: /
            backend:
              serviceName: redacted-staging
              servicePort: port-1
          - path: /admin
            backend:
              serviceName: redacted-staging
              servicePort: port-1-admin
    - host: host3.redacted.com
      http:
        paths:
          - path: /
            backend:
              serviceName: redacted-staging
              servicePort: port-2
    - host: host4.redacted.com
      http:
        paths:
          - path: /
            backend:
              serviceName: redacted-staging
              servicePort: port-3
    - host: host5.redacted.com
      http:
        paths:
          - path: /
            backend:
              serviceName: redacted-staging
              servicePort: port-4
    - host: host6.redacted.com
      http:
        paths:
          - path: /
            backend:
              serviceName: redacted-staging
              servicePort: port-1

All 1120 erors are from 2 different versions of this same ingress resource.

@MaikuMori please check the vts output in url :18080/nginx_status and :18080/nginx_status/format/json (if you can, please redact the upstream names and hosts and send the json)

Status endpoint works, that's the first thing I checked. I'm sending you email with json. It's somewhat big because we have more Ingreses besides this one.

Did you customize your template?
Looks like your upstream is not named in the pattern name-portnumber.
On Wed, 15 Mar 2017 at 18:53, Miks Kalnins<EMAIL_ADDRESS>wrote:

Status endpoint works, that's the first thing I checked. I'm sending you
email with json. It's somewhat big because we have more Ingreses besides
this one.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/kubernetes/ingress/issues/448#issuecomment-286825942,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AFbljAAW_Cv0DStbCJSBnEabvQWtCkACks5rmCWRgaJpZM4MeMd2
.

--
Giancarlo Rubio

I don't use custom template.
Also working via email with @aledbf where I provided him some additional debug info.

@gianrubio I think the issue is related to the the reuse of the upstreams inside the same zone (multiple ingress pointing to the same service)

I just reproduce the error, the controller is duplicating the server upstream. I'm looking how to fix this
nginx.conf
    upstream default-default-http-backend-port-1 {
        least_conn;
        server <IP_ADDRESS>:8080 max_fails=0 fail_timeout=0;
        server <IP_ADDRESS>:8080 max_fails=0 fail_timeout=0;
    }
    upstream default-default-http-backend-port-1-admin {
        least_conn;
        server <IP_ADDRESS>:8080 max_fails=0 fail_timeout=0;
        server <IP_ADDRESS>:8080 max_fails=0 fail_timeout=0;
    }

Error
$ curl <IP_ADDRESS>:10254/metrics
An error has occurred during metrics gathering:

28 error(s) occurred:
* collected metric nginx_nginx_all_upstream_responses_total label:<name:"server" value:"<IP_ADDRESS>:8080" > label:<name:"status_code" value:"1xx" > label:<name:"upstream" value:"default-default-http-backend-port-1" > counter:<value:0 >  was collected before with the same name and label values
* collected metric nginx_nginx_all_upstream_responses_total label:<name:"server" value:"<IP_ADDRESS>:8080" > label:<name:"status_code" value:"2xx" > label:<name:"upstream" value:"default-default-http-backend-port-1" > counter:<value:0 >  was collected before with the same name and label values
* collected metric nginx_nginx_all_upstream_responses_total label:<name:"server" value:"<IP_ADDRESS>:8080" > label:<name:"status_code" value:"3xx" > label:<name:"upstream" value:"default-default-http-backend-port-1" > counter:<value:0 >  was collected before with the same name and label values

I concur this is probably the error since we have multiple upstream servers with same and/or different ports.

@MaikuMori just to confirm, could you share your upstream for redacted-redacted-staging-redacted ?

I just reproduce the error, the controller is duplicating the server upstream. I'm looking how to fix this

is not duplicating the upstream, the ports are different (names) https://github.com/kubernetes/ingress/blob/master/core/pkg/ingress/controller/controller.go#L739

is not duplicating the upstream, the ports are different (names)

Sorry, it's duplicating the server
server <IP_ADDRESS>:8080 max_fails=0 fail_timeout=0;
server <IP_ADDRESS>:8080 max_fails=0 fail_timeout=0;

@gianrubio right, but that is ok. The current implementation allows different configuration for the same service if is used by different ingress rules like sticky sessions
Maybe we need to preprocess the stats in order to avoid this issue?

@MaikuMori please test the image quay.io/aledbf/nginx-ingress-controller:0.78

@MaikuMori @gianrubio this issue is related to #455

Yep, this indeed fixes the problem.


Add the possibility to link a node to itself

Hi,
first thanks for the framework it really works great!
Do you think it would be possible to add links from a node to itself (i.e. a link with tid === sid)
so that it would be visible? As of now you can of course add that link but it isn't drawn
That would be really cool!

Hi @simonefranza, thanks for your comments!why do you want to link a node to itself? What kind of visualization do you envision for that?

I'm drawing a graph given an adjacency matrix (see here). The values on the diagonal represent links to itself, so as of now they have to be 0, but since the matrix is interactive, it would be cool if one could also edit the diagonal of the matrix and it would get reflected on the graph


Refactor ExprNodes for Python 3 compatibility

This pull request contains a series of commits refactoring the ExprNodes module to clean up old Python 2 code and be compatible with Python 3.
Most notable changes include:

Removal of Python 2 specific elements across various functions such as _analyse_name_as_type, generate_evaluation_code, and analyse_as_type. This involves eliminating outdated type handling, surrogate pair processing, and compatibility checks.
Simplification of string handling in alignment with Python 3's consistent Unicode approach, notably in the StringNode class and generate_evaluation_code method. This includes removing the unicode_value attribute and streamlining the handling of string constants.
Streamlining of the ImportNode to adhere to Python 3 standards, removing Python 2 specific features like absolute_import checks and adapting import level handling.

See the individual commit messages for more details.
There are probably many more old Python 2 constructs that can be cleaned up in ExprNodes, but this is a start.

Probably worth checking that some of this isn't covered by https://github.com/cython/cython/pull/5827 and https://github.com/cython/cython/pull/5830

Probably worth checking that some of this isn't covered by #5827 and #5830

Yeah, I'll merge those first because they also fix some tests and establish behavioural differences.

@scoder Thanks for rebasing and reviewing. I processed your suggestions.

We first need to decide what to do about UnicodeNode and StringNode: https://github.com/cython/cython/issues/5854


added case when color doesn't exist in colour.py

We have objects that are 'rose' color and that doesn't exist in the colour.py that the plotter uses.  This is an easy default to stop the plotter from failing.

I would think anything can be merged to development, although if anything needs to be merged to master that is Dean's call when he gets back.


pipenv install : pkg_resources.extern.packaging.requirements.InvalidRequirement: Parse error at "'monitori'": Expected stringEnd

I git clone the forked repo on a Cloud 9 instance
I have a strange issue and I don't understand where is the issue
Admin:~/environment/automating-livestream-video-monitoring/broadcast-monitoring (main) $ pipenv install
Pipfile.lock not found, creating...
Locking [dev-packages] dependencies...
Building requirements...
Resolving dependencies...
✔ Success!
Locking [packages] dependencies...
Building requirements...
Traceback (most recent call last):
  File "/usr/lib/python3.7/site-packages/pkg_resources/_vendor/packaging/requirements.py", line 93, in __init__
    req = REQUIREMENT.parseString(requirement_string)
  File "/usr/lib/python3.7/site-packages/pkg_resources/_vendor/pyparsing.py", line 1654, in parseString
    raise exc
  File "/usr/lib/python3.7/site-packages/pkg_resources/_vendor/pyparsing.py", line 1644, in parseString
    loc, tokens = self._parse( instring, 0 )
  File "/usr/lib/python3.7/site-packages/pkg_resources/_vendor/pyparsing.py", line 1402, in _parseNoCache
    loc,tokens = self.parseImpl( instring, preloc, doActions )
  File "/usr/lib/python3.7/site-packages/pkg_resources/_vendor/pyparsing.py", line 3417, in parseImpl
    loc, exprtokens = e._parse( instring, loc, doActions )
  File "/usr/lib/python3.7/site-packages/pkg_resources/_vendor/pyparsing.py", line 1406, in _parseNoCache
    loc,tokens = self.parseImpl( instring, preloc, doActions )
  File "/usr/lib/python3.7/site-packages/pkg_resources/_vendor/pyparsing.py", line 3205, in parseImpl
    raise ParseException(instring, loc, self.errmsg, self)
pkg_resources._vendor.pyparsing.ParseException: Expected stringEnd (at char 10), (line:1, col:11)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/ec2-user/.local/bin/pipenv", line 8, in <module>
    sys.exit(cli())
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/vendor/click/core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/vendor/click/core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/vendor/click/core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/vendor/click/core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/vendor/click/core.py", line 754, in invoke
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/vendor/click/decorators.py", line 84, in new_func
    return ctx.invoke(f, obj, *args, **kwargs)
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/vendor/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/cli/command.py", line 215, in install
    site_packages=state.site_packages
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/core.py", line 2008, in do_install
    keep_outdated=keep_outdated
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/core.py", line 1258, in do_init
    pypi_mirror=pypi_mirror,
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/core.py", line 1068, in do_lock
    keep_outdated=keep_outdated
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/utils.py", line 1315, in venv_resolve_deps
    deps, project, r=False, include_index=True
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/utils.py", line 1447, in convert_deps_to_pip
    new_dep = Requirement.from_pipfile(dep_name, dep)
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/vendor/requirementslib/models/requirements.py", line 2745, in from_pipfile
    r = FileRequirement.from_pipfile(name, pipfile)
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/vendor/requirementslib/models/requirements.py", line 1842, in from_pipfile
    arg_dict["setup_info"] = arg_dict["parsed_line"].setup_info
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/vendor/requirementslib/models/requirements.py", line 806, in setup_info
    self.setup_info = self.get_setup_info()
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/vendor/requirementslib/models/requirements.py", line 795, in get_setup_info
    setup_info = SetupInfo.from_ireq(self.ireq, subdir=self.subdirectory)
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/vendor/requirementslib/models/requirements.py", line 772, in ireq
    self.parse_ireq()
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/vendor/requirementslib/models/requirements.py", line 936, in parse_ireq
    if self.requirement is not None and self._ireq.req is None:
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/vendor/requirementslib/models/requirements.py", line 474, in requirement
    self.parse_requirement()
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/vendor/requirementslib/models/requirements.py", line 1082, in parse_requirement
    self._requirement = init_requirement(name)  # type: PackagingRequirement
  File "/home/ec2-user/.local/lib/python3.7/site-packages/pipenv/vendor/requirementslib/models/utils.py", line 197, in init_requirement
    req = Requirement.parse(name)
  File "/usr/lib/python3.7/site-packages/pkg_resources/__init__.py", line 3153, in parse
    req, = parse_requirements(s)
  File "/usr/lib/python3.7/site-packages/pkg_resources/__init__.py", line 3098, in parse_requirements
    yield Requirement(line)
  File "/usr/lib/python3.7/site-packages/pkg_resources/__init__.py", line 3108, in __init__
    super(Requirement, self).__init__(requirement_string)
  File "/usr/lib/python3.7/site-packages/pkg_resources/_vendor/packaging/requirements.py", line 97, in __init__
    requirement_string[e.loc : e.loc + 8], e.msg
pkg_resources.extern.packaging.requirements.InvalidRequirement: Parse error at "'monitori'": Expected stringEnd

I delete this line https://github.com/aws-samples/automating-livestream-video-monitoring/blob/main/broadcast-monitoring/Pipfile#L18 and the install works without this package

I found a "fix"
I cleaned this file https://github.com/aws-samples/automating-livestream-video-monitoring/blob/main/broadcast-monitoring/src/sharedlib/setup.py
setuptools.setup(
    name="Broadcast Monitoring Lambda Helpers",
    version="0.0.1",
    description="Helper classes",
    long_description="Helper classes",
    long_description_content_type="text/markdown",
    packages=setuptools.find_packages(),
    install_requires=[
        'boto3',
        'PyYAML'
    ],
    classifiers=[
        "Programming Language :: Python :: 3",
        "License :: Other/Proprietary License",
        "Operating System :: OS Independent",
    ],
)


Increment versions for healthcareapis releases

Increment package versions for healthcareapis releases

API change check
API changes are not detected in this pull request.


Generate "copyWith" and "operator == method" when running build_runner

Good afternoon,
I was wondering if there are plans to include copyWith and operator == method in the generated files, like in the freezed package.
Thanks

There's a package to generate copy with and equality. It's compatible with Isar.

Do you know the name by chance?

This is one: https://pub.dev/packages/copy_with_extension
And all other packages that don't do weird things like freezed should work too

Sure you can make them immutable if you prefer

Like this?
@collection
@immutable
class User {
...
}

Yes

Thanks.
I am currently using Riverpod with freezed and Hive. I am hoping I can get at least the same functionality that I currently am by using Isar. I really like the looks of this package.
And I will head on over to the telegram channel.


Make the API's marked in the screenshot below to use page id instead of application and workspace ids.

Change
Make the API's marked in the screenshot use pageId instead of applicationId.
Why
We have the page id as soon as the main bundle is initialized.
We can not make these essential API calls unless we have the application ID. We depend on another API to get the application id making the first meaningful paint slower by 2*(300-600)ms.
Possible way to handle it
Add an additional step to these API handlers on backend to translate page id to application id, this is an extra query, but we are ok with it.
Considerations
Should we leave the original API end points intact for when we have the applicationId.

List of API to modify.
View mode
v1/actions/view?applicationId={id}
v1/collections/actions/view?applicationId={id}
v1/themes/applications/${applicationId}/current?mode=${mode}
v1/themes/applications/${applicationId}
Edit mode
v1/actions?applicationId={id}
v1/collections/actions?applicationId={id}
same 2 theme API's
api/v1/plugins?workspaceId=${workspaceId}
v1/datasources?workspaceId=${workspaceId}
Don't deprecate the existing API's

Closing this in favour of consolidated APIs project.

https://github.com/appsmithorg/appsmith/pull/29251


JAX C++ jit path pulls SDA back to host

import jax
import jax.numpy as jnp
f = lambda x: jnp.add(x, 1)
x = jax.pmap(f)(jnp.array([1]))  # x is a SDA

# jnp.add will use the JAX C++ jit path which has SDA handling falling back to numpy-like handling
x = jnp.add(x, 1)

Handling: https://github.com/tensorflow/tensorflow/blob/master/tensorflow/compiler/xla/python/py_values.cc#L220-L223

This is true for both the C++ and Python paths, and in both is due to device_put(x: ShardedDeviceArray) involving a copy to host. Instead we should (at least!) special case the path where the SDA is fully replicated and we can just take the buffer on the desired device and wrap it in a DeviceArray...

Duplicate of https://github.com/google/jax/issues/4885


Fix "make release" issue

Will raise exception:
hack/make-rules/release-images.sh: 19: hack/make-rules/release-images.sh: Bad substitution

@vincent-pli  I put /usr/bin/env bash at the beginning of the file release-images.sh. What's the bash version of /usr/bin/env bash in your environment?

@charleszheng44 It's on my utuntu 18.04:
root@thump1:~/go/src/github.com/alibaba/openyurt# bash --version
GNU bash, version 4.4.20(1)-release (x86_64-pc-linux-gnu)
Copyright (C) 2016 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>

I have not dig into this issue, and I found make build could work as normal and it has bash like this:
bash hack/make-rules/build.sh $(WHAT)

@vincent-pli thanks for your information. The reason I put #!/usr/bin/env bash at the beginning of the script is to make the script portable across different UNIX like operating systems.
What is the output of /usr/bin/env bash in your environment?  Is it the same as just running bash, i.e., version 4.4.20?

@charleszheng44
root@thump1:~# /usr/bin/env bash --version
GNU bash, version 4.4.20(1)-release (x86_64-pc-linux-gnu)
Copyright (C) 2016 Free Software Foundation, Inc.

That's weirod, make release should work the same way without the bash. Anyway, I will merge this PR for now.


Transak

Checklist

[x] I have read the CONTRIBUTING guide
[ ] Good naming (as clear and simple as possible)
[ ] Correct behavior if external API endpoints are down, return 404, 504 (or no answer), 401 errors (ddos simulation)
[ ] I tested desktop/mobile resolution
[x] I tested light/dark theme
[ ] I tested different languages
[ ] I checked the functionality once again (AFFECT MONEY)
[x] I checked the work on the Testnet
[ ] I checked the work on the Mainnet
[ ] I checked the work in the plugin
[ ] I checked the PR once again

Tests
Please start auto tests as follows:

add a label swap test to start swap tests
add a label withdraw test to start withdraw tests

You can skip these tests if you completely sure that your changes aren't related to this functional
Original issue
#4826
Video / screenshot proof

RPC на полигоне и бинансе опять тормозит в тестах. Для бинанса локально тоже


added steps required to run this playbook

Purpose

Added steps required to run playbook create_virtualmachine_with_subnet_in_different_resource_group.yml. Closes #49

Does this introduce a breaking change?

[ ] Yes
[ x] No

Pull Request Type
What kind of change does this Pull Request introduce?

[ ] Bugfix
[ ] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ x] Documentation content changes
[ ] Other... Please describe:

How to Test

Install ansible

$ pip install ansible[azure]

[Optional] Install ansible role

$ ansible-galaxy install Azure.azure_preview_modules
$ pip install -r ~/.ansible/roles/Azure.azure_preview_modules/files/requirements-azure.txt

Get the sample playbook

git clone https://github.com/Azure-Samples/ansible-playbooks.git
cd ansible-playbooks
git checkout [branch-name]

Test the code

ansible-playbook <filename>.yml

What to Check
Verify that the playbook is successfully run.
Other Information

@zikalino Could you help to review this PR? This PR add documentation to fixed #49, Thanks!

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: ashishrajsrivastava sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

@yuwzho

will be adding Ansible extension for Visual Studio code steps in readme as a part of another PR.

If installing Ansible extension, there is no need to install the Azure account extension. @yungezz Please correct me if anything wrong

you'll still need install azure account extension if you want to run playbook in cloudshell with VSCode. Ansible extension doesn't bundle any other extension. User instsall azure account extension per need.

Yep to be able to run it in cloud shell in vscode user will have to install azure account extension too. If user opts for other  execution target like docker,local ansible or via ssh then azure account extension will not be needed but then user will jave to configure the authentication environment in respective options himself.

@ashishrajsrivastava Thanks for your pr, sorry about the late response.


Add a Simple Maze Game

Describe the project you want to add with tech stack
A simple maze game using HTML, CSS, and JavaScript
Expected behavior

The objective of the game is to navigate the player from its starting position to the end position, represented by a green square.
You can use the arrow keys on your keyboard to move the player up, down, left, and right within the boundaries of the maze.
If the player successfully reaches the end position, a message will pop up, congratulating you for completing the maze.

Please assign me this issue I would love to work on it. I am a GSSOC'2023 contributor.


[HackaDoc] Updating cluster version reference in mahout article

Updating cluster version reference in mahout article to include 3.1, 3.2 or later versions.

Hi @maxluk, I'm your friendly neighborhood Azure Pull Request Bot (You can call me AZPRBOT). Thanks for your contribution!

It looks like you're working at Microsoft (maxluk). If you're full-time, we DON'T require a contribution license agreement.

If you are a vendor, or work for Microsoft Open Technologies, DO please sign the electronic contribution license agreement. It will take 2 minutes and there's no faxing! https://cla.azure.com.

TTYL, AZPRBOT;


stream模式导入csv时，csv中最后一个字段（字符串类型）为\N，导入后存入字符串\N；非最后一个字段（字符串类型）为\N，导入后存入null

Describe the bug
A clear and concise description of what the bug is.
To Reproduce
Steps to reproduce the behavior:

Go to '...'
Click on '....'
Scroll down to '....'
See error

Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):

OS: [e.g. iOS]
Browser [e.g. chrome, safari]
Version [e.g. 22]

Smartphone (please complete the following information):

Device: [e.g. iPhone6]
OS: [e.g. iOS8.1]
Browser [e.g. stock browser, safari]
Version [e.g. 22]

Additional context
Add any other context about the problem here.

Maybe you use the way was incorrect，I test the same case but always the data is NULL. please recheck again.


Remove PropTypes from IncrementalPresenter

Related to https://github.com/facebook/react-native/issues/21342

Just did the request changes, @empyrical. Thanks for the advise.

Looks like there's a flow failure here:
Cannot create `View` element because mixed [1] is incompatible with undefined [2] in the return value of property
`onLayout`.

   Libraries/Experimental/IncrementalPresenter.js:85:9
               v----
   85|         <View
   86|           children={this.props.children}
   87|           ref="view"
   88|           style={style}
   89|           onLayout={this.props.onLayout}
   90|         />
               -^

References:
   Libraries/Experimental/IncrementalPresenter.js:38:38
   38|   onLayout?: (event: LayoutEvent) => mixed,
                                            ^^^^^ [1]
   Libraries/Components/View/ViewPropTypes.js:31:39
   31|   onLayout?: ?(event: LayoutEvent) => void,
                                             ^^^^ [2]

This is because the onLayout type in ViewPropTypes.js needs to be fixed so it returns mixed, rather than void. Then your PR should pass tests! :+1:

Thanks for contributing!


[fixed] Reset mountedComponents array when routing, to avoid leaking component references if the mount depth decreases.

I'm currently developing an application with a route structure like so:
<Route name="app" path="/" handler={App}>
  <Route name="search" path="search" handler={SearchResults}/>
  <Route name="result" path="result/:resultId" handler={ResultPage}>
    <DefaultRoute name="resultDetail" handler={ResultDetail}/>
    <Route name="relatedResults" path="related" handler={RelatedResults}/>
  </Route>
</Route>

Whenever I transition from one of the two child routes of ResultPage to the SearchResults route, the mountedComponents variable inside createRouter.js leaks a reference to the child route, as no component will overwrite it with a call to setRouteComponentAtDepth. This could potentially leak a large amount of memory through references to props, etc.
This PR fixes that by recreating the array with every route dispatch. I'm not sure how to create a test specifically for this, as it just changes an internal variable's behavior, and the failing case is a silent memory leak.

:+1:
I'm not sure if this the correct place to reset mountedComponents though.
What if...

a transition is aborted?
user doesn't (fully) rerender?

I think it would be better to unset them individually in componentWillUnmount in RouteHandlerMixin.

 I'll make a new PR with that fix.

New fix in #783


Track Progress Completed Count > Count includes Work Items in "Removed" state

The Portfolio Plans view is counting work items in "removed state" for the completed count.
Browser
Choose a browser
[X] Edge Chromium
[ ] IE11
[ ] Chrome
[ ] FireFox
[ ] Safari

Sorry, but this code in this repo is not currently being maintained. We recommend you use the Delivery Plans feature that is core to Azure DevOps.


KeyError: 'OrientedRCNN is not in the models registry'

I have run the inference command using the following command:
python image_demo.py demo/demo.jpg
configs/obb/oriented_rcnn/vit_base_win/faster_rcnn_orpn_our_rsp_vitae-nc-base-win-rvsa_v3_wsz7_fpn_1x_dota10_ms_lr1e-4
_ldr75_dpr15.py
checkpoints/vitae_rvsa_new.pth
--device cpu
Its using image_demo.py file from OBBDetection.
I am using MMCV version 1.6.2 and python version 3.9. How to reslove this error?

I have the same problem


Fix TreeMap creation from Java Map

Probably fixes https://github.com/javaslang/javaslang/issues/1418, @ruslansennov, @danieldietrich and @goerge, please review.

[Current coverage][cc-pull] is 97.25%

Merging [#1420][cc-pull] into [master][cc-base-branch] will not change coverage

@@             master      #1420   diff @@
==========================================
  Files            86         86
  Lines         10307      10307
  Methods           0          0
  Messages          0          0
  Branches       1823       1823
==========================================
  Hits          10024      10024
  Misses          156        156
  Partials        127        127

Powered by Codecov. Last updated by [728f432...b133b20][cc-compare]
[cc-base-branch]: https://codecov.io/gh/javaslang/javaslang/branch/master?src=pr
[cc-compare]: https://codecov.io/gh/javaslang/javaslang/compare/728f43228282a66e75b677e597e775ce15c7a76a...b133b2022a078b92b233e1782a998c998b2a078b
[cc-pull]: https://codecov.io/gh/javaslang/javaslang/pull/1420?src=pr

Thank you, will check that this evening...

Thank you!! Will pull it now.


Twemproxy Server Timedout

Hi,
Can you please help to identify the reason of error with redis server.
Twemproxy logs :-
[2017-02-09 12:06:24.188] nc_request.c:96 req 219840 done on c 27903 req_time 1000.594 msec type REQ_REDIS_HMGET narg 7 req_len 117 rsp_len 27 key0 'USER:SESSION:8c5ab24a-c0b0-4ccd-a377-02c0b1d728ed' peer '<IP_ADDRESS>:58653' done 1 error 1
Twemproxy Configurations :-
alpha:
auto_eject_hosts: false
client_connections: 40000
distribution: modula
hash: crc32a
hash_tag: '{}'
listen: <IP_ADDRESS>:8511
preconnect: false
redis: true
server_connections: 10000
server_failure_limit: 2
server_retry_timeout: 30000
servers:

<IP_ADDRESS>:6382:1
timeout: 500
beta:
auto_eject_hosts: false
client_connections: 75000
distribution: modula
hash: crc32a
hash_tag: '{}'
listen: <IP_ADDRESS>:8510
preconnect: false
redis: true
server_connections: 20000
server_failure_limit: 2
server_retry_timeout: 30000
servers:
<IP_ADDRESS>:6380:1 slave1
<IP_ADDRESS>:6381:1 slave2
timeout: 1000

And also my redis server is running fine but in my twemproxy logs i have found below error logs.
nc_core.c:237 close s 7742 '<IP_ADDRESS>:6381' on event FF00FF eof 0 done 0 rb 76 sb 123: Connection reset by peer
And counter of server_error at nutcracker is increased.
Please help to understand the situation from that logs.

@manjuraj
Please help as i am going to productions in few days.


file access errors and accordions not working for me

Software Versions

Python :Python 3.9.2
OS: windows 10
Kivy: 2.0.0
Kivy installation method: used the instructions here https://kivy.org/doc/stable/gettingstarted/installation.html#kivy-source-install

Describe the bug
I first noticed it when i tried to make a accordion setup. It wouldn't display no matter what example i fallowed. Even if i fallowed the one in the example files it wouldn't display the contents and would have a extra button. If i changed the orientation to horizontal it would all collaps to the corner ignoring anything i tried. Then i noticed all these errors in the console and google has been no  help figuring out what they mean.
The code im using
https://pastebin.com/zCGm3thH
https://pastebin.com/D1WhUyrt
what it looks like on my end
https://imgur.com/gallery/NnO8fIa
I tried to fallow this video to see what i was doing wrong but nothing
https://www.youtube.com/watch?v=h_5QsY_Es00
i even copied his 100% and i still don't get that result

I ran your code with master and it looks fine:
from kivy.app import App
from kivy.uix.widget import Widget
from kivy.lang import Builder

Builder.load_string("""
<PaperTicketGridLayout>
	BoxLayout:
		orientation: "vertical"
		size: root.width, root.height
		Accordion:
			orientation: 'vertical'
			AccordionItem:
				title: 'New Ticket'
				Label:
					text: "Building Number"
				Label:
					text: "Room Number"
			AccordionItem:
				title: 'New Ticket'
				Label:
					text: "Building Number"
				Label:
					text: "Room Number"
""")

class PaperTicketGridLayout(Widget):
    pass

class PaperTicketApp(App):
    def build(self):
        return PaperTicketGridLayout()

if __name__ == '__main__':
    PaperTicketApp().run()

i tried that but as soon as i posted it there it was deleted with not warning or error or notification.


Add a weather app

I can add a weather app to this project. @iamrahulmahato  plz assign this to me with gssoc-extd label

@iamrahulmahato please assign this project to me

sorry @devarsheecodess someone already working it


[pt-PT] Adding new translated strings

Updating pt-pt translation as requested in #50

Looks good to me @gablm.
I will go ahead to merge this PR right now.
Once again, thank you for your contribution on this!


fix: Updated Template

Description
Summary of changes

Replaced all the input widgets with the new Input widget for the CRUD app.

All the input widget of the CRUD app needs to be changed to INPUT_WIDGET_V2 which is done in the PR = Resolves issue raised in the PR: https://github.com/appsmithorg/appsmith/pull/10694
But QA found out below bugs(Can be found in the above PR):

The input widget name has been changed because of which the Insert fails
The update button deletes the data from the table
When there is a build data and user tries to insert the data the data doesn’t get inserted in table (might be same as 1st issue because of the name change in the input widget)

Type of change

New feature (non-breaking change which adds functionality)

How Has This Been Tested?
This is only tested on PostgreSQL page for updating the records in the table.
The above cases needs to be re-tested
Checklist:

[ ] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes

/ok-to-test sha=fd17be1

@keyurparalkar All the 3 issues are fixed and have done a round of regression around crud pages seems good


Return Type Defaults to Object when attr_* Methods are Used

Using the @!attribute directive, the type can be defined within []
class Task < ActiveRecord::Base
  # @!attribute [r] name
  #   @return [String] The name of the task.
end

This works perfectly, with the generated document showing
#name ⇒ String (readonly)

Unfortunately, by adding a attr_* method to the class,  the generated doc shows Object as the return type.
This code
class Task < ActiveRecord::Base
  # @!attribute [r] name
  #   @return [String] The name of the task.

  attr_reader :name
end

generates this document
#name ⇒ Object (readonly)

Could you please take a look? Thanks.

You should not be using @!attribute on the attr_reader DSL, you should document it normally because YARD already understands attr_reader:
# @return [String] the name of the task
attr_reader :name

Thank you.
Does that mean I should separate my variables into multiple lines of attr_reader?
# @return [String] the name of the task
attr_reader :name

# @return [CustomClass] lorem ipsum
attr_reader :foo

Otherwise, how does the @return statement tell which variable they are
referring to?
# @return [String] the name of the task
# @return [CustomClass] lorem ipsum
attr_reader :name, :foo

Yes, for documentability you should have separate declarations for each attribute.

Thanks.


Exclude sub-test incompatible with jdk16+ HotSpot

Exclude sub-test incompatible with jdk16+ HotSpot to allow MiniMix system test to work on HotSpot JDk16+
Related to https://github.com/AdoptOpenJDK/openjdk-tests/issues/2150

Signed-off-by<EMAIL_ADDRESS><EMAIL_ADDRESS>

Test : https://ci.adoptopenjdk.net/view/Test_grinder/job/Grinder/5921/console

Test : https://ci.adoptopenjdk.net/view/Test_grinder/job/Grinder/5921/console

Copying Pete's comment from https://github.com/AdoptOpenJDK/openjdk-tests/pull/2151#issuecomment-757005016:

You can try adding --illegal-access=permit to see if it fixes the Hotspot failure, not sure it will. Using --illegal-access isn't a long term solution as the option is expected to be removed in a future version of java.
a) likely this failure shows OpenJ9 is missing something, although we may already have an issue for it @tajila ?
b) if we can't find a command line option workaround for the Hotspot failure, I expect the test needs to be removed as incompatible with jdk16+

Since --illegal-access=permit is an option that'd be discontinued in future version of Java, I feel reluctant to introduce it in the playlist.
This PR excludes the failing subtest. This exclusion, together with https://github.com/AdoptOpenJDK/openjdk-tests/pull/2151, makes the MiniMix test functional on HotSpot as seen in test the grinder here.

Copying Pete's comment from https://github.com/AdoptOpenJDK/openjdk-tests/pull/2151#issuecomment-757005016:

You can try adding --illegal-access=permit to see if it fixes the Hotspot failure, not sure it will. Using --illegal-access isn't a long term solution as the option is expected to be removed in a future version of java.
a) likely this failure shows OpenJ9 is missing something, although we may already have an issue for it @tajila ?
b) if we can't find a command line option workaround for the Hotspot failure, I expect the test needs to be removed as incompatible with jdk16+

Since --illegal-access=permit is an option that'd be discontinued in future version of Java, I feel reluctant to introduce it in the playlist.
This PR excludes the failing subtest. This exclusion, together with https://github.com/AdoptOpenJDK/openjdk-tests/pull/2151, makes the MiniMix test functional on HotSpot as seen in test the grinder here.

<EMAIL_ADDRESS>- Please review.

<EMAIL_ADDRESS>- Please review.

Test on JDk16 HotSpot AIX: https://ci.adoptopenjdk.net/view/Test_grinder/job/Grinder/5922/console

Test on JDk16 HotSpot AIX: https://ci.adoptopenjdk.net/view/Test_grinder/job/Grinder/5922/console


Ruru example error

Hey
I managed to get the ruru example to compile however i am getting this error when I try to run the ruby script.
example.rb:1:in `require_relative': cannot load such file -- /Users/zacksiri/Repositories/rust_example/ruru/target/release/librurulol (LoadError)

here is the target/release directory after running cargo build --release
build            deps             examples         librurulol.dylib native

I committed the version for linux, but you're on OSX. You need to modify the source to say librurulol.dylib rsather than librurulol.so.

Where do I change that? i don't see any reference to either.
Sorry i am quite a noob to this ;)

Sorry, It's .a, not .so: https://github.com/steveklabnik/rust_example/blob/master/Makefile#L3

(and it's all good, it's been a while since I"ve played with this repo, as you can see, I'm fuzzy on the exact details myself! the newest rust also just came with a cdylib type that this should probably be using now...)

@steveklabnik thx for replying! I managed to get it to work here
https://github.com/codemy/ruru_example
I am going to work on writing more rust code now, as I am working on an application, where I need to be able to control memory usage, and relying on Ruby's GC is just not enough anymore.
Been reading through the rust documentation I know you had a major hand in that so thank you for your efforts!

Awesome! Feel free to post any questions on our forums or drop by IRC if you need help. Good luck! :)


Problem when folder contains quote in name

Hi,
The page doesn't currently handle folder with quote in name (it truncate what's after the quote, quote included)

Hi @Nerothos, that is interesting. I hadn't run into that yet. Which web server(s) are you using?
Will you please save, and share, copies of your web browser's file browsing pages for the folder, and parent of it, that you have issues with? Like the test examples in this folder? https://github.com/pseudosavant/folder.api/tree/master/server

I'm using Apache/2.4.53
Here's a basic test using an image and a folder with similar quote.
test.tar.gz

Thanks @Nerothos, I'll check it out when I work on this project next.

@Nerothos I haven't been able to reproduce this issue using Apache locally with folders that have a quote in them. I checked out your tar file. I don't think I explained what I'm looking for well.
The test examples in https://github.com/pseudosavant/folder.api/tree/master/server are all the result of browsing to a folder on an HTTP server with file browsing enabled and pressing Ctrl-S to save the HTML of the folder/file browsing page. Not the player.html page. It is the HTML that the server renders to list the files.
Here is how to do it:

Go to the folder that has the problematic folder or file name in it (e.g. http://yourserver.com/videos/)

Press Ctrl-S to save the index.html file of the Apache folder listing
Upload that index.html here

You should end up with a file like this: https://github.com/pseudosavant/folder.api/blob/master/server/apache-std/index.html

That file could still be useful for tests, but I figured out where the issue is. Single quotes needed to be percent encoded for URLs in the folder template. The fix will be in the next release.

Sorry for not responding, I was busy.
I've just tried with that version and it seems to be working ! Thanks.


chore(deps): upgrade dev dependencies

Upgrades project dependencies. See details in workflow run.

Automatically created by projen via the "upgrade-dev-dependencies-k8s-30-main" workflow

⚪ Backport skipped
The pull request was not backported as there were no branches to backport to. If this is a mistake, please apply the desired version labels or run the backport tool manually.
Manual backport
To create the backport manually run:
backport --pr 4517

Questions ?
Please refer to the Backport tool documentation


Right Epsilon for 6 decimal GeoJSON ?

What would be the best epsilon for GeoJSON with 6 decimals coordinates ?

With tests, 0.00000000001 (1 x 10^-11) is ok while 0.0000000001 (1 x 10^-10) is not

FYI, there is an open PR for better (?) epsilon calculations, here:
https://github.com/voidqk/polybooljs/pull/8
I haven't tested it in depth, but maybe it is worth your time.


Bump commons-io from 2.6 to 2.7 in /monkey-api-encrypt-core

Bumps commons-io from 2.6 to 2.7.
Signed-off-by: dependabot[bot]<EMAIL_ADDRESS>

fdf


[entropy_src/dv] Ignore outstanding alerts after disablement

Some tests were failing because the scoreboard was expecting an alert after disabling the DUT. This PR adds a variable that when set leads the scoreboard to ignore any outstanding alerts.
Closes #18797

@vogelpi thanks for your feedback. I changed the line to what you suggested and ran 100% of alert tests as well as 10% of a full regression and I didn't notice any unexpected failures. I think this can be merged now.


Vc 2.0 time props

Implements VC 2.0 validUntil and validFrom feature and tests.
CI is failing in node 14.

@aljones15 Is the PR this one is merging into ready for review? I suggest reviewing the other PR before merging this one into it. If it's ready for review, please mark it as such. Thanks.


Implement new curl request wrapper for uploads.

With this change we introduce support for streaming (chunked)
uploads. This is part of the work for #557.

Rebase and addressed comments. PTAL.


Using The Dataset

Hi, I'm trying to find a source for the Sort-of-CLEVR Dataset. The provided code in this repository seems to be what I'm looking for, but I need help understanding how to set it up for training, validation, and testing. Could you provide a brief example of how the included code could be used to generate a training, validation, and testing set, and then from this, iterate through these datasets in batches of chosen size?

You can have a look at my Jupyter notebook example)


2 surah revelations to fixed

سورة الحشر و سورة الجن
in surah_data.dart
you must fix the revelations

Fixed


[Bug]: Gajim setup fails

Prerequisites

[X] I have written a descriptive issue title.
[X] I have searched all issues/PRs to ensure it has not already been reported or fixed.
[X] I have verified that I am using the latest version of Scoop and corresponding bucket.

Package Name
gajim
Expected/Current Behaviour
Gajim is installed
Steps to Reproduce
scoop install ltguillaume_schep/gajim

Possible Solution

Scoop and Buckets Version
latest

Scoop Config
-

PowerShell Version
-

Additional Softwares
Thank you for packaging gajim :-)
The installation fails for me, because the installer file is named "gajim-portable.exe":
https://github.com/ltguillaume/schep/blob/ee0143c12680e784d9e7b824b069f760dcf8e98a/bucket/gajim.json#L21
The downloaded file is actually named as in the url: "Gajim-Portable-1.9.3-64bit.exe"
Changing the line to the correct filename fixes the installation for me.

Hello, sorry for the delay. I uninstalled gajim and re-installed with your changes, this works for me now 🥳


Support Jaeger daemonset in Helm chart

Please support jaeger daemonset in helm chart. link => https://www.jaegertracing.io/docs/1.18/operator/#installing-the-agent-as-daemonset
e.g
apiVersion: apps/v1
kind: Deployment
metadata:
  name: myapp
spec:
  selector:
    matchLabels:
      app: myapp
  template:
    metadata:
      labels:
        app: myapp
    spec:
      containers:
      - name: myapp
        image: acme/myapp:myversion
        env:
        - name: JAEGER_AGENT_HOST
          valueFrom:
            fieldRef:
              fieldPath: status.hostIP

Hello @kernel164,
As you said in #621, to support daemonset deployment for Jaeger we will support the env and envFrom properties for mesh proxies in the Helm chart.
To configure the Jaeger agent host and port you'll have to reference the JAEGER_AGENT_HOST env variable in the tracing.jaeger.localagenthostport property.


'Loop' setting does not appear in UI

Expected behaviour
When 'loop' is added to the settings config I expect to see something pertaining to 'loop' somewhere in the GUI (specifically, I expect to see it in the settings menu).
Actual behaviour
No 'loop' widget appears in UI.
Steps to reproduce
May be reproduced using codepen link below
Environment

Browser:Chrome
Version:
Operating System:Windows
Version:8.1

Console errors (if any)
Link to where the bug is happening
https://codepen.io/anon/pen/YggeOb

I can comfirm, I have the same issue.

It's not an issue as such but an improvement that can be made. The native player doesn't have any loop display either but it's certainly something we can add.


Error installing on Raspberry pi 2 B

Hello,
I have been trying for the past few hours installing the module on my raspberry pi running Raspbian.
But keep getting the same error. I have checked I have the latest version of npm and nodejs installed.
nodejs: v4.0.0, npm: v 3.8.1
Output Window from  sudo npm install --unsafe-perm --verbose -g sqlite3
https://gist.github.com/elman90/7d3d2e7ee730bd9b8bd7
Debug log
https://gist.github.com/elman90/a19ea08a767e129018fa

This version of node/NAN/v8 requir es a C++11 compiler

That is from the first log. You need to set CXX environment variable to a compiler that supports the -std=c++11 flag.

Thank you for the reply.
I have not changed these compiler related variables before, and relatively new to this.
I tried with
~ $ CXX=gcc-4.8
which by the man page should support C++11. Also by a few searches tried this.
~ $ export CXX=clang++
~ $ export CXXFLAGS="-g -std=c++11 -Wall -pedantic"
And get the same error.
Is there anything I am missing, or any other value I should set.

Hi, I have also problem with sqlite3 on raspberry:
log.txt

I get issues building on a Raspberry PI due to lack of memory. If you are using a PI with < 512mb RAM then you must add a 1gb swapfile. I've had the best experience of building sqlite on Arch Linux and a PI2.

I am running on Raspberry Pi 2 model B. It has 1 GB of RAM. I am using
Raspbian OS
Il giorno 18/mar/2016 18:35, "Alex Ellis"<EMAIL_ADDRESS>ha
scritto:

I get issues building on a Raspberry PI due to lack of memory. If you are
using a PI with < 512mb RAM then you must add a 1gb swapfile. I've had the
best experience of building sqlite on Arch Linux and a PI2.
—
You are receiving this because you authored the thread.
Reply to this email directly or view it on GitHub
https://github.com/mapbox/node-sqlite3/issues/615#issuecomment-198257280

@elman90 I am able to build on Arch Linux on the PI2.. are you able to give it a shot?

Hi again!
I have resolve this issue with updating my Raspberry to latest OS - RASPBIAN JESSIE (Release date: 2016-03-18) https://www.raspberrypi.org/downloads/raspbian/
Also I install NodeJS (v 4.4.0) in correct way https://nodejs.org/en/download/package-manager/#debian-and-ubuntu-based-linux-distributions
After this manipulations, my application works correctly.

I will try that out!
Thank you.
2016-03-21 12:28 GMT+01:00 AndrosovIgor<EMAIL_ADDRESS>
Hi again!
I have resolve this issue with updating my Raspberry to latest OS -
RASPBIAN JESSIE (Release date: 2016-03-18)
https://www.raspberrypi.org/downloads/raspbian/ http://url
Also I install NodeJS (v 4.4.0) in correct way
https://nodejs.org/en/download/package-manager/#debian-and-ubuntu-based-linux-distributions
http://url
After this manipulations, my application works correctly.
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
https://github.com/mapbox/node-sqlite3/issues/615#issuecomment-199233172

Same problem on RASPBIAN.

Got the same issue on a Raspberry pi 3 running raspbian Jessie. Solved installing node this way:
curl -sL https://deb.nodesource.com/setup_4.x | sudo -E bash - sudo apt-get install -y nodejs

Regular install worked for me
uname -a Linux raspberrypi 4.1.13+ #826 PREEMPT Fri Nov 13 20:13:22 GMT 2015 armv6l GNU/Linux
I added swap space, then

install nvm
nvm install v6.1.0
npm install sqlite3
It built without problem and ran the sample

An alternative solution for those who don't want to upgrade their Raspbian from wheezy to jessie or up: if your GCC is too old (gcc -v gives a version older than 4.8), you can also install gcc 4.8 like this:
https://somewideopenspace.wordpress.com/2014/02/28/gcc-4-8-on-raspberry-pi-wheezy/
This will solve the "This version of node/NAN/v8 requires a C++11 compiler" error (which I got because upgrading Node from 0.10.x to 6.x brought the C++11 requirement).

For user in china, you may  try "cnpm install sqlite3", please install cnpm first

About memory requirement check:
https://github.com/mapbox/node-sqlite3/issues/942
About slowness to build:
https://github.com/mapbox/node-sqlite3/issues/597

The errors reported here are all various and from different issues. Anyone hitting this please:

use latest<EMAIL_ADDRESS>use latest npm@6
create a new issue if you are still having problems

If you are on ARM, we don't support binaries yet for easy install, so see #418


add scikit-learn dependency

Also add scipy dependency, since old version of sklearn does not install it automatically.

https://github.com/pfnet-research/chainer-chemistry/pull/93


Help connect dev.gitlive:firebase-database to project

Hi, I'm new to kotlin multiplatforms, I'm trying to connect dev.gitlive:firebase-database:0.2.3 in gradle to my multiplatform project, but I get an error on how to do it right?
Gradle

Error:

Hi sorry about that. The CI didn't publish the artifacts correctly. Should be good now but it's version 0.2.0 you need


[EXID] Added custom metadata to cross-tenant-access-settings-b2b-collaboration (ADO-2093518)

Added "ms.custom: engagement-fy23” metadata to the article.

Learn Build status updates of commit 1e375d5:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

articles/active-directory/external-identities/cross-tenant-access-settings-b2b-collaboration.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the learn.microsoft.com contributor guidesPost your question in the Learn support channel

#sign-off


minimumInputLength = 0 filter issue

As I see in documentation and source code:
@Input() minimumInputLength: if this value is '0', only makes one request to server and later filter values on client side, works as a dropDown in single mode. Functionality for values bigger than 0 not implemented yet.
When we use minimumInputLength = 0 you implemented you own filter function, BUT for instance I have in my local observable 500 elements. In this case your component tries to render all 500 items, and when I click on select there are delay for ~1 second, maybe will be useful to add limit(optional) @Input(), to avoid the delay. Also may be useful to add trackBy for *ngFor results, to accelerate it.

I don't see a clear way to optimize this. I don't believe I know too much ng2 yet to optimize it. If you have code suggestions I will happily integrate a pull request.
In any case, I think the programmer should take a care of how many results will be loaded at a maximum. I will add a feature soon, to load a batch of results and indicate with a message if there are more results available, so that the user knows he should write more characters to narrow the result list. This will require the limit you are talking about.
I will also add the default minimumInputLength behavior.


Twipsy instances do not appear within a modal

Hovering over text causes the twipsy tooltip to show up but it is not visible anywhere.
http://jsfiddle.net/csenV/2/

i think this is because twipsy.js adds the twipsy div at the top of the body, ".modal .twipsy" is never a valid selector.  Changing the z-index on just the .twipsy fixes this, but then twipsy divs will always be above any modal z-index, which I'm not sure is correct behavior

Somebody already fixed this?

We have the same problem and yes, garza is exactly right. The workaround we used is to write:
body div.twipsy{
z-index: 12000;
}
In order to properly fix it, they need to implement #651

Resolved in 2.0-wip. I've added some popovers and twipsies to the demo modal in the js docs page there to help test how those things are layered for the future.


[Pulsar 2.6.2] Partitioned topics was not deleted completely

Describe the bug
After a partitioned topic was automatically deleted because brokerDeleteInactiveTopicsEnabled=true, the topic's metadata was not deleted but we cannot get the topic's info and also cannot create the same topic.
The current state is:
# As you see, there's no topics
$ curl -L http://localhost:8080/admin/v2/persistent/public/default; echo
[]
# However, we can query the topic's metadata
$ curl -L http://localhost:8080/admin/v2/persistent/public/default/_schemas/partitions
{"partitions":1}
# Also, we cannot create the same topic
$ curl -L http://localhost:8080/admin/v2/persistent/public/default/_schemas/partitions -X PUT -H 'Content-Type: application/json' -d 1
{"reason":"Partitioned topic already exists"}
# The stats is also available
$ curl -L http://localhost:8080/admin/v2/persistent/public/default/_schemas/partitioned-stats
{"msgRateIn":0.0,"msgThroughputIn":0.0,"msgRateOut":0.0,"msgThroughputOut":0.0,"bytesInCounter":0,"msgInCounter":0,"bytesOutCounter":0,"msgOutCounter":0,"averageMsgSize":0.0,"msgChunkPublished":false,"storageSize":0,"backlogSize":0,"publishers":[],"subscriptions":{},"replication":{},"metadata":{"partitions":1},"partitions":{"persistent://public/default/_schemas":{"msgRateIn":0.0,"msgThroughputIn":0.0,"msgRateOut":0.0,"msgThroughputOut":0.0,"bytesInCounter":0,"msgInCounter":0,"bytesOutCounter":0,"msgOutCounter":0,"averageMsgSize":0.0,"msgChunkPublished":false,"storageSize":0,"backlogSize":0,"publishers":[],"subscriptions":{},"replication":{}}}}

And before the topic was deleted, the stats is different because I have sent a message:
{
  "msgRateIn": 0.0,
  "msgThroughputIn": 0.0,
  "msgRateOut": 0.0,
  "msgThroughputOut": 0.0,
  "bytesInCounter": 186,
  "msgInCounter": 1,
  "bytesOutCounter": 0,
  "msgOutCounter": 0,
  "averageMsgSize": 0.0,
  "msgChunkPublished": false,
  "storageSize": 186,
  "backlogSize": 0,
  "publishers": [

  ],
  "subscriptions": {

  },
  "replication": {

  },
  "metadata": {
    "partitions": 1
  },
  "partitions": {
    "persistent://public/default/_schemas-partition-0": {
      "msgRateIn": 0.0,
      "msgThroughputIn": 0.0,
      "msgRateOut": 0.0,
      "msgThroughputOut": 0.0,
      "bytesInCounter": 186,
      "msgInCounter": 1,
      "bytesOutCounter": 0,
      "msgOutCounter": 0,
      "averageMsgSize": 0.0,
      "msgChunkPublished": false,
      "storageSize": 186,
      "backlogSize": 0,
      "publishers": [

      ],
      "subscriptions": {

      },
      "replication": {

      },
      "deduplicationStatus": "Disabled"
    }
  }
}

To Reproduce
It happened when I run KoP with Pulsar 2.6.2 and can be reproduced every time
Steps to reproduce the behavior:

Use PulsarAdmin to create a topic;
Create a KafkaProducer to send a message.

TODO: The reproduce procedure by pure Pulsar is to be added.
Expected behavior
The partitioned topic should be deleted completely, which means the related metadata shouldn't be queried and we can recreate the topic again.

https://github.com/apache/pulsar/pull/8442
Has this pr fixed the problem?

#8442
Has this pr fixed the problem?

Yeah, thx for your help.


ValueError: need more than 4 values to unpack

When I try to run the a3c.py, I came across some problem.
“”“
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File "a3c.py", line 71, in actor_learner_thread
s, a, R, minimize, p_network, v_network = graph_ops
ValueError: need more than 4 values to unpack
“‘’”
Follow by the solution in the Stackoverflow, I add a comma in the code. but it failed.
I would appreciate it if anyone can help me.

It looks like a3c is currently in progress and it should be working.  As you can see build_graph https://github.com/coreylynch/async-rl/blob/master/a3c.py#L170 returns 4 values but then when you trying to unpack it with 6 values https://github.com/coreylynch/async-rl/blob/master/a3c.py#L70

@fgvbrt Thank you for your reply and you are right. It seems that the author is too busy to update the A3C project in the short term.


Add @mvayngrib as a collaborator

I'm +1 to add @mvayngrib as a collaborator based on recent PRs (#64, #65, #67), but I don't have the rights. @No9 if you're on board, could you do the honors?
As for rules, it's pretty informal, but I think generally it's good at ask for a +1 from someone else before merging code, although this repo has been pretty quiet, so sometimes you have to wait awhile. For less controversial stuff (readme fixes, etc.), those can just go in directly. And be sure to keep Travis green; once you have rights, you can restart jobs that fail spuriously.
Also @mvayngrib if you let me know your npm username I can add you as an owner, so you have npm publish rights.

@nolanlawson thanks! i'm tenaciousmv on npm

You're an owner now. Let's wait for all these PRs to get in before doing a release, though. Also I'm happy to do a release this time (seems to be a point release?).

Sorry missed this
But I can see @mvayngrib in the npm store so taking it that we are all good.

@No9 Did you add him as a collaborator in Github? I had the rights to add him to npm, but not Github.

Have done now
Welcome @mvayngrib and thanks for the work

@No9 my pleasure, thanks for adding


Spectrum training support

Feature request
Support spectrum training in sft script / cli, e.g. by passing unfrozen_parameters via yaml obtained with spectrum snr analysis:
trl sft \
--model_name_or_path meta-llama/Llama-3.1-8B-Instruct \
--unfrozen_parameters snr_results_Llama-3.1-8B_50percent.yaml \
...

Motivation
I'd love to use the huggingface-pytorch-training docker container out of the box with spectrum for

training speedup
memory reduction

Axolotl does seem to natively support spectrum.
Your contribution
TBD

It seems @philschmid has in implementation here: https://github.com/philschmid/deep-learning-pytorch-huggingface/blob/391f19ba06c128a2a290b3bdcb717ad6ff794fd7/training/scripts/run_sft.py#L54-L77 and the question is maybe just what's the best cleanest way to integrate this natively in trl?

This would be great and would prevent users from making mistakes in the manual implementation of this method: for example, the code for integration with other libraries reported in the official repo has some problems. In contrast, the simple implementation in my tutorial and Philipp's code should be correct.
LMK what's the better way to proceed and help with this integration.


Member settings (upload image, update name)

A page where the member can update their personal information

Will implement in mobile app.


bwoken doesn't run

When I start to run bwoken I get
/Library/Ruby/Gems/2.0.0/gems/bwoken-2.0.0/lib/bwoken/cli.rb:10:in `block in <top (required)>': undefined method `on' for main:Object (NoMethodError)
	from /Library/Ruby/Gems/2.0.0/gems/slop-4.0.0/lib/slop/options.rb:33:in `initialize'
	from /Library/Ruby/Gems/2.0.0/gems/slop-4.0.0/lib/slop.rb:24:in `new'
	from /Library/Ruby/Gems/2.0.0/gems/slop-4.0.0/lib/slop.rb:24:in `parse'
	from /Library/Ruby/Gems/2.0.0/gems/bwoken-2.0.0/lib/bwoken/cli.rb:9:in `<top (required)>'
	from /Library/Ruby/Site/2.0.0/rubygems/core_ext/kernel_require.rb:69:in `require'
	from /Library/Ruby/Site/2.0.0/rubygems/core_ext/kernel_require.rb:69:in `require'
	from /Library/Ruby/Gems/2.0.0/gems/bwoken-2.0.0/bin/bwoken:3:in `<top (required)>'
	from /usr/bin/bwoken:23:in `load'
	from /usr/bin/bwoken:23:in `<main>'

I am not root so I tried the sudo gem install bwoken && bwoken init method, could that be the problem?
Thanks and regards,
Sebastian Mecklenburg

I have the same issue... seems like it is due to slop v.4 ... keep fighting with it:)

HI  Guys,
Ny update on this ? even i am stuck with the same issue,

https://github.com/bendyworks/bwoken/issues/89 look at this issue - here is a solution:)


Swift 3 cocoapods release?

Hi @icanzilb,
Will 1.0.1 be pushed to cocoapods?
Thanks.

CocoaPods still doesn't officially support Swift 3

What exactly do you mean by that?

there's a problem when you try pushing a swift 3 pod to the pods trunk with the current release, I'm waiting for the PRs to fix this to merged towards the final 1.1.0

ok thanks.

Does SwiftSpinner support Swift 3 yet?

yes, if you pull from master

you can get the latest: https://github.com/icanzilb/SwiftSpinner/releases/tag/1.0.2

Thx
But Xcode still ask me to convert :(

Does the DemoApp from the SwiftSpinner GitHub repo work for you?

The Demo works. Didn't even as ask to convert

Everything started to work just now. I'm on latest beta cocoa pods

@TakanashiOuken then maybe have a look at your own project, maybe it still needs converting?

It's a clean Project I created for testing....
I will make another one to try

No good
If I install SwiftSpinner with pod "SwiftSpinner"
Xcode will ask me to convert it.
But seems like cocoapad installed 1.0.2 alright

maybe something like this? https://github.com/CocoaPods/CocoaPods/pull/5530

@icanzilb
You're right thanks so much


feat: swap-or-not shuffle

Please read contributing guidelines and remove this line.

[!WARNING]
This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

#7646  👈
#7635
master

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @LHerskind and the rest of your teammates on  Graphite

Benchmark results
Metrics with a significant change:

batch_insert_into_append_only_tree_32_depth_ms (256): 131 (-69%)
batch_insert_into_append_only_tree_32_depth_hash_ms (256): 0.451 (-69%)
batch_insert_into_indexed_tree_20_depth_ms (256): 182 (-53%)
batch_insert_into_indexed_tree_20_depth_hash_ms (256): 0.483 (-53%)
avm_simulation_time_ms (Token:constructor): 125 (+36%)
avm_simulation_time_ms (Token:mint_public): 266 (+340%)
avm_simulation_time_ms (FPC:pay_refund_with_shielded_rebate): 136 (+120%)
protocol_circuit_proving_time_in_ms (base-parity): 2,117 (+52%)
l2_block_processing_time_in_ms (4): 753 (-57%)

Detailed results
All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call  to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.
This benchmark source data is available in JSON format on S3 here.
Proof generation
Each column represents the number of threads used in proof generation.

Metric
1 threads
4 threads
16 threads
32 threads
64 threads

proof_construction_time_sha256_ms
5,714
1,552 (+1%)
701 (-1%)
755
772

proof_construction_time_sha256_30_ms
11,747
3,140
1,407
1,422 (-1%)
1,461

proof_construction_time_sha256_100_ms
43,762
11,962
5,411
5,423
5,329

proof_construction_time_poseidon_hash_ms
78.0
38.0 (+12%)
34.0
59.0 (+2%)
89.0 (+3%)

proof_construction_time_poseidon_hash_30_ms
1,519
419
203
225 (+2%)
272 (+1%)

proof_construction_time_poseidon_hash_100_ms
5,616
1,509
676 (-1%)
733 (+3%)
744 (-1%)

L2 block published to L1
Each column represents the number of txs on an L2 block published to L1.

Metric
4 txs
8 txs
16 txs

l1_rollup_calldata_size_in_bytes
708
708
708

l1_rollup_calldata_gas
6,600
6,586
6,588

l1_rollup_execution_gas
611,446 (+5%)
611,583 (+5%)
611,736 (+5%)

l2_block_processing_time_in_ms
:warning: 753 (-57%)
1,419 (+1%)
2,710 (-3%)

l2_block_building_time_in_ms
10,891
21,143
42,117 (-7%)

l2_block_rollup_simulation_time_in_ms
10,891
21,143
42,117 (-7%)

l2_block_public_tx_process_time_in_ms
9,087
19,162
40,042 (-7%)

L2 chain processing
Each column represents the number of blocks on the L2 chain where each block has 8 txs.

Metric
3 blocks
5 blocks

node_history_sync_time_in_ms
7,038
9,843

node_database_size_in_bytes
12,689,488
16,855,120

pxe_database_size_in_bytes
16,254
26,813

Circuits stats
Stats on running time and I/O sizes collected for every kernel circuit run across all benchmarks.

Function
time_ms
bytecode_size_in_bytes

GasToken:_increase_public_balance
101 (+3%)
13,790

GasToken:set_portal
13.1 (-9%)
3,339

Token:constructor
:warning: 125 (+36%)
23,692

FPC:constructor
93.0 (+3%)
13,592

GasToken:mint_public
82.4 (+3%)
10,158

Token:mint_public
:warning: 266 (+340%)
19,034

Token:assert_minter_and_mint
49.8 (-23%)
12,925

AuthRegistry:set_authorized
48.5 (+9%)
7,812

FPC:prepare_fee
256
11,068

Token:transfer_public
47.4 (-11%)
44,012

FPC:pay_refund
79.3 (+12%)
15,961

Benchmarking:increment_balance
1,064 (-3%)
11,281

Token:_increase_public_balance
59.7 (-27%)
15,006

FPC:pay_refund_with_shielded_rebate
:warning: 136 (+120%)
17,056

Public DB Access
Time to access various public DBs.

Function
time_ms

get-nullifier-index
0.154

Tree insertion stats
The duration to insert a fixed batch of leaves into each tree type.

Metric
1 leaves
16 leaves
64 leaves
128 leaves
256 leaves
512 leaves
1024 leaves

batch_insert_into_append_only_tree_16_depth_ms
10.3 (-3%)
16.7 (-2%)
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_count
16.8
31.7
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_16_depth_hash_ms
0.595 (-3%)
0.512 (-2%)
N/A
N/A
N/A
N/A
N/A

batch_insert_into_append_only_tree_32_depth_ms
N/A
N/A
47.8
75.6 (-3%)
:warning: 131 (-69%)
244
471

batch_insert_into_append_only_tree_32_depth_hash_count
N/A
N/A
95.9
159
287
543
1,055

batch_insert_into_append_only_tree_32_depth_hash_ms
N/A
N/A
0.489
0.465 (-3%)
:warning: 0.451 (-69%)
0.443
0.440

batch_insert_into_indexed_tree_20_depth_ms
N/A
N/A
59.1
111 (-1%)
:warning: 182 (-53%)
351
694

batch_insert_into_indexed_tree_20_depth_hash_count
N/A
N/A
109
207
355
691
1,363

batch_insert_into_indexed_tree_20_depth_hash_ms
N/A
N/A
0.500 (-1%)
0.497 (-1%)
:warning: 0.483 (-53%)
0.476
0.478

batch_insert_into_indexed_tree_40_depth_ms
N/A
N/A
72.7 (-2%)
N/A
N/A
N/A
N/A

batch_insert_into_indexed_tree_40_depth_hash_count
N/A
N/A
133
N/A
N/A
N/A
N/A

batch_insert_into_indexed_tree_40_depth_hash_ms
N/A
N/A
0.517 (-2%)
N/A
N/A
N/A
N/A

Miscellaneous
Transaction sizes based on how many contract classes are registered in the tx.

Metric
0 registered classes
1 registered classes

tx_size_in_bytes
72,017
666,910

Transaction size based on fee payment method
| Metric |  |
| - |  |


AttributeError: 'list' object has no attribute 'start'

[06:39:06:237] <redacted>: !cm
Exception in thread Thread-21:
Traceback (most recent call last):
  File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
    self.run()
  File "/usr/lib/python2.7/threading.py", line 754, in run
    self.__target(*self.__args, **self.__kwargs)
  File "/root/nortbot/tinychat.py", line 163, in connect
    self._listener()
  File "/root/nortbot/tinychat.py", line 212, in _listener
    self.dispatch(event, json_data)
  File "/root/nortbot/tinychat.py", line 223, in dispatch
    self._process_event(event, method, event_data)
  File "/root/nortbot/tinychat.py", line 216, in _process_event
    pe.process()
  File "/root/nortbot/_process_event.py", line 71, in process
    self._process_msg()
  File "/root/nortbot/_process_event.py", line 138, in _process_msg
    self._client.run_method(self._method, *(user, msg))
  File "/root/nortbot/tinychat.py", line 233, in run_method
    func(*args, **kwargs)
  File "/root/nortbot/bot.py", line 173, in on_msg
    ch.handle()
  File "/root/nortbot/handlers/command.py", line 59, in handle
    self._handle_command(cmd, cmd_arg)
  File "/root/nortbot/handlers/command.py", line 197, in _handle_command
    self.do_close_media()
  File "/root/nortbot/handlers/command.py", line 962, in do_close_media
    if self._playlist.has_active_track:
  File "/root/nortbot/util/tracklist.py", line 84, in has_active_track
    if self.elapsed == 0:
  File "/root/nortbot/util/tracklist.py", line 101, in elapsed
    elapsed = time.time() - self.current_track.start
AttributeError: 'list' object has no attribute 'start'

Can you give a bit more detail, like did a moderator close the video before this

Ah my bad, I just added the last command I saw in the log before the crash, didn't pay attention at the commands that were sent right before the !cm. Anyway, I think this can be gracefully handled independently from what were the previous commands, no? WDYT?

I am a little puzzled about this. current_track should not be a list, but rather a Track object. I need more info. Like what leads it to happen? what command's were used prior to it happening? debug log?

I haven't kept the log for this crash, will update with mor infos if I see it again.

Need help recreating this issue

Haven't seen it happen again.

Reckon we should close?

Yep, let's reopen if it re-happen and will make sure to come with more logs.

im experiencing this issues as well:
[07:28:28:975] T00MuchSalt: !yt https://youtu.be/6JBpr5Rqdtg
'list' object has no attribute 'start'
[07:28:30:891] Geek: !yt buyy
[07:28:31:105] Anicrow: !yt this is america
'list' object has no attribute 'start'
'list' object has no attribute 'start'

@imtammer can you go back through your logs for the couple of commands and paste them, ensuring to remove any info that may be sensitive to others.

i turned on logging as well in config, restart bot, and voila it began to work...will keep you posted if it crops up again.

This is probably fixed in https://github.com/nortxort/nortbot/commit/4362a9934fd02d04fa1d0da48089c2ecea9612bb

Does not seem to be a problem. Comment if this needs reopened.


SQL Blog

Hi -
Hasib from Sydney, a Data Architect with Deloitte. When I design a solution for client, I read lots and lots of blog to ensure my ideas are refreshed with what's new out there. I came across this post of your blog today - https://www.rakirahman.me/sql-replication-to-azure/.
Of all the blogs I visited and I visited a lot, yours is by far the best in terms of presenting the technical content. Very good. Also, you are very unique in the way you presented some diagram. A question about the above blog,
In my current use-case, I need to have 10 tables (Azure SQL MI) synced with 10 source tables hosted on-prem (SQL Server 2016). It seemed replication is (Option 3 on your blog) is the best and easiest option, but it's in preview - https://docs.microsoft.com/en-us/azure/azure-sql/managed-instance/replication-transactional-overview
Other options looked bit complex for my use cases (only few tables replication) ..ADF doesn't seem like easier option either. Your thoughts?

Hi @iamhasib,
Thank you for your note, and for the kind comments.
Note that even though "Transactional Replication" is listed as "Preview" for SQL MI - the way I like to think about this is more from a Support Lifecycle Perspective, rather than a Feature Parity perspective. What I mean by that, is the SQL MI Engine (which runs SQL Server Executables - just managed), it supports Transaction Replication the same way SQL Server does. And Transaction Replication is a very mature capability baked into the SQL Server Engine.
For your use case, it may be that Trx Replication will be the easiest way to implement sync from a SQL Server 2016.
ADF will "work" (the same way SSIS will - it's just ETL) - but the challenge will become in how you build your ETL pipelines, this will involve identifying Watermak column and incremental sync around that.
As an alternative to building these ETL pipelines out, you might even consider a CDC Engine like Debezium that supports SQL Server as a Source, then use Event Hub (i.e. Kafka) to store the CDC logs - which you can persist to SQL MI as well.
Transaction Replication is easier than both methods above since the Agents take care of the complexities for you.

Salaam Raki (Bhai) -
Firstly, a quick question about something different. I checked some other post on your blog site. Did you draw your diagram and artwork that you published on your page? Which tool you used to draw those diagrams, specially those with code snippet.
Now about your solution. I comment on the last one first. Event driven one. I would love to do that but wouldn't you agree that would be a massive project. I ran CDC project and they are complex. However you simplify it, CDC is always complicated.
As of Replication based, even cost wise, it's cheaper (than ADF). I saw a video about ADF pricing, man...this is major ....Back to replication, I am not sure if I fully understood as to what you were saying on Preview. Does feature in preview means it's not available in AU region?
I look forward to hearing from you soon.


Request for Documentation / Clarifying How to Best Use the Tool

Hi all,
This is a very cool project, and I think many of us looking at Guetzli are interested and excited by its promise of better compression and higher-quality images.
I have some notes on what I found confusing as a new user. Answering these questions would help users make better use of the tool, with better outcomes. (Obviously just answering these questions here would help me personally, but it would be great if they would make it into some official documentation. Nonetheless, informally discussing it here is probably an okay first step toward identifying what should be documented.)
My main questions are:

What does Guetzli do on the default setting? i.e. no flags on.

Does it read the Quality number used on the original image, like GIMP does when exporting as JPG?
(answered: it defaults to Quality 95: https://github.com/google/guetzli/issues/76#issuecomment-287605815)
The file is compressed by some amount for a given --quality setting. Is Guetzli attempting to output a file that is of equivalent quality (extremely low difference as per Butteraugli) yet as much smaller as possible given that constraint?
(Answered in code comments: Quality for a given Q (84-110) in Guetzli is determined by attempting hit a target Butteraugli score, which is set to match the Butteraugli score that libjpeg-turbo achieved with the same given Q number (0-100), averaged over a set of test PNGs: guetzli/quality.cc#L31)

Just for curiosity's sake, how much difference of Butteraugli score is it willing to tolerate compared to its target for the specified Q

Is it loose, accepting a wide margin above/below the target Butteraugli score, in order to provide output at a very low filesize? Or is it conservative, and only willing to compress to a smaller size if the visual difference (actual Butteraugli score compared to the target score) will be negligible?
 How can we play into this compression strategy and help it succeed?

Do's and Don'ts guide to compression with Guetzli?
How should my photos be handled or converted before using Guetzli, for best results?

Is it bad to run the program with no flags and expect miracles?

(A rhetorical question... But this would be a good thing for myself and probably most lay-person users to know. How should we approach getting good compression and respectable image quality out of Guetzli? What are the limits of running without flags? How to dip our toes into the Q settings? Are other tools better for novices such as myself?)
Is there a good guideline for what the --quality Q value should be?
With respect to the often-touted 20-30% file-size reduction figure, how should we achieve that? At what quality value should we be outputting to see that reduction?

Thank you for your consideration.

Here are my 2 cents ...

 How can we play into this compression strategy and help it succeed?

Guetzli uses feedback from butteraugli to decide what data to throw away.Read Guetzli paper for more info

How should my photos be handled or converted before using Guetzli, for best results?

Note that Guetzli is designed to work on high quality images. You should always prefer providing uncompressed input images (e.g. that haven't been already compressed with any JPEG encoders, including Guetzli). While it will work on other images too, results will be poorer.
For best result the input images should be in a lossless format such as PNG

Is it bad to run the program with no flags and expect miracles?

Use it on the PNG with no flag and it will work fine if you have the resources(i.e enough RAM and CPU on your server)
Note: Guetzli uses a large amount of memory. You should provide 300MB of memory per 1MPix of the input image.
Note: Guetzli uses a significant amount of CPU time. You should count on using about 1 minute of CPU per 1 MPix of input image.

Is there a good guideline for what the --quality Q value should be?
With respect to the often-touted 20-30% file-size reduction figure, how should we achieve that? At what quality value should we be outputting to see that reduction?

The default quality (95) would give you perfect images and will give you the file-size reduction you want.The quality flag can be used to get smaller filesize at the cost of quality

That's pretty good, thank you.
On the point of:

Are there better tools for novices such as myself

Mozjpeg is probably the best go-to encoder (for web assets) for absolute beginners. It is fast, and produces decent images. Filesizes can even be smaller than Guetzli, because Q below 84 is allowed. You can do lots of trial and error and learn the ropes. I basically spent a day learning the jpeg compression workflow and I found Mozjpeg made it convenient to learn these things. I produced ~100 encodes in my image set at different Q, and I'm not sure I could have even begun to approach that number of encodes, given the runtime Guetzli has right now.
Until Guetzli is optimized, Guetzli is for a fairly specialized use-case. (high-resource usage, only allows very-high-quality settings). I think it kind of implicitly assumes you know what you're doing already, and that opting for Guetzli is an informed choice.
Now that I'm familiar with the workflow, I am in a better position to understand if Guetzli is better than Mozjpeg, so honestly it's a win-win in a way.
(Not saying Guetzli has to evangelize for Mozilla in their README.md! Just making a note of my experiences here. Devs can make/not make whatever documentation they want to.)

@DeeDeeG
I would recommend using ImageMagick or GraphicsMagick. Under the hood they both use libjpeg but you can compile it to use libjpeg-turbo.You should be able to generate JPEG also at any quality you want + do all kinds of image manipulations.Allowing quality less than 84 would defeat the purpose of this encoder as it aim is to provide JPEG of good quality at best file size.

I found out some things that could help guide users.
Regarding PNG vs JPEG:
If your input is a PNG, in some cases it is best to keep it a PNG. This is especially true for images with large areas of the exact same color.
If a typical fast JPEG encoder (such as the one built into GIMP or built into ImageMagick or Photoshop...) exports a JPEG larger than your source PNG, regardless of settings, then Guetzli can't help.
Regarding ways to handle your input images before using Guetzli:
Start with a high quality, unprocessed JPEG or PNG (ideally straight from the camera or straight from the software that initially produced it, and not compressed or re-compressed), when possible.
But feeding this directly into Guetzli will often produce large files! There are ways to reduce the output filesize without throwing away noticable quality.
Often the easiest way is to pick a lower Quality setting in Guetzli. Anywhere in the allowed range may produce a good result (85 - 95 usually are best, higher and lower quality settings are RARELY needed).
But that's not the only way!
Other ways to reduce output filesize is to scale down or crop down your input image. You will be able to tell if the resulting image is too small or too cropped down. Reducing the number of pixels in your output image reduces the size. If you're happy with your image the way it is, and don't want to change how it's framed, try scaling down somewhat.
Another option, especially for very high resolution images, is gaussian blur, or selective gaussian blur. Gaussian blur with a radius of 1px will reduce image complexity, and give a softer look. Do  scale down for lots of filesize savings, and not much noticeable difference in quality.
Selective Gaussian blur preserves contrasty parts of the image, while blurring and reducing complexity of less-contrasty areas. If your image is a hogh-resolution image from a digital camera, and it has noise tat doesn't add clarity to the scene, selective gaussian blur will get rid of some of the noise while preserving edges and major details. This reduced complexity is also easier to compress. The biggest downside of this is that too wide a blur radius can over-smooth and blur out your picture. I keep it at around 2px radius and 11 or so max diference (GIMP).
Selective gaussian blur artificially bumps up contrast in your image. If your image was washed out or normal/accurate to begin with, this artificially boosted contrast may look BETTER to they eye. If it's already over-contrasted, it will probably make the image look worse. In any case, be aware that contrast goes up when using selective gaussian blur.
For super high resolution camera photos, I highly recommend some form of Gaussian blur then scaling down in order to subtly reduce complexity, and get rid of some pixels, all the while keeping your image looking nice. You can then pick the correct quality setting for Guetzli (trial and error? Do 85, 90, and 95 to start, or just 85 and 95, as upper and lower bounds, then see if the filesizes and visible quality are acceptable and work from there.)
(Tip: other encoders allow chroma subsampling. This encodes lower resolution data for color than for brightness. It saves a lot of bits, but changes colors at edges and at severe transitions ftom one color to another neighboring color. I recommend this only for extremely high resolution images, where the effects will be much less noticeable, or where color accuracy isn't important, and only when filesize matters big-time. It can be effective with the aforementioned super-high resolution camera photos at full-size, though.)
Every image may need a tailored approach, but this is what I learned when working on a particular image I needed at three sizes. There are other, sometimes sheaky ways to save filesize, so try some things if you're adventurous, and see what works.

Great question and answers @DeeDeeG. In your last comment you mentioned about cropping images before passing to guetzli. I'm interested to know how to do this correcting for JPEGs using Python. Because whatever tool I use (skimage, cv2 etc), they change the quality of the image on save? Do you recommend saving the cropped image(s) from those tools with quality=100 and then pass that to guetzli? Which library do you recommend for cropping?

@Nithanaroy Hmm... I cropped/scaled manually with GIMP. (I am not much of a programmer myself, so I can't help much with Python specifically.)
I searched this in google: lossless crop python jpeg and the Python Imaging Library (PIL) is mentioned here, and supposedly can do a lossless crop. https://stackoverflow.com/questions/2933084/is-cropping-of-jpeg-images-using-the-pil-lossless (There is a currently maintained fork of PIL known as Pillow, apparently.)
You might also consider jpegtran which I believe is in c, but is probably the tool most focused on lossless operations of anything to do with jpeg. https://unix.stackexchange.com/questions/273097/jpegtran-losslessly-crop-left-portion-of-image https://en.wikipedia.org/wiki/Libjpeg#jpegtran
I think ImageMagick also tries to crop losslessly... https://en.wikipedia.org/wiki/ImageMagick#Other

That said, in general if you don't trust your tools to save losslessly, and you want to do lossless operations, I think working with PNG (or at least exporting/saving only as PNG) for lossless steps is the safest bet. Saving as PNG, in and of itself, should always be visually lossless. Any JPEG encode, you need to read up on your tool and confirm it is lossless from its documentation, I suppose.
Likewise, if you work in a non-destructive GUI editor (i.e. doesn't mess with your source file on disk unless you re-export there) like Photoshop or GIMP, you can modify the data multiple times, and export only once at the end in the desired quality. And you can always save as PNG (lossless) from these editors. That's what I did.
I believe encoding/saving JPEGS with q100 is generally NOT done losslessly. As this StackOverflow answer says, q100 and lossless are two different things. https://stackoverflow.com/questions/7982409/is-jpeg-lossless-when-quality-is-set-to-100

A simple request.
Guetzli works great when I run it from cmd. For some reason, I can’t make it work when I use createprocess. It always returns 1. I can call mozjpeg using createprocess. My request is simple. If there’s something wrong with how you call guetzli.exe, then different return codes should be used.
Thank you for creating this great tool,
Fredrik Wahlgren

I found the solution to my problem. If you use CreateProcess, if the cmd string starts with a space character then it works. I used a debug build version, maybe the behavior is different when you build a release version.

BTW. I have used JPEGmini which works well. It does have a nice feature which would be neat. It creates a comment so that it won’t process the same file more than once.


Have report fail build instead of committing reports to repo

It would be more useful for the action to dump the error report to the the console and if there are errors to fail the action. Commiting the reports to the repo is less helpful since it won't fail the action and is inconsistent with other CI workflows.

Hi, @DomAmato thanks for submitting the issue. New release 1.1.1 fixed this :)

@all-contributors please add @DomAmato  for infrastructure

@all-contributors please add @DomAmato for infrastructure