Add the support for the sparklens in spark-3.0.0 and later version of spark with scala-2.12

In spark 3.0.0 there are lots of changes done by the community , so creating this improvement PR to make the sparklens work with spark 3.0.0 / new version of spark and scala-2.12.
I have made code change  and also tested the same .please find the output
./bin/spark-shell --jars file:///tmp//src/opensrc/sparklens/target/scala-2.12/sparklens_2.12-0.4.0.jar --conf spark.extraListeners=com.qubole.sparklens.QuboleJobListener --conf  spark.eventLog.enabled=true

Printing application meterics. These metrics are collected at task-level granularity and aggregated across the app (all tasks, stages, and jobs).

 AggregateMetrics (Application Metrics) total measurements 20
                NAME                        SUM                MIN           MAX                MEAN
 diskBytesSpilled                            0.0 KB         0.0 KB         0.0 KB              0.0 KB
 executorRuntime                           344.0 ms         3.0 ms        30.0 ms             17.0 ms
 inputBytesRead                              0.0 KB         0.0 KB         0.0 KB              0.0 KB
 jvmGCTime                                   1.3 ss         0.0 ms       130.0 ms             65.0 ms
 memoryBytesSpilled                          0.0 KB         0.0 KB         0.0 KB              0.0 KB
 outputBytesWritten                          0.0 KB         0.0 KB         0.0 KB              0.0 KB
 peakExecutionMemory                         0.0 KB         0.0 KB         0.0 KB              0.0 KB
 resultSize                                 17.5 KB         0.9 KB         0.9 KB              0.9 KB
 shuffleReadBytesRead                        0.0 KB         0.0 KB         0.0 KB              0.0 KB
 shuffleReadFetchWaitTime                    0.0 ms         0.0 ms         0.0 ms              0.0 ms
 shuffleReadLocalBlocks                           0              0              0                   0
 shuffleReadRecordsRead                           0              0              0                   0
 shuffleReadRemoteBlocks                          0              0              0                   0
 shuffleWriteBytesWritten                    0.0 KB         0.0 KB         0.0 KB              0.0 KB
 shuffleWriteRecordsWritten                       0              0              0                   0
 shuffleWriteTime                            0.0 ms         0.0 ms         0.0 ms              0.0 ms
 taskDuration                                4.3 ss        10.0 ms       441.0 ms            215.0 ms

Total Hosts 1, and the maximum concurrent hosts = 1

Host <IP_ADDRESS> startTime 09:32:50:262 executors count 1
Done printing host timeline
======================

Printing executors timeline....

Total Executors 1, and maximum concurrent executors = 1
At 09:32 executors added 1 & removed  0 currently available 1

Done printing executors timeline...
============================

Printing Application timeline

09:32:49:492 app started
09:32:57:059 JOB 0 started : duration 00m 00s
[      0                                      |||||||||||||||||||||||||||||||||||||||||| ]
09:32:57:448      Stage 0 started : duration 00m 00s
09:32:57:889      Stage 0 ended : maxTaskTime 30 taskCount 10
09:32:57:899 JOB 0 ended
09:33:01:125 JOB 1 started : duration 00m 00s
[      1        |||||||||||||||||                                                        ]
09:33:01:132      Stage 1 started : duration 00m 00s
09:33:01:149      Stage 1 ended : maxTaskTime 6 taskCount 10
09:33:01:150 JOB 1 ended
09:33:03:044 app ended

Checking for job overlap...

 JobGroup 1  SQLExecID (-1)
 Number of Jobs 1  JobIDs(0)
 Timing [09:32:57:059 - 09:32:57:899]
 Duration  00m 00s

 JOB 0 Start 09:32:57:059  End 09:32:57:899

 JobGroup 2  SQLExecID (-1)
 Number of Jobs 1  JobIDs(1)
 Timing [09:33:01:125 - 09:33:01:150]
 Duration  00m 00s

 JOB 1 Start 09:33:01:125  End 09:33:01:150

No overlapping jobgroups found. Good

 Time spent in Driver vs Executors
 Driver WallClock Time    00m 12s   93.62%
 Executor WallClock Time  00m 00s   6.38%
 Total WallClock Time     00m 13s

Minimum possible time for the app based on the critical path (with infinite resources)   00m 12s
Minimum possible time for the app with same executors, perfect parallelism and zero skew 00m 12s
If we were to run this app with single executor and single core                          00h 00m

 Total cores available to the app 16

 OneCoreComputeHours: Measure of total compute power available from cluster. One core in the executor, running
                      for one hour, counts as one OneCoreComputeHour. Executors with 4 cores, will have 4 times
                      the OneCoreComputeHours compared to one with just one core. Similarly, one core executor
                      running for 4 hours will OnCoreComputeHours equal to 4 core executor running for 1 hour.

 Driver Utilization (Cluster idle because of driver)

 Total OneCoreComputeHours available                             00h 03m
 Total OneCoreComputeHours available (AutoScale Aware)           00h 03m
 OneCoreComputeHours wasted by driver                            00h 03m

 AutoScale Aware: Most of the calculations by this tool will assume that all executors are available throughout
                  the runtime of the application. The number above is printed to show possible caution to be
                  taken in interpreting the efficiency metrics.

 Cluster Utilization (Executors idle because of lack of tasks or skew)

 Executor OneCoreComputeHours available                  00h 00m
 Executor OneCoreComputeHours used                       00h 00m        2.49%
 OneCoreComputeHours wasted                              00h 00m        97.51%

 App Level Wastage Metrics (Driver + Executor)

 OneCoreComputeHours wasted Driver               93.62%
 OneCoreComputeHours wasted Executor             6.22%
 OneCoreComputeHours wasted Total                99.84%

 App completion time and cluster utilization estimates with different executor counts

 Real App Duration 00m 13s
 Model Estimation  00m 12s
 Model Error       6%

 NOTE: 1) Model error could be large when auto-scaling is enabled.
       2) Model doesn't handles multiple jobs run via thread-pool. For better insights into
          application scalability, please try such jobs one by one without thread-pool.

 Executor count     1  (100%) estimated time 00m 12s and estimated cluster utilization 0.17%
 Executor count     1  (110%) estimated time 00m 12s and estimated cluster utilization 0.17%
 Executor count     1  (120%) estimated time 00m 12s and estimated cluster utilization 0.17%
 Executor count     1  (150%) estimated time 00m 12s and estimated cluster utilization 0.17%
 Executor count     2  (200%) estimated time 00m 12s and estimated cluster utilization 0.08%
 Executor count     3  (300%) estimated time 00m 12s and estimated cluster utilization 0.06%
 Executor count     4  (400%) estimated time 00m 12s and estimated cluster utilization 0.04%
 Executor count     5  (500%) estimated time 00m 12s and estimated cluster utilization 0.03%

Total tasks in all stages 20
Per Stage  Utilization
Stage-ID   Wall    Task      Task     IO%    Input     Output    ----Shuffle-----    -WallClockTime-    --OneCoreComputeHours---   MaxTaskMem
          Clock%  Runtime%   Count                               Input  |  Output    Measured | Ideal   Available| Used%|Wasted%
       0   96.00   84.30        10    NaN    0.0 KB    0.0 KB    0.0 KB    0.0 KB    00m 00s   00m 00s    00h 00m    4.1   95.9    0.0 KB
       1    3.00   15.70        10    NaN    0.0 KB    0.0 KB    0.0 KB    0.0 KB    00m 00s   00m 00s    00h 00m   19.9   80.1    0.0 KB
Max memory which an executor could have taken =   0.0 KB

 Stage-ID WallClock  OneCore       Task   PRatio    -----Task------   OIRatio  |* ShuffleWrite% ReadFetch%   GC%  *|
          Stage%     ComputeHours  Count            Skew   StageSkew
      0   96.29         00h 00m      10    0.63     1.03     0.07     0.00     |*   0.00           0.00   448.28  *|
      1    3.71         00h 00m      10    0.63     1.00     0.35     0.00     |*   0.00           0.00     0.00  *|

PRatio:        Number of tasks in stage divided by number of cores. Represents degree of
               parallelism in the stage
TaskSkew:      Duration of largest task in stage divided by duration of median task.
               Represents degree of skew in the stage
TaskStageSkew: Duration of largest task in stage divided by total duration of the stage.
               Represents the impact of the largest task on stage time.
OIRatio:       Output to input ration. Total output of the stage (results + shuffle write)
               divided by total input (input data + shuffle read)

These metrics below represent distribution of time within the stage

ShuffleWrite:  Amount of time spent in shuffle writes across all tasks in the given
               stage as a percentage
ReadFetch:     Amount of time spent in shuffle read across all tasks in the given
               stage as a percentage
GC:            Amount of time spent in GC across all tasks in the given stage as a
               percentage

If the stage contributes large percentage to overall application time, we could look into
these metrics to check which part (Shuffle write, read fetch or GC is responsible)```

cc @itskals @iamrohit @mayurdb

How you did sbt compile !!?
I am facing this error on compilation,
sbt.ResolveException: unresolved dependency: org.spark-packages#sbt-spark-package;0.2.4: not found

How you did sbt compile !!?
I am facing this error on compilation,
sbt.ResolveException: unresolved dependency: org.spark-packages#sbt-spark-package;0.2.4: not found
update resolver at path to https://repos.spark-packages.org/

@SaurabhChawla100 Should we have a separate branch for Spark 3.0 instead?
I have created a new branch for Spark 3.0. If you think its better to have a separate branch please raise this against - https://github.com/qubole/sparklens/tree/SPARK30

@SaurabhChawla100 Should we have a separate branch for Spark 3.0 instead?
I have created a new branch for Spark 3.0. If you think its better to have a separate branch please raise this against - https://github.com/qubole/sparklens/tree/SPARK30

@mayurdb - I have changed the merge branch to SPARK30

How did you run the sbt compile. I have updated the resolver URL to the one mentioned above. I still am getting unresolved dependency error
sbt.ResolveException: unresolved dependency: com.eed3si9n#sbt-assembly;0.12.0: not found [error] unresolved dependency: org.spark-packages#sbt-spark-package;0.2.4: not found
my project/plugin.sbt is
`addSbtPlugin("com.eed3si9n" % "sbt-assembly" % "0.12.0")
resolvers += "Spark Package Main Repo" at "https://repos.spark-packages.org/"
addSbtPlugin("org.spark-packages" % "sbt-spark-package" % "0.2.4")`

Any update on this? This would be great to have


[share] plugin - Add ability to share image/files

Use case
When sharing items from the app, most of the time its necessary to also share and image or a file, not just text.
Proposal
Add the ability to share images or files along with text.

Duplicate of https://github.com/flutter/flutter/issues/19607 https://github.com/flutter/flutter/issues/36894 https://github.com/flutter/flutter/issues/16712 https://github.com/flutter/flutter/issues/9817
Fixed by https://github.com/flutter/plugins/pull/970

@Zazo032 I hope it gets merged. I did not see if you can share both text and image together, it looks like it's either share text or share image separately? Can you clarify?
Thanks


Question: Does WSL provide decent entropy? (e.g. for generating ssh keys)

While recognizing the complexities inherent in this topic, I wanted to know if we could get some guidance on what to expect from the entropy sources / random number generators in WSL (/dev/random, /dev/urandom, and the getentropy/getrandom sys calls). Is it mixing in user-generated entropy from the environment? Using hardware-assisted RNG from a CPU (when available)? Or instead, is it doing something boneheaded like seeding the entropy pool with the current time or PID? Or worse, a hard-coded seed?
An example use case would be generating ssh keys. I would like to know whether or not I can expect the randomness used to generate the keys as "good enough" for every day usage. ie No state-level actors or APT malware.
Currently there is no /proc/sys/kernel/random/entropy_avail to check for entropy, but I see in #1092 that a fix is inbound for some parts of /proc/sys/kernel/random, so maybe that will include a working implementation of entropy_avail.
Any implementation details that could be shared would be appreciated too. Thanks!

@evancox10 /dev/random does not use entropy_avail in userspace.  The kernel blocks when entropy_avail is zero, not the userspace.  Pretty sure that /dev/random sits on top of the NT Kernel's version of /dev/random.

@evancox10 - Great question. We use the BCryptGenRandom API in our driver to generate random bytes for the gerandom syscall as well as /dev/random and /dev/urandom.

Thanks @benhillis, that answers my question!


Update readme.md

Leading ? is not generated and confuses users

It is. Go to https://github.com/sindresorhus/query-string/pull/45/files?w=1 and in the console:
location.search
"?w=1"


[BUG] Game freezes on window launch, nouveau

log.txt
Dell, old i5.
OS:
Linux itg 5.10.11-zen2-1-zen #1 ZEN SMP PREEMPT Wed, 27 Jan 2021 23:13:33 +0000 x86_64 GNU/Linux
CPU:
Model name:                      Intel(R) Core(TM) i5 CPU         660  @ 3.33GHz
GPU: 01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Caicos XT [Radeon HD 7470/8470 / R5 235/310 OEM]
f86-video-nouveau 1.0.17-1
Storage: 120gb ssd
StepManiaOutFox-5.3.0-alpha-4.9.7-amd64-date-20210220
StepMania Version: StepManiaOutFox-5.3.0-alpha-4.9.7-amd64-date-20210220
Theme: Default
Describe the problem
Game launches rendering window to black screen and locks.
Describe what should happen
Game should launch.
Logs and Additional context
See attached.
Other:
Default user directory, no .stepmania5.3 created.
Issue persists on both legacy and default.
Overriding VideoRenderers=opengl in Preferences.ini does fix this issue. Perhaps the default renderer for this era of card needs to be opengl,glad or perhaps it's a more widespread nouveau issue.
Previous beta runs no issues.
log.txt

where are the logs chap?

Attached, I was writing the ticket while moving over the files.

Fixed by forcing HighResolutionTexures=Auto rather than the default ForceOn


HHH-18945 Hibernate Processor - fails if entity extends mapped superclass with same simple class name

Jira issue HHH-18945
Simplified solution is to revert change in HHH-18693 so that superclass is always fully quylified when extended in meta model class.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license
and can be relicensed under the terms of the LGPL v2.1 license in the future at the maintainers' discretion.
For more information on licensing, please check here.

BTW, should I squash those commits or leave that as is?

Squash please

Squash please

Done!

Thank you sir!


Diacritics followed by spaces breaks highlighting.

If I replace the é in Opportunité de vente by a regular e syntax highlighting works again. The word Opportunité alone doesn't break the highlighting.
I'm using the latest version 2.32.2

I have no problem. Are you are sure you are using my grammar Babel ES6 JavaScript showing on bottom right statius bar?

Yes, 100% sure.

Can you let me have your source code for this file, or a section that still shows the issue?

https://gist.github.com/wiredmax/f9326ca54c8ecaffe84077a47ed3d64c

No that file works fine for me! See below.

What theme are you using? What packages have you loaded?

I'm using OneDark, but I have the issue with the default theme also. I've tried on a "vanilla" atom with all the plugin disabled (except the core ones) and I still got the issue. Next step I intend to try on another computer at home later today with a clean installation of Atom.

OK thanks. Below is One Dark with your gist, atom 1.9.8 and language-babel 2.32.2

Maybe you could determine the scope active for the de word in the string by positioning the cursor between the d and e and pressing cmd-alt-P or ctrl-alt-P  This may give a clue as to what package, if any, is changing the scope of the string.

Closing this issue. Add additional information if you wish to re-open.


ytarchive doesn't start muxing after it finishes downloading

I set up ytarchive to monitor a channel for live streams, and every time a stream, let it be public or members only ends, the download stops presumably because it finished downloading, but fails to start the muxing process.
I enabled debug to see what's going on, and the only message it spams indefinitely is
DEBUG: video1: Error with fragment 11634: unexpected EOF
DEBUG: audio1: Error with fragment 11634: unexpected EOF
Video Fragments: 11634; Audio Fragments: 11634; Max Fragments: 11633; Max Sequence: 11633; Total Downloaded: 3.92GiB

Canceling and merging manually works just fine, and the final video is complete as well.
In case it's useful, I'm running ytarchive --retry-frags 0 --vp9 -t --lookalike-chars -o OUTPUT_DIR --cookies PATH_TO_COOKIES --monitor-channel CHANNEL_URL best on a raspberrypi 4 with 64bit raspbian installed

Anyone know how to fix this or what might be causing it? I have also tried setting --retry-frags to a value other than 0, in case that's what's breaking it, but nothing


help me!!!

There is noting in the .srt file. Anything else is ok.

应该是网络问题，建议更换代理或者使用服务器

好的
---Original---
From<EMAIL_ADDRESS>Date: Mon, Apr 29, 2019 14:31 PM
To<EMAIL_ADDRESS>Cc: "Crisfw"youqi55<EMAIL_ADDRESS>Subject: Re: [agermanidis/autosub] help me!!! (#147)
应该是网络问题，建议更换代理或者使用服务器
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or mute the thread.


Method 'jsonLoads' wanted

Standard JSON libraries usually support beneath a 'load' function also a 'loads' function - to enable users to read content directly from strings.
In my opinion this would be a nice and useful extension also for the JsonPreprocessor.
sJSON = "{testdict.subKey_1} : \"A\""
dictReturned = json_preprocessor.jsonLoads(sJSON)

I already see a certain use case for us. A 'jsonLoads' function would enable us to autogenerate JSON test code on the fly within a Python script and pass this code to the JsonPreperocessor without the need to store every test code separately in a file on hard disc - that would be rather long winded in this case.

Hi Son,
Holger requested this feature.
It will help him to generate tests by means of  strings.
Thank you,
Thomas

Hi Son, hi Thomas,
in the meantime I implemented to write autogenerated JSON code to a temporary file and I let the JsonPreprocessor read from this file. I can life with that. A jsonLoads method is still a useful feature - also for customers, but from my point of view this issue is not urgent any more.

Hello Holger, Hello Thomas,
I created the commit 862548e6653 to add jsonLoads method.
The jsonLoads method is now available on stabi branch.
Thank you,
Son

Hi Son,
In case of JsonPreprocessor reads invalid JSON code from file, this is the error message:
'Expecting ',' delimiter: line 4 column 4 (char 76)
Nearby: '... subKey2}" : 1,\n   "testdict2" : "${testdict1}"\n   "${testdict1.subKey1 ...'
In file: 'D:/ROBFW/Dev/GenSnippetsJPP/tmp_files/JPPSnippetFile.jsonp''

In case of JsonPreprocessor reads the same invalid JSON code from string, this is the error message:
'Expecting ',' delimiter: line 4 column 4 (char 76)'
For sure, a file information cannot be available in this case, but it should be possible to provide the 'Nearby:' information.
The 'Nearby:' information is missing because it depends on 'jFile':
if jFile != '':
    failedJsonDoc = self.__getFailedJsonDoc(error)

Please add 'self.__getFailedJsonDoc(error)' also to all relevant positions where JSON code is loaded from string.

Hi Son,
you moved a lot of code from 'jsonLoad' to new 'jsonLoads'. Maybe this is OK, but the impact is that 'jsonLoads' - that only has to read JSON content from a string immediately - contains input parameter like 'jFile' and 'masterFile'. And this is really not nice. It looks like 'jsonLoads' is a mixture of stand-alone method and a helper for 'jsonLoad'.
For what kind of purpose does 'jsonLoads' require input parameter like 'jFile' and 'masterFile'? What is the use case?
'jsonLoad' does a path normalization of 'jFile'. At end the normalized 'jFile' is handed over to 'jsonLoads'. This means, 'jsonLoads' only works with the normalized path in case of this method is called by 'jsonLoad' internally. But what shall happen in case of a developer uses 'jFile' for 'jsonLoads'?
In my opinion this is a very unfavorable software design. Please try to realize a better separation here.
In case you add a new functionality, you also have to update the package version and date, and also the history. Additionally you have to rebuild and check in the PDF documentation. This is missing.
CRQ:
The question is: What happens if the JSON string contains an import based on a relative path?
sJSON = """{
   "A" : 1,
   "[import]" : "../imported.jsonp"
}"""

dictValues = oJsonPreprocessor.jsonLoads(sJSON)
This works fine! The reference for the relative path is the folder in which the executed Python script is placed. Also this is OK.
But for testing purposes there might be the need to redirect the reference path, to be able to refer to a certain folder with imported JSON files - a folder that is located at a complete different place than the currently executed test script. Therefore 'jsonLoads' should have the possibility to define an optional root path as reference for all relative file imports within the JSON string.
Something like:
dictValues = oJsonPreprocessor.jsonLoads(sJSON, reference_path="d:/my_configuration_folder/suite_1")

Hello Holger,
Thank you for your review comments! For the jFile and masterFile parameters in jsonLoads method, I will find a solution to move them out of jsonLoads method.
Regarding What happens if the JSON string contains an import based on a relative path?:
- In my opinion, we can block a relative path when users want to load JSONP by content (means using jsonLoads method)
- Or we can implement the solution which you suggested above.
Thank you,
Son

Hi Son,
imports are a really good feature in JsonPreprocessor. I see no reason for blocking imports if JSON code is loaded from string. I would prefer to have this possibility implemented (together with reference_path).

Hello Holger,
I updated this feature based on your review comments, the change is pushed to stabi branch via commits b01d9b5b1140 and b91836e78428
Could you please help me verify and give your feedback if any?
Thank you,
Son

Hi Son,
the interface descriptions of jsonLoad and jsonLoads are outdated or rather incomplete. Please update.

Hi Son,
please consider also:
https://github.com/test-fullautomation/python-jsonpreprocessor/issues/316

Hi Son,
feature works like expected now! After adaption of interface description issue can be closed.

Hello Holger,
I updated the interface descriptions and some minor points based your review comments on stabi branch.
Thank you,
Son

Hi Son,
the parameters 'referenceDir', 'firstLevel' and 'masterFile' are not required. They are optional.
Please correct the interface description.

Hi Son,
the parameters 'referenceDir', 'firstLevel' and 'masterFile' are not required. They are optional.
Please correct the interface description.

Hello Holger,
Thank you for your comment, I updated the interface description of jsonLoad and jsonLoads.
Thank you,
Son

Ready for sprint 0.13.0 [09.08.24](jsonpreprocessor / tsm)


Support for Mousedetectors connected in Verisure systems

Together with https://github.com/balloob/home-assistant-polymer/pull/28


Broken Promise rejection

I'm having an issue after upgrading to Dexie 1.4.0:
MyDB.where('id')
    .equals('does-not-exist')
    .first()
    .then(result => {
      if (result !== null && result !== undefined) {
        return result;
      } else {
        return Promise.reject(result)
      }
    })
    .catch(_ => null);

The catch block is never running, despite returning a rejected promise in the handler above.
This worked in 1.3.6.

Thanks for reporting. Will try to look into it asap

It seems that it does work if I throw Promise.reject(result), but that's not consistent with behaviour of native promises

Issue was that rejecting with undefined triggered the bug. v1.4.1 out in a few minutes.

Yep, 1.4.1 works. Thanks!


chore: rm unused clap feature

not used in cli args, if this is necessary this functionality can be restored via custom valueparser

need to fix value parser


python310Packages.lupupy: 0.2.8 -> 0.3.0

Changelog: https://github.com/majuss/lupupy/releases/tag/v0.3.0
Description of changes

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 217301 run on x86_64-linux 1

2 packages built:

python310Packages.lupupy
python311Packages.lupupy


ImageBuffer: prevent additional copy converting from RGBA to RGB

np.astype will perform a full copy of the array, which is very slow for large images (was taking 30ms for a 1920x1080 image). Our application requires grabbing these images in realtime, and this was taking significant portion of the time. You can avoid this copy if the array is contiguous. However, if the texture buffer is RGBA, the array won't be contiguous, so I disabled RGBA in the output texture. This improved the performance of grabbing images from the engine
If RGBA isn't used anywhere else, the frame_buffer_properties can go directly into ImageBuffer as I have it now. If not, perhaps it should go into BaseCamera or RGBCamera, or be based on the CamMask that you have selected

Thank you very much. All tests have passed. Merged


rtl toggler proposal

Cool idea. This can be implemented as a UI plugin fairly straightforward, and it seems useful enough to be included by default. Not sure about the best UI yet, but I think the toggle control can go in the control panel (where the props panel is).
@serjout Is this something you'd be interested in implementing? If so I can walk you through the relevant parts of the codebase.


Remove archive storage factory

Which problem is this PR solving?

Simplify Storage: Remove ArchiveFactory, Use Storage.Factory

Description of the changes

Fixes #5230

How was this change tested?

some test are still failing working on fixing them

Checklist

[x] I have read https://github.com/jaegertracing/jaeger/blob/master/CONTRIBUTING_GUIDELINES.md
[x] I have signed all commits
[x] I have added unit tests for the new functionality
[x] I have run lint and test steps successfully

for jaeger: make lint test
for jaeger-ui: yarn lint and yarn test

@akagami-harsh I see you fixing tests, but the direction itself doesn't seem right to me (https://github.com/jaegertracing/jaeger/pull/5279#discussion_r1528655325). Can you elaborate?

@akagami-harsh I see you fixing tests, but the direction itself doesn't seem right to me (#5279 (comment)). Can you elaborate?

@yurishkuro , i am trying do to what you explained in the comment. first i removed the storage.archiveFactory interface and then trying to find a way to pass in two separate factories in the query-service for primary and archive.

I also said we should only do it in the scope of jaeger-v2, not do a major change in v1 storage

If at all possible we should try to avoid changing anything in v1 storage interface, because it's not necessary for v2.

I think we can close this


Reference list

The first version of the Reference List.
I used ChatGPT to answer the back-end settings. There is still work to do regarding the first author.
The front end also needs fixing. For example, the filters need some refactoring. The Author filter should contain the possibility to filter by any author (not only the first author). It may require some coding at the back end too. Also, filtering with Title (and many other fields) could be less fuzzy. And finally, the widths of the fields should be made more compact. Setting the Title as 20 did not make any change. Maybe I didn't know how to exactly do it.

Merged into development instead.


Force a workspace rule to override window rule

Discussed in https://github.com/hyprwm/Hyprland/discussions/5318

Originally posted by Kommynct March 29, 2024
I have a bunch of
windowrulev2 = bordersize 0,class:(firefox)
In my config file, but I have a special workspace that I want everything to always have borders in (because there are gaps in the special workspace anyway)
workspace=special,gapsin:20,gapsout:120,bordersize:2,border:true
I've tried the above, but it doesn't effect firefox, how would I achieve this?

use the unset window rule and match it to the class and workspace you want, put those rules at the top of the config file

windowrulev2 = unset,class:(firefox),workspace:special
windowrulev2 = bordersize 0,class:(firefox)
workspace=special,gapsin:20,gapsout:120,bordersize:2,border:true
in that order is not resolving the issue, am I doing something wrong?

should be windowrulev2 = unset, workspace:special, class:(firefox) and not
windowrulev2 = unset, workspace special, class:(firefox)

windowrulev2 = unset, workspace:special, class:(firefox)
windowrulev2 = bordersize 0,class:(firefox)
workspace=special,gapsin:20,gapsout:120,bordersize:2,border:true
in that order is still not working for me

it does work for non special workspaces, so it's likely a bug

Yeah, can confirm
windowrulev2 = bordersize 0,class:(firefox)
windowrulev2 = bordersize 2, workspace:1, class:(firefox)
workspace=special,gapsin:20,gapsout:120,bordersize:2,border:true
sets the border only when on workspace 1, @vaxerski somethings definitely wrong with special workspaces

I dont understand

if you have a config file with:
windowrulev2 = bordersize 0,class:(firefox)
windowrulev2 = bordersize 2, workspace:1, class:(firefox)
then when firefox is on workspace 1 it has a 2px border, elsewhere it has a 0px border
but if you set
windowrulev2 = bordersize 0,class:(firefox)
windowrulev2 = bordersize 2, workspace:special, class:(firefox)
workspace=special,gapsin:20,gapsout:120,bordersize:2,border:true
firefox does not have a 2px border in the special workspace

workspace rules for special are fixed on git, does that close this?


Add a quickstart section

README still needs work, but I think this should help people get started.

Thanks, incorporated all of your feedback.


Add python 3 compatability to python scripts

This uses __future__ imports and the six module to enable preprocess.py and novel_substrings.py to run on python 2 and python 3. Tested on python versions 2.7, 3.4, 3.5.

Any particular reason this isn't merged? It's had a review and doesn't conflict.

 Author's busy playing with pytorch 😉
#178


Stacked Bar X-Axis (vertical) Annotation Line not working

Recently turned this piece of code into a stacked bar chart from a regular bar chart. Annotation was working on the x-axis. When switched to y-axis, line shows up fine.
Couldn't find anything on the internet related to this issue, so I'm hoping someone here can help. Thanks.
var config_delta = {
type: 'bar',
data: {
    datasets: [
    {
    data: [3.8635456200000000,0.91864468800000000000,3.0506386200000000,1.5481537680000000,0.55593540000000000000,9.0997879680000000,1.3021911600000000,0.21176811600000000000,1.5247572000000000,3.2008850880000000,15.5784626640000000,1.2660168600000000,1.6641993480000000,2.3172742440000000,4.0637822400000000,3.4261679520000000,2.2400760000000000,8.9503183680000000,-0.14851364400000000000,3.1357236240000000,-0.00182925600000000000,0.41221826400000000000,4.1846267880000000,0.45266263200000000000,-0.17626687200000000000,0.10990296000000000000,-0.07860241200000000000,2.2229076600000000,-0.33906475200000000000,-0.06301486800000000000,0.06082005600000000000,0.000000000000000000000000,14.1759089160000000,-0.06011748000000000000,0.10604961600000000000,0.02024383200000000000,0.000000000000000000000000,3.5868448200000000,0.000000000000000000000000,0.000000000000000000000000,0.000000000000000000000000,0.000000000000000000000000,2.4134026800000000],
    label: 'Opex Delta',
    backgroundColor: '#444444',

    },
    {
    data: [19.6418444160000000,5.2080000720000000,5.6340883080000000,2.2670607240000000,1.9201662840000000,19.0396900440000000,1.2481872720000000,4.9949665320000000,0.07463049600000000000,0.15033601200000000000,32.9349843000000000,0.85423844400000000000,2.9307569160000000,0.81429690000000000000,0.48922659600000000000,12.4512929520000000,-0.43921528800000000000,4.8106992480000000,0.00309074400000000000,1.3231370760000000,0.03256056000000000000,1.5838690320000000,50.0265211320000000,0.16991613600000000000,-0.28202866800000000000,0.65346111600000000000,0.74684616000000000000,27.9974410560000000,-0.63033022800000000000,0.17321056800000000000,-0.50770414800000000000,0.48214376400000000000,32.1769067640000000,-0.53966004000000000000,-0.41447900400000000000,-1.9704895200000000,-0.55652973600000000000,16.9435786560000000,-0.28067370000000000000,-0.28227368400000000000,-0.71887399200000000000,-0.99450764400000000000,19.7907408360000000],
    label: 'Delta',
    backgroundColor: '#ff8a05',

    },
    ],
labels: [30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,47.5,48,48.5,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70],
},
options: {
    plugins:{
        legend: {
            display: false,
        },
        annotation: {

            annotations: {
                line1: {
                type: "line",
                scaleID: "x",

                value: 49,

                borderWidth: 2,
                borderDash: [6, 6],
                borderColor: "black",
                backgroundColor: '#7f7f7f',
                },
            },
        },
            tooltip:  {
                callbacks: {
                label: function(context) {
                    var label = context.dataset.label || '';

                    if (label) {
                        label += ': ';
                    }
                    if (context.parsed.y !== null) {
                        label += new Intl.NumberFormat('en-US', { style: 'decimal', minimumFractionDigits: '1',maximumFractionDigits:'1' }).format(context.parsed.y);
                    }
                    return label;
                }
            }
        }
    },
    scales: {
        x: {
            grid:{
                display:false,
            },
            title:{
                display:true,
                text: 'Strike'
            },
            ticks: {
                display: true,
                stepSize: 1,
                autoSkip: true,
                maxRotation: 90,
                minRotation: 90
            },
            gridLines: {
                offsetGridLines: false
            },
            stacked:true
        },
        y: {

            beginAtZero: true,
            title: {
                display:true,
                text: 'Net Nominal ($M)'
            },
            ticks: {
                callback: function(label, index, labels) {
                    return label;
                },
            },
            stacked:true
        }
    },
    responsive: true
}
};

@Jacyle use value: 22 instead of value: 49.
https://codepen.io/stockinail/pen/KKXwoMb
The access to the scale value by number uses the value passed as the index in the scale.
In this case, the labels as numbers but using the value as number, is looking for 50th value in the scale and not the numeric value 50.
I don't know if you can transform the labels form numbers to strings. in this case, you should be able to use the value: '49'


[WFCORE-5156] Upgrade JUnit to 4.13.1.

https://issues.redhat.com/browse/WFCORE-5156
Release Notes:

https://github.com/junit-team/junit4/blob/HEAD/doc/ReleaseNotes4.13.md
https://github.com/junit-team/junit4/blob/HEAD/doc/ReleaseNotes4.13.1.md

/retest

The test failure will be fixed by https://github.com/wildfly/wildfly-core/pull/4357.

@jamezp thanks


Error Waiting for wake word...

Hello! Thanks for this build!
I have a problem after launching, when "Waiting for wake word..." should work
I tried it on a USB microphone and wireless, but it doesn't even want to listen to my voice, but immediately gives an error.
I'd be grateful if you have a solution or a hint where to look.
"
Waiting for wake word...
Wake word file path: /home/xxxPython-3.12.7/ChatGPT-OpenAI-Smart-Speaker/wake_words/custom_model/Jeffers_Pi.ppn
Error with wake word detection, Porcupine or the PicoVoice Service.
"

Hi, you need to visit: https://picovoice.ai/platform/porcupine/  and create a free account to get an access key.
Finally, add the access key to your .env file: ACCESS_KEY="KEY GOES HERE"

Hi, you need to visit: https://picovoice.ai/platform/porcupine/ and create a free account to get an access key.
Finally, add the access key to your .env file: ACCESS_KEY="KEY GOES HERE"
I'll improve the error handling to identify a missing key.

Hi. Thanks for the answer, my key is ok.
Replacing the query helped me:
from:
porcupine = pvporcupine.create(access_key=os.environ.get("ACCESS_KEY"), keyword_paths=[custom_wake_word_path])
to:
porcupine = pvporcupine.create(access_key="ACCESS_KEY", keyword_paths=[custom_wake_word_path])


Add VPN monitoring alerts to 2-networking-b-vpn

The Fast stage 2-networking-b-vpn currently adds monitoring dashboards for VPN metrics. This change proposes also to add the following monitoring alerts:

VPN tunnel established *
VPN bandwidth

To configure the alerts, there is a new alert_config variable with defined default values. By default, the alerts are not created. In order to create the alerts with default values, add the following to terraform.tfvars:
alert_config = {
  vpn_tunnel_established = {}
  vpn_tunnel_bandwidth = {}
}

Thanks @juliocc , I only copied the variables.tf but obviously it doesn't make sense to have a variable present if the implementation is not there.
I can add the same monitoring to the other stages, but currently the dashboards are not replicated as well. Does it make sense to have monitoring (dashboards + alerts) copied to all the networking stages, or should it be a separate module?


Hide virtual sensors and switch groups

@Jey-Cee I think they are useful functions.

The groups are working quite well so far but the CLIP sensors are created again when used.

I think it works now.

@Jey-Cee What do you think about this PR?

It's done

I still have two little things.
Do group states really have a transitiontime? I thought it only existed with action.
https://github.com/Jey-Cee/ioBroker.deconz/blob/1428d0b5375dcb2a738acf1aa4509e32706e5f77/main.js#L1131-L1138
And actually the same thing only with window covering (roller blind).
https://github.com/Jey-Cee/ioBroker.deconz/blob/1428d0b5375dcb2a738acf1aa4509e32706e5f77/main.js#L1988-L1994

I just thought of one and according to the documentation it is not supported by on either.


[CGP-377] HTTP MockChain Part 1

This commit introduces an http server that provides endpoints
that run actions in the WalletAPI class against wallets stored
in memory. The transactions are currently thrown away but in
part 2 we will apply/validate those transactions against a
mockchain stored in memory. We will also provide a control API
for the mockchain.
During this commit the binary serialization of UTXO types has
been changed to derived versions using DeriveGeneric, this was
done to make serialization and deserialization easier as it is
used in JSON marshalling, it also cleans up the code a bit.

During this commit the binary serialization of UTXO types has
been changed to derived versions using DeriveGeneric, this was
done to make serialization and deserialization easier as it is
used in JSON marshalling, it also cleans up the code a bit.

I wouldn't do that. The main reason for deriving instances is "I do not want to write them down", which is totally fine sometimes, but in production it's rarely a good idea. The reason for that is that it's too easy to change a data type and do not realize that the derived instance is changed as well, behind your back. Now you have a silent mismatch between old produced JSON and new produced JSON. Moreover:

The problem is that Aeson's instance derivation code could change between releases. We've been bitten before by having version bounds on Aeson which were too lax, meaning that JSON formats could be incompatible between two copies of the same version of the compiler if one had been built with aeson < 1.0 and the other with aeson >= 1.0.

Fixing the nix stuff now

I think it's probably okay to have the derived instances here, because this isn't a fully specified API yet, it's mainly for testing. In the future when there's a proper wallet API over HTTP we're going to have to conform to whatever it uses anyway.

@michaelpj, @effectfully has an argument (quite a good one) for not deriving these instances but there is a counter argument. I would disagree strongly with "but in production it's rarely a good idea". Writing code is rarely a good idea in production, deriving is much more maintainable.
"it's too easy to change a data type and do not realize that the derived instance is changed as well" - this is why you shouldn't have orphans.
If you change the data type then you are more than likely changing the API, you have the equal risk of not changing the JSON API when you should do. Either way these things should be tested if they are critical.

I think my argument for the JSON here is that we actually don't care if this interface is unstable at the moment. There will be a "real" wallet API interface at some point where we will care, but this isn't it.

Looks good now. I would do a squash merge though (the last two commits are just to address the comments, and the build fails for the first two commits)


FYI: Prometheus federation master: 60s flamegraph

What did you do?
Just to let you know: I created a 60s FlameGraph of our Prometheus federation master using go-torch.
What did you expect to see?
I am surprised by the GC cpu time.
What did you see instead? Under which circumstances?
62% cpu time spent in Garbage Collector. Is this expected?This is just FYI. Feel free to close this issue if this is expected behavior.
Environment
CentOS Linux release 7.2.1511 (Core)

System information:
Linux 3.10.0-327.28.3.el7.x86_64 x86_64

Prometheus version:
prometheus, version 1.1.3 (branch: v1.1.3_build, revision: ac374aa6748e1382dbeb72a00abf47d982ee8fff)
build date:       20160916-12:58:14
go version:       go1.7.1

Master (Slave0):

Ingested Samples:  2.889k/s

Time Series:  	479.4k

Memory:  	4.983GiB

Slave1:

Ingested Samples: 5.38k/s

Time Series: 80.94k

Memory: 3.769GiB

Slave2:

Ingested Samples: 13.83k/s

Time Series: 333.2k

Memory: 4.375GiB

This zip contains the FlameGraph svg:
prometheus_federation_60s.zip
How to read the FlameGraph: "The x-axis shows the stack profile population, sorted alphabetically (it  is not the passage of time), and the y-axis shows stack depth. Each  rectangle represents a stack frame. The wider a frame is is, the more  often it was present in the stacks. The top edge shows what is on-CPU,  and beneath it is its ancestry. The colors are usually not significant,  picked randomly to differentiate frames." Source

What's your total CPU usage? (If you are light on CPU usage, then 62% is just a large chunk of a very small CPU usage.)
Does the flame graph look differently of you take it multiple times? (GC might just have kicked in for this one, and it might look differently at another time.)

Hi @beorn7,

What's your total CPU usage? (If you are light on CPU usage, then 62% is just a large chunk of a very small CPU usage.)

Prometheus uses between 5% and %500. It depends on the amount of threads opens. See
# ps -eLf | grep /usr/sbin/prometheus | wc -l
39
# cat /proc/cpuinfo  | grep 'model name' | uniq -c
    24 model name      : Intel(R) Xeon(R) CPU           X5670  @ 2.93GHz
# vmstat 1
procs -----------memory---------- ---swap-- -----io---- -system-- ------cpu-----
r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa st
0  1      0 67071196   1812 23299532    0    0    11   275   21    6  5  0 92  4  0
1  2      0 67068400   1812 23299564    0    0     0  5840 1293 2100  1  0 93  6  0
0  2      0 67059408   1812 23299608    0    0     0  4624 2085 2628  4  0 87  8  0
0  1      0 67044472   1812 23299564    0    0     0  3072 1415 1871  2  0 90  7  0
2  1      0 67071800   1812 23299568    0    0     0  3068 1338 2338  1  0 94  4  0
0  2      0 67086432   1812 23299596    0    0     0  2820 1118 1994  1  0 95  4  0
1  2      0 67125568   1812 23299564    0    0     0 11656 1536 2493  1  0 90  8  0
0  2      0 67126040   1812 23299624    0    0     0  2760  869 1600  0  0 91  8  0
1  1      0 67122192   1812 23299644    0    0     0  1412 1197 2431  1  0 94  5  0
1  1      0 67113952   1812 23299660    0    0     0  1536 1277 1975  2  0 94  4  0
0  1      0 67141696   1812 23299576    0    0     0  1796 1562 2769  1  0 94  4  0
0  1      0 67143440   1812 23299568    0    0     0  1928  792 1576  0  0 95  5  0
0  1      0 67114048   1812 23299600    0    0     0  2048 2678 2635  7  0 89  4  0
4  2      0 67092572   1812 23299544    0    0     0  4016 2448 2324  6  0 87  6  0

Does the flame graph look differently of you take it multiple times? (GC might just have kicked in for this one, and it might look differently at another time.)

I just realized that -log.level=debug was active during my first test. That's why I made two FlameGraphs with and without the debug mode. See this zip prometheus_federation_600s.zip.
In the new FlameGraphs the GC cpu usage is not as big as before.
A co-worker remarked that Prometheus uses golang/protobuf instead of gogo/protobuf. See e.g. in go_serialization_benchmarks. Any thought about that?
benchmark                                   iter           time/iter      bytes alloc               allocs
---------                                   ----           ---------      -----------               ------
BenchmarkGoprotobufMarshal-8                2000000        746 ns/op      312 B/op        4 allocs/op
BenchmarkGoprotobufUnmarshal-8              2000000        978 ns/op      432 B/op        9 allocs/op
BenchmarkGogoprotobufMarshal-8             10000000        211 ns/op       64 B/op        1 allocs/op
BenchmarkGogoprotobufUnmarshal-8            5000000        289 ns/op       96 B/op        3 allocs/op

In general, I would expect a server that does nothing else but scraping a light load and then federate everything further up to have a CPU workload with a significant part of GC, as it's mostly shoveling data around without a let to do otherwise for the CPU.
Your "normal mode" flame graph doesn't look suspicious to me.
Having said all that, https://github.com/gogo/protobuf looks like the package I have been looking for all the time, while I was upset how allocation-wasteful the standard protobuf implementation is. I just had a first glance, and I didn't know the package before. This is definitely something we should look into. Thanks for the pointer.
The practical impact might be limited, as the protobuf encoding and decoding is rarely a bottle neck, but every little helps, and more idiomatic code anyway. @juliusv Perhaps that's something that can be stuffed into the proto3 transition, too?

I've filed https://github.com/prometheus/client_model/issues/15 about the gogo/protobuf idea. Will close this here as there is no real issue left.


TEST-#6795: don't use platform-dependent int type

What do these changes do?

Depending on the platform int can be 32 bits or 64 bits.
These changes are enough for the tests to work on Windows. I don’t think it’s necessary to test at CI for now.

[x] first commit message and PR title follow format outlined here

NOTE:  If you edit the PR title to match this format, you need to add another commit (even if it's empty) or amend your last commit for the CI job that checks the PR title to pick up the new PR title.

[x] passes flake8 modin/ asv_bench/benchmarks scripts/doc_checker.py
[x] passes black --check modin/ asv_bench/benchmarks scripts/doc_checker.py
[x] signed commit with git commit -s
[x] Resolves #6795
[x] tests added and passing
[x] module layout described at docs/development/architecture.rst is up-to-date

what's the problem with using the platform-dependent type here? wouldn't 'int' always resolve into 'int32' everywhere so all the comparisons still stay true?

what's the problem with using the platform-dependent type here? wouldn't 'int' always resolve into 'int32' everywhere, so all the comparisons still stay true?

This is not the same type as what pandas uses by default (otherwise the tests would pass on windows and there would be no problem)


Intermediate Epoch Validation Metrics

Especially when each individual data point is large, such as an image data, the batch size need to be small to fit  within the memory. Hence in every epoch there would be too many batch, and each batch would update weights. It may be possible that there is a the validation loss minimum was some where mid way to an end of epoch, and further, the model was mostly overfitting.
This can be handled by provisioning an intermediate epoch validation matric, like for every batch_ID % n == 0 , where n is configurable, a validation metric is logged.

@Gelesh,
Yeah as mentioned the things are doable,  it will create the confusion for the user and also when we are trying to provide the results, it might take longer time interval to run the model which will leads to perfomance issue.  If you provide any Usecase for the similar feature, it will be easy to analyse the issue.
We used custom callback for a while until I found that model.validate resets all metrics so each time we do model.validate while the epoch is in progress, we lose all training metrics, overwriting them with validation metrics.
https://www.tensorflow.org/guide/keras/customizing_what_happens_in_fit?hl=en
Thank you!


ImportError: cannot import name 'soft_unicode' from 'markupsafe'

add "markupsafe=2.0.1" into setup.py
 install_requires=[         "MarkupSafe==2.0.1" # add         "backoff>=1.8.0",         "bleach>=3.0.2, <4.0.0",         "cachelib>=0.4.1,<0.

On a fresh pip install of Superset 1.4.2 I get the same error. Downgrading MarkupSafe to 2.0.1 fixes it.

This was bumped to 2.1.1 in https://github.com/apache/superset/pull/22355
CC @EugeneTorap for context here.
Assuming this is now resolved, and the issue seems like it's gone stale anyway. If there are still issues here, we can certainly revisit/reopen! Thank you!


How to disable selection in specific row

This appears to be an implementation question. Please use https://spectrum.chat/react-table, thanks!


Not enough components of "forces" on the /xServTopic topic

Curved Uskin tactile sensors attached to Allegro hand:
There is an element of the ROS node named "forces" where values change according to the force applied. However, there are only 10 x, y, and z components per sensor, even though there should be 30 (30 taxels per sensor). I am attaching messages from the topic /xServTopic  without forces applied.
Forces.docx

Could you send us the Server software version, the xServ.ini file, and the XR21AFTC.xela file (or if you use .xcal or .xdef, those as well) that you use? This could help us replicate the issue and find a possible cause.
Thank you

We have received the WeTransfer files as well; thank you. Yet from those, it looks like the ROS node has taken other information in for the force measurement. It has been reading ups values as force, which would explain why it only exists in the 10-taxel range. As such, have you changed the node's source at any point?
On line 465 of the scripts/xela_service, you can see the following:
force_vals = msg_obj.get("calibrated", None)
    If force_vals is None:
        force_vals = []
    for i in range(0, len(force_vals), 3):
        forces.append(Forces())
        forces[-1].x, forces[-1].y, forces[-1].z = force_vals[i:i + 3]
    sensor.forces = forces

This allocation also ensures that no other value shall be used for calibrated forces, only if marked as calibrated, which ups is not.
The ups stands for updates per second, and with event-driven microcontrollers, they are usually low until the values change, in which case they start broadcasting more often.
If you have modified the code, please show me so I can help fix it. If not, I would need to figure out why I have been unable to reproduce this issue since it was first mentioned in a direct email.

Thank you.
Yes, that is the issue then.
We will do some more testing for the force calibration for the curved fingertip and let you know once it can be downloaded from our support website.
I will now close the issue.


Avoid relying on non-standard Fortran syntax extension for unary negation

The code as written leads gfortran to produce this warning:
Warning: Extension: Unary operator following arithmetic operator (use parentheses)

Many of the cases touched in my change could maybe be more clearly rewritten by replacing addition with subtraction, or reciprocal by exponentiation with division. I opted to take a purely syntactic approach. I'll defer to the Noah developers on how they'd like arithmetic to be written out in the code.


Added 64-bit

included a libsvm_x64.dll which will be used for the DllImports if WIN32
is not defined. Additionally changed the target platform to AnyCPU from
x86 in the settings for each of the projects.

I just realized I wasn't using the newest libsvm dll.


hover markdown not rendered properly

Is this plugin still being developed? If not, could someone please suggest something else that is close to as good.
Kite constantly seems to stop working and then just show path locations when I mouse over things in vscode. Starting to become more of a hindrance than anything else. I have the latest core installed, but no matter how many times I reboot or logout or reinstall the plugin, Kite core keeps telling me that I need to refresh vscode...
Would appreciate any info. Thanks.

This plugin is indeed under active development.

What features of Kite stop working? Completions? Follow cursor? Hover?
Could you provide screenshots regarding your second point: "Kite core keeps telling me that I need to refresh vscode."

Thanks for your feedback.

Sorry for not giving enough information the first time.
Here is a screenshot: https://ibb.co/6rQ8H67
Basically what happens is that mousing over something just produces something like what you see in that tooltip, what seems to be a broken tooltip where kite is trying to pull information from the database about that given function/etc.
It doesn't mater what I mouseover, I get either the same kind of tooltip, or I get literally nothing. Compared to the screenshots I've seen which show direct parsing of the Python Documentation (or something similar) I'm not getting this at all. Plus the Kite core window is giving me that "you may need to reload vscode" error all the time. No matter how many times I reload vscode or uninstall kite or the plugin.
In PyCharm kite seems to work flawlessly.

That's very helpful. We're looking into it.

meet same problem here

Apologies for the delay here. I'm looking into this issue today, and we should have a fix ready within the next couple of days. Thanks for your patience.

@ivan-ivy @pythonInRelay could you provide the version of these components:

VS Code version ("About Visual Studio Code")
Kite extension version (Preferences -> Extensions inside VS Code)

I am not able to easily reproduce the issue you're seeing.


please publish new package version to NPM

publish package
profit
:+1:

I will, just the end of this week is a little busy :)

Sorry it took longer, I wanted to add CLI tests and refactor it.
But it's good now v0.7.21 :)

:+1:


(PUP-3936) Ensure that weaving logic is aware of block

Previously, a block parameter was not added to the weaving array
which resulted in it being omitted by the weaving logic. This
commit ensures two things.

No parameters can be added after a block parameter.
The index of the block parameter (size of the names array)
is added to the weaving array.

A test is also added that tests combining injection with a required block
parameter.

CLA signed by all contributors.

nice catch ! looks good


Send a Payment

Is it possible to send a payment without there being an order and a charge? Just send another account some money?

@radiantone, if you are asking about peer-to-peer payments between two individuals, this is not something supported by Amazon Pay.
If you are asking about payments from an individual to a business, can you elaborate on your use case?  Generally a specific product or service needs to be purchased that has fixed amounts associated with them on your system.


Helper messages and autocomplete broken for inferred function props

Reproduces on 2.8.0-dev.20180315
interface FooProps<T> {
  callback: (input: T) => string;
  value: T;
}

class Foo<T> extends React.Component<FooProps<T>> {
  public render() {
    return "baz";
  }
}

const X = <Foo callback={test => test} value="asd"/>;

The bug is visible while using an IDE like visual code, but I expect the problem is in the language server, since from what I know it's the source for helper messages and the autocomplete functionality.
What happens is that the callback gets correctly inferred as (input: string) => string, in fact, you can write
callback={test => test.substring(0)}

without errors, as the compilers actually knows that test is a string.
and you cannot write
callback={test => 42}
or
callback={test => test.methodNotOnString()}

However, if in visual code you hover over the callback, it shows as a function T => any, instead of string => string. The return value of substring will be shown as any.
Moreover autocomplete won't work correctly when trying to access a property of test.
It seems like the compiler does everything correctly in inferring the correct type, but the helper messages and autocomplete functions are instead unable to access the same inferred type.

It looks like we aren't treating JSX constructors as well as we treat regular calls when it comes to quick info.
import * as React from "React";

interface FooProps<T> {
    value: T;
    callback: (input: T) => string;
}
class Foo<T> extends React.Component<FooProps<T>> { }

function foo<T>(_obj: { value: T, callback: (input: T) => string }) { }

// Hover over callback shows (JSX Attribute) callback: (test: T) => any
// Hover over test shows (parameter) test: T
<Foo value={0} callback={test => test.toFixed()} />;

// Hover over callback shows `(property) callback: (input: number) => string`
// Hover over test shows (parameter) test: number
foo({ value: 0, callback: test => test.toFixed() });

class C<T> {
    constructor(_o: { value: T, callback: (input: T) => string }) {}
}
// Same as function call
new C({ value: 0, callback: test => test.toFixed() });

I know you guys are very busy, but do you think there's a chance that this could be fixed in 2.8?
Given that generic tsx components now work in 2.8 and type inference as well, it is very unfortunate that the quick info doesn't work as that it is very close related to those new features and even if it is not a real showstopper it does make the developing experience a bit clunky.

I know you guys are very busy, but do you think there's a chance that this could be fixed in 2.8?

I am afraid it is too late for including anything in 2.8 at the moment

Given that generic tsx components now work in 2.8 and type inference as well,

we intend the whole thing to work in 2.9 end to end.

I understand, thanks anyway, I am already quite happy that it is shipping so soon! Great Work!

I was curious about this so I saw if I could figure out if I could write a failing test. I've done so, but I’m not sure if it's the right approach or not. Feel free to use it or not. I’d potentially be interested in trying to work on this, but I don’t have to—I was just exploring for my own education. https://github.com/andrewbranch/TypeScript/commit/75812b3b2f742455b177f7c0e3f9cf4a36869a11


Typography change between master and 1.0

I've deployed the 1.0 branch and the font is thinner than the master version. I still haven't changed the content from the starter, so it's easy to compare them side-by-side at:

master: https://gatsbyjs.github.io/gatsby-starter-blog/hi-folks/
1.0: https://www.hsribei.com/2015-05-28-hi-folks/

Is the change intentional? Since the files moved I couldn't find which change could've been responsible for this difference.
Inspecting the paragraphs shows the same font-family and font-weight. How do I revert to the heavier version? Thanks!

It looks like the google fonts aren't loading on your version causing the change.

Branch 1.0 seems to use self-hosted fonts via the Typefaces npm packages for montserrat and merriweather. So probably not related to google fonts. Still investigating.

The fonts are getting bundled with the build, eg:
https://www.hsribei.com/static/montserrat-latin-400.8ebd6e27.svg
Just not sure why they aren't being loaded. Any hint on how I track down how which path is being used to refer to them? My JS skills are shameful :disappointed:

It looks like you're not inlining the css in the head correctly. Look at your html.js where it loads the styles.css file and inlines it.

That helps. The problem seems to be with webpack raw-loader.
Looking at gatsby-starter-blog's html.js (I'm using it unaltered), I found this:
https://github.com/gatsbyjs/gatsby-starter-blog/blame/1.0/src/html.js#L10
let stylesStr
if (process.env.NODE_ENV === `production`) {
  try {
    stylesStr = require(`!raw-loader!./public/styles.css`) // <== causes error
  } catch (e) {
    console.log(e)
  }
}

module.exports = React.createClass({
  render () {
    const head = Helmet.rewind()
    let css                                                // <== is later inlined
    if (process.env.NODE_ENV === `production`) {
      css = <style id="gatsby-inlined-css" dangerouslySetInnerHTML={{ __html: stylesStr }} />
    }

Cleaning the build and running it again I noticed this webpack error I hadn't before:
Generating Static HTML
{ Error: Cannot find module "!raw-loader!./public/styles.css"
    at webpackMissingModule (render-page.js:25624:82)

The require used to read
css = <style dangerouslySetInnerHTML={{ __html: require('!raw!./public/styles.css') }}
(raw instead of raw-loader). Changing it back to !raw! doesn't work though. The current documentation recommends raw-loader! (without the first exclamation point). That doesn't work either.
I'm trying to figure out how to make raw-loader work.

The path to styles.css is wrong 🙈
Fixed on github
https://github.com/gatsbyjs/gatsby-starter-blog/commit/1d2329c1c9bb073d5bd1f4e8963671ee208904bd
On Wed, May 3, 2017 at 12:31 PM Helder S Ribeiro<EMAIL_ADDRESS>wrote:

That helps. The problem seems to be with webpack raw-loader.
Looking at gatsby-starter-blog's html.js (I'm using it unaltered), I
found this:
https://github.com/gatsbyjs/gatsby-starter-blog/blame/1.0/src/html.js#L10
let stylesStr
if (process.env.NODE_ENV === production) {
try {
stylesStr = require(!raw-loader!./public/styles.css) // <== causes error
} catch (e) {
console.log(e)
}
}
module.exports = React.createClass({
render () {
const head = Helmet.rewind()
let css                                                // <== is later inlined
if (process.env.NODE_ENV === production) {
css = <style id="gatsby-inlined-css" dangerouslySetInnerHTML={{ __html: stylesStr }} />
}
Cleaning the build and running it again I noticed this webpack error I
hadn't before:
Generating Static HTML
{ Error: Cannot find module "!raw-loader!./public/styles.css"
at webpackMissingModule (render-page.js:25624:82)
The require used to read
css = <style dangerouslySetInnerHTML={{ __html:
require('!raw!./public/styles.css') }}
(raw instead of raw-loader). Changing it back to !raw! doesn't work
though. The current documentation recommends raw-loader! (without the
first exclamation point). That doesn't work either.
I'm trying to figure out how to make raw-loader work.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/gatsbyjs/gatsby-starter-blog/issues/28#issuecomment-299011902,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAEVh7qdQXHFohhzGIPmyKa2LlY96g8jks5r2NYjgaJpZM4NMRqk
.

That got rid of the error, but <style id="gatsby-inlined-css"></style> is still empty and fonts still missing.

Just ran it locally and it worked for me
On Wed, May 3, 2017 at 12:54 PM Helder S Ribeiro<EMAIL_ADDRESS>wrote:

That got rid of the error, but  is
still empty and fonts still missing.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/gatsbyjs/gatsby-starter-blog/issues/28#issuecomment-299017247,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAEVh_9ytx4gUU-LHTCuDjWUCOFzUsBiks5r2NtXgaJpZM4NMRqk
.

You're right, it worked!! Did a clean build and everything looks pretty again :) Can't believe I didn't think of looking into such a small thing. Sorry for the trouble. Thank you very much!


Merkelize some hashes in block header

Currently, block header contains multiple hashes, that can be "merkelized" into single hash.
There is similar discussion in Tendermint repo.
Origin: https://github.com/lazyledger/optimint/pull/73#discussion_r644734732
ref:

tendermint/tendermint#7860
tendermint/tendermint#7915

Not relevant anymore


request: XBOX button launch

Hi,
I havent figured out how to trigger the "XBOX home" button. Everything else works fine.
I would need to have "XBOX home" button opened, so the "startpage"  menue will be launched. From there I will be able to scroll down to launch a certain app/game.
Any idea how this can be done?

Hi, how is it not working? I mapped my home button to the "X" key and is works while streaming. You map the button and it does nothing?


[bug]: installer bat issue

Is there an existing issue for this?

[X] I have searched the existing issues

OS
Windows
GPU
cuda
VRAM
No response
What happened?
Win10 machine.  ERROR: Ignored the following versions that require a different python version: 0.55.2 Requires-Python <3.5; 1.21.2 Requires-Python >=3.7,<3.11; 1.21.3 Requires-Python >=3.7,<3.11; 1.21.4 Requires-Python >=3.7,<3.11; 1.21.5 Requires-Python >=3.7,<3.11; 1.21.6 Requires-Python >=3.7,<3.11
ERROR: Could not find a version that satisfies the requirement torch==1.12.1 (from versions: none)
ERROR: No matching distribution found for torch==1.12.1
Requirements installation failed. See above for errors and check https://invoke-ai.github.io/InvokeAI/installation/INSTALL_AUTOMATED/#troubleshooting for potential solutions.
The installer will exit now.
Press any key to continue . . .
So I tried reinstalling 3.7.9, and then "repaired" 3.11.1.
Re-runnning the install.bat, I get:
***** Checking and Updating Python *****
Your version of Python is too low. You need at least 3.9.0 but you have 3.7.9. We recommend Python 3.10.9 from https://www.python.org/downloads/release/python-3109/
The installer will exit now.
Press any key to continue . . .
Screenshots
No response
Additional context
No response
Contact Details
<EMAIL_ADDRESS>

InvokeAI isn't currently compatible with python 3.11 because of the pytorch version it's using (maybe other dependencies as well, I'm not sure).
Please try installing 3.10.9 from the link provided in what you've pasted above, making sure to check 'add python.exe to PATH' when doing so.

I did as requested, removing the latest Python and installing the 3.10.9. as requested.
After much wrangling with the Huggingface tokens, the install appears to have completed, but the actual use will not.
When I run the "Unified Canvas" it will not ever complete the task.  The first attempt appeared to be asking too much, as did the second.  I scaled back the third attempt with a different picture.  I'm attempting to extend the bottom of a picture  by a third.
My Virtual Memory is 24.7 GB, My Video Card is a 16GB CUDA card, NVIDIA GeForce GTX 1660 Ti
OS Name	Microsoft Windows 10 Home
Version	10.0.19045 Build 19045
Other OS Description 	Not Available
OS Manufacturer	Microsoft Corporation
System Name	D5000
System Manufacturer	Micro-Star International Co., Ltd.
System Model	MS-7B79
System Type	x64-based PC
System SKU	To be filled by O.E.M.
Processor	AMD Ryzen 5 2600X Six-Core Processor, 3600 Mhz, 6 Core(s), 12 Logical Processor(s)
BIOS Version/Date	American Megatrends Inc. A.70, 1/23/2019
SMBIOS Version	2.8
Embedded Controller Version	255.255
BIOS Mode	Legacy
BaseBoard Manufacturer	Micro-Star International Co., Ltd.
BaseBoard Product	X470 GAMING PLUS (MS-7B79)
BaseBoard Version	2.0
Platform Role	Desktop
Secure Boot State	Unsupported
PCR7 Configuration	Binding Not Possible
Windows Directory	C:\WINDOWS
System Directory	C:\WINDOWS\system32
Boot Device	\Device\HarddiskVolume9
Locale	United States
Hardware Abstraction Layer	Version = "10.0.19041.2251"
User Name	DESTROYOBOT5000\Dad
Time Zone	Pacific Standard Time
Installed Physical Memory (RAM)	16.0 GB
Total Physical Memory	15.9 GB
Available Physical Memory	7.28 GB
Total Virtual Memory	24.7 GB
Available Virtual Memory	3.93 GB
Page File Space	8.73 GB
Page File	C:\pagefile.sys
Kernel DMA Protection	Off
Virtualization-based security	Not enabled
Device Encryption Support	Reasons for failed automatic device encryption: TPM is not usable, PCR7 binding is not supported, Hardware Security Test Interface failed and device is not Modern Standby, Un-allowed DMA capable bus/device(s) detected, TPM is not usable
Hyper-V - VM Monitor Mode Extensions	Yes
Hyper-V - Second Level Address Translation Extensions	Yes
Hyper-V - Virtualization Enabled in Firmware	No
Hyper-V - Data Execution Protection	Yes
Do you want to generate images using the

command-line
browser-based UI
open the developer console
Please enter 1, 2 or 3: 2
Starting the InvokeAI browser-based UI..

Patchmatch initialized

Initializing, be patient...

Initialization file C:\Users\Dad\InvokeAI\invokeai\invokeai.init found. Loading...
InvokeAI runtime directory is "C:\Users\Dad\InvokeAI\invokeai"
GFPGAN Initialized
CodeFormer Initialized
ESRGAN Initialized
Using device_type cuda
Current VRAM usage:  0.00G
Scanning Model: stable-diffusion-1.5
Model Scanned. OK!!
Loading stable-diffusion-1.5 from C:\Users\Dad\InvokeAI\invokeai\models\ldm\stable-diffusion-v1\v1-5-pruned-emaonly.ckpt
| LatentDiffusion: Running in eps-prediction mode
| DiffusionWrapper has 859.52 M params.
| Making attention of type 'vanilla' with 512 in_channels
| Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
| Making attention of type 'vanilla' with 512 in_channels
| Using more accurate float32 precision
| Loading VAE weights from: C:\Users\Dad\InvokeAI\invokeai\models\ldm\stable-diffusion-v1\vae-ft-mse-840000-ema-pruned.ckpt
Model loaded in 26.34s
Max VRAM used to load the model: 4.28G
Current VRAM usage:4.28G
Current embedding manager terms: *
Setting Sampler to k_lms

--web was specified, starting web server...

Initialization file C:\Users\Dad\InvokeAI\invokeai\invokeai.init found. Loading...
Started Invoke AI Web Server!
Default host address now <IP_ADDRESS> (localhost). Use --host <IP_ADDRESS> to bind any address.
Point your browser at http://<IP_ADDRESS>:9090
System config requested
Image generation requested: {'prompt': 'space pirate, digital art, elegant, ((intricate)), ((highly detailed)), (((depth of field))), ((professionally color graded)), highly intricate, concept art, award winning photograph, soft cinematic lighting, sharp focus, 8k resolution wallpaper, hyperrealistic, perfect composition, soft cinematic lighting, octane render, smooth, denoise, art by artgerm and greg rutkowski and alphonse mucha', 'iterations': 1, 'steps': 50, 'cfg_scale': 7.5, 'threshold': 0, 'perlin': 0, 'height': 512, 'width': 512, 'sampler_name': 'k_lms', 'seed': 534563495, 'progress_images': False, 'progress_latents': True, 'save_intermediates': 5, 'generation_mode': 'unifiedCanvas', 'init_mask': 'data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAABAAAAAVACAYAAADWMi...', 'fit': False, 'strength': 0.75, 'invert_mask': False, 'bounding_box': {'x': 0, 'y': 0, 'width': 1024, 'height': 1344}, 'init_img': 'data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAABAAAAAVACAYAAADWMi...', 'inpaint_width': 1024, 'inpaint_height': 1344, 'seam_size': 96, 'seam_blur': 16, 'seam_strength': 0.7, 'seam_steps': 10, 'tile_size': 32, 'infill_method': 'patchmatch', 'force_outpaint': False, 'variation_amount': 0}
ESRGAN parameters: False
Facetool parameters: False
{'prompt': 'space pirate, digital art, elegant, ((intricate)), ((highly detailed)), (((depth of field))), ((professionally color graded)), highly intricate, concept art, award winning photograph, soft cinematic lighting, sharp focus, 8k resolution wallpaper, hyperrealistic, perfect composition, soft cinematic lighting, octane render, smooth, denoise, art by artgerm and greg rutkowski and alphonse mucha', 'iterations': 1, 'steps': 50, 'cfg_scale': 7.5, 'threshold': 0, 'perlin': 0, 'height': 512, 'width': 512, 'sampler_name': 'k_lms', 'seed': 534563495, 'progress_images': False, 'progress_latents': True, 'save_intermediates': 5, 'generation_mode': 'unifiedCanvas', 'init_mask': <PIL.Image.Image image mode=RGBA size=1024x1344 at 0x15CD46B66B0>, 'fit': False, 'strength': 0.75, 'invert_mask': False, 'bounding_box': {'x': 0, 'y': 0, 'width': 1024, 'height': 1344}, 'init_img': <PIL.Image.Image image mode=RGBA size=1024x1344 at 0x15CD4748E50>, 'inpaint_width': 1024, 'inpaint_height': 1344, 'seam_size': 96, 'seam_blur': 16, 'seam_strength': 0.7, 'seam_steps': 10, 'tile_size': 32, 'infill_method': 'patchmatch', 'force_outpaint': False, 'variation_amount': 0}
using provided input image of size 1024x1344
This input is larger than your defaults. If you run out of memory, please use a smaller image.
using provided input image of size 1024x1344
Using recommended DDIM sampler for inpainting.
Traceback (most recent call last):
File "C:\Users\Dad\InvokeAI\invokeai.venv\lib\site-packages\ldm\generate.py", line 492, in prompt2image
results = generator.generate(
File "C:\Users\Dad\InvokeAI\invokeai.venv\lib\site-packages\ldm\invoke\generator\base.py", line 61, in generate
make_image = self.get_make_image(
File "C:\Users\Dad\InvokeAI\invokeai.venv\lib\site-packages\torch\autograd\grad_mode.py", line 27, in decorate_context
return func(*args, **kwargs)
File "C:\Users\Dad\InvokeAI\invokeai.venv\lib\site-packages\ldm\invoke\generator\inpaint.py", line 268, in get_make_image
self.model.encode_first_stage(init_image)
File "C:\Users\Dad\InvokeAI\invokeai.venv\lib\site-packages\torch\autograd\grad_mode.py", line 27, in decorate_context
return func(*args, **kwargs)
File "C:\Users\Dad\InvokeAI\invokeai.venv\lib\site-packages\ldm\models\diffusion\ddpm.py", line 1250, in encode_first_stage
return self.first_stage_model.encode(x)
File "C:\Users\Dad\InvokeAI\invokeai.venv\lib\site-packages\ldm\models\autoencoder.py", line 414, in encode
h = self.encoder(x)
File "C:\Users\Dad\InvokeAI\invokeai.venv\lib\site-packages\torch\nn\modules\module.py", line 1130, in _call_impl
return forward_call(*input, **kwargs)
File "C:\Users\Dad\InvokeAI\invokeai.venv\lib\site-packages\ldm\modules\diffusionmodules\model.py", line 497, in forward
h = self.down[i_level].block[i_block](hs[-1], temb)
File "C:\Users\Dad\InvokeAI\invokeai.venv\lib\site-packages\torch\nn\modules\module.py", line 1130, in _call_impl
return forward_call(*input, **kwargs)
File "C:\Users\Dad\InvokeAI\invokeai.venv\lib\site-packages\ldm\modules\diffusionmodules\model.py", line 134, in forward
h = self.norm1(x)
File "C:\Users\Dad\InvokeAI\invokeai.venv\lib\site-packages\torch\nn\modules\module.py", line 1130, in _call_impl
return forward_call(*input, **kwargs)
File "C:\Users\Dad\InvokeAI\invokeai.venv\lib\site-packages\torch\nn\modules\normalization.py", line 272, in forward
return F.group_norm(
File "C:\Users\Dad\InvokeAI\invokeai.venv\lib\site-packages\torch\nn\functional.py", line 2516, in group_norm
return torch.group_norm(input, num_groups, weight, bias, eps, torch.backends.cudnn.enabled)
RuntimeError: CUDA out of memory. Tried to allocate 672.00 MiB (GPU 0; 6.00 GiB total capacity; 4.66 GiB already allocated; 0 bytes free; 4.77 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation.  See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

Could not generate image.
Usage stats:
0 image(s) generated in 54.96s
Max VRAM used for this generation: 5.01G. Current VRAM utilization: 4.28G
Max VRAM used since script start:  5.01G

Please check the hardware requirements in the documentation; unfortunately the GTX 1660 isn't recommended for InvokeAI.

If I understand what you're saying, it's a requirement to have a CUDA card, but you don't support one of the most popular CUDA cards manufactured?
I tried resizing the original image down to 512 x 704.  It's now producing results, albeit very weird results, but it is producing results.

There's currently either a hardware or driver bug with those cards; it has nothing to do with InvokeAI - essentially, they don't support FP16 properly, and since they have very low VRAM compared to newer cards, they run out of memory quite easily (as they have to use about twice as much with FP32). There's been talk over in the pytorch repo issues about the fault lying with cudnn, and there were supposedly updates to address it, but the results seem to be mixed. Things might work better with those cards and InvokeAI in the future, but nobody here can say for sure.

Is it the bug that makes the AI make the weird choices when extending a picture?
(I'm trying to use InvokeAI to build out a picture of a women generated with a different AI that caused one of her legs to be severely deformed.  Clipping the deformation from the picture and running InvokeAI...well let's just say that Invoke doesn't seem to grasp human anatomy very well.  I've tried nine attempts so far with all of them creating weird mangrove root distortions where the other leg should be.
If I was going for an acid-trip-hippy-picture-lost-in-Salvador-Dali-land, than all the results would be "groovy, man!"
But since I'm trying for photorealism-- not really hitting the mark, if you know what I mean.

Nope, unrelated.


Better 'Add torrent' dialog

A better dialog for adding torrents. File tree on the right, tracker editor, etc.

Looks 🌶


Chrono types in remote sinks

In RisingWave, time / timestamp / timestamptz has a precision of microseconds, neither milli nor nano.
When possible, prefer "new" classes in java.time.* since Java 8 (doc) over legacy ones in java.sql.*.

date -> LocalDate
time -> LocalTime
timestamp -> LocalDateTime
timestamptz -> OffsetDateTime

It seems that all remote sinks use java.sql.Time\Date\Timestamp, and their precision is in milliseconds.
Originally posted by @xuefengze in https://github.com/risingwavelabs/risingwave/issues/13651#issuecomment-1829051121

https://ideone.com/MQaQHQ
long ms = -13222483200000l;
new java.sql.Date(ms); // 1550-12-21 in Julian calendar
java.time.LocalDate.ofEpochDay(ms / 1000 / 86400); // 1550-12-31 in proleptic Gregorian calendar


Fleet based unit tests updated to reflect d3ploy changes

The NO_Inst segments of the mock simulations in no_inst_fleet_unit_tests.py need to be updated to reflect new d3ploy NO_inst.py structure. Only after https://github.com/ergs/d3ploy/issues/18,  https://github.com/ergs/d3ploy/issues/19 and https://github.com/ergs/d3ploy/issues/20 have been implemented.

closed with https://github.com/ergs/d3ploy/pull/51


add nbsphinx to exe examples, use Travis CI to build docs

Coverage remained the same at 100.0% when pulling 026eac64f2abf5fdf18503e873ea40af5bd7e968 on nbsphinx into 3920fd8327abac03a010a921fa2239d472d7ec6b on master.

Coverage remained the same at 100.0% when pulling 6aebaa11e52b6e10d8e018cd600b06390ddbd247 on nbsphinx into 3920fd8327abac03a010a921fa2239d472d7ec6b on master.

Coverage remained the same at 100.0% when pulling 47872d25086fba0adfa98455972b4137e6d7ae82 on nbsphinx into 3920fd8327abac03a010a921fa2239d472d7ec6b on master.


Tag missing for 0.3.2

Hello there!
Release notes for 0.3.2 are out but tags go only as far as 0.3.1
Thanks in advance,
Nuba
$ bower install<EMAIL_ADDRESS>--save
bower ion-autocomplete#~0.3.2       not-cached git://github.com/guylabs/ion-autocomplete.git#~0.3.2
bower ion-autocomplete#~0.3.2          resolve git://github.com/guylabs/ion-autocomplete.git#~0.3.2
bower ion-autocomplete#~0.3.2     ENORESTARGET No tag found that was able to satisfy ~0.3.2

Additional error details:
Available versions in git://github.com/guylabs/ion-autocomplete.git: 0.3.1, 0.3.0, 0.2.3, 0.2.2, 0.2.1, 0.2.0, 0.1.2, 0.1.1, 0.1.0, 0.0.2, 0.0.1

Hi Nuba,
0.3.2 is not yet released and the release notes are already updated when an issue is fixed on the master. That is why there are already release notes despite the release is not out already. So you need to check the releases and then read the according release notes. You also see the latest version in the badges in the readme.
So can I close the issue as I think it should be clear why it is already there right?
Thanks and regards,
Guy

I see, thanks for the explanation! :P
On Mon, Dec 7, 2015 at 6:24 PM, Guy Brand<EMAIL_ADDRESS>wrote:

Hi Nuba,
0.3.2 is not yet released and the release notes are already updated when
an issue is fixed on the master. That is why there are already release
notes despite the release is not out already. So you need to check the
releases and then read the according release notes. You also see the latest
version in the badges in the readme.
So can I close the issue as I think it should be clear why it is already
there right?
Thanks and regards,
Guy
—
Reply to this email directly or view it on GitHub
https://github.com/guylabs/ion-autocomplete/issues/122#issuecomment-162649925
.


add shiny for package results of CohortSymmetry

For outputs from package it would be great to have a shiny see here for examples:
https://github.com/oxford-pharmacoepi/EHDENCancerSurvivalStudyShiny
https://github.com/oxford-pharmacoepi/EHDENCancerIncSurvCovid
https://github.com/oxford-pharmacoepi/EHDENCancerExtrapolationStudyShiny

Closing this as I think OmopViewer can handle this now


Combining Dask Tasks

For catalogs with many partitions, such as PanSTARRS, having a Dask task for each partition would introduce a lot of unnecessary task scheduling overhead. Combining tasks to reduce the overall number of tasks could help with this.
Need to investigate how worker memory management handles combined tasks operating serially. If it can't spill older memory within a running Task, this might not be easily possible.

Dask memory management makes this hard. Dask spilling to disk only happens with the results of tasks, not with intermediate values, so combining multiple tasks leads to workers needing lots of memory without the ability to spill their results.


Bump lean3 and mathlib; fix extraction script

Bumps mathlib and adapts the extraction script to the new version (lint_mathlib_decls was removed from mathlib.)
Tested by generating the dataset (though understandably generation took much longer).

LGTM, thanks @zygi!


FERC EQR Archiver

This script archives FERC EQR data from two sources: 2002-2013 and 2014-present. Technically, the code should work: it produces the expected URLs for each resource, and sends them to the download_zipfile() method. However, two issues will frustrate the easy use of this archiver and should be dealt with more creatively.

Exceptionally slow download times from FERC. As FERC notes on their website:

Due to the large size of the database, only three users are allowed to download simultaneously at any time. Because downloading may take a long time, it will likely work best if scheduled during off-peak hours, such as Sundays or at night.
Indeed, running this script generally results in timeout errors. Because of the 3-download limitation, downloads may want to be done serially, rather than in parallel.

Files exceed size limitations for GitHub runner, as noted by Zane.

This issue is blocked by #44

Like, a global 3-user throttle? Oy vey. Can you link to the specific docs where they mention that?  I think we could specifically limit the # of concurrent connections to 1 for EQR - maybe via some sort of command-line flag. I'm thinking something like this in src/pudl_archiver/__init__.py:
diff --git a/src/pudl_archiver/__init__.py b/src/pudl_archiver/__init__.py
index 4eb4439..cf9d20c 100644
--- a/src/pudl_archiver/__init__.py
+++ b/src/pudl_archiver/__init__.py
@@ -47,13 +47,19 @@ async def archive_dataset(
         await archiver.create_archive()

+DATASETS_LIMITED_CONCURRENCY = {"ferc_eqr"}
+
+
 async def archive_datasets(
     datasets: list[str],
     sandbox: bool = True,
     initialize: bool = False,
     dry_run: bool = True,
+    conns_per_host: int = 20,  # could be parsed as a CLI option
 ):
     """A CLI for the PUDL Zenodo Storage system."""
+    if set(datasets).intersection(DATASETS_LIMITED_CONCURRENCY):
+        conns_per_host = 1
     if sandbox:
         upload_key = os.environ["ZENODO_SANDBOX_TOKEN_UPLOAD"]
         publish_key = os.environ["ZENODO_SANDBOX_TOKEN_PUBLISH"]
@@ -61,7 +67,7 @@ async def archive_datasets(
         upload_key = os.environ["ZENODO_TOKEN_UPLOAD"]
         publish_key = os.environ["ZENODO_TOKEN_PUBLISH"]

-    connector = aiohttp.TCPConnector(limit_per_host=20, force_close=True)
+    connector = aiohttp.TCPConnector(limit_per_host=conns_per_host, force_close=True)
     async with aiohttp.ClientSession(
         connector=connector, raise_for_status=False
     ) as session:
@@ -75,7 +81,6 @@ async def archive_datasets(
                 publish_key,
                 testing=sandbox,
             )
-
             tasks.append(
                 archive_dataset(
                     dataset,

Re: the file size, if we were to upload individual files to Zenodo instead of downloading the whole dataset and then uploading everything, would that work?

Testing the individual archivers is definitely an important/unanswered question. This archiver is following the general pattern of having a method that gets the url for/downloads a single file. We could always mock out download_zipfile and check that the URL can be downloaded from there, or we could go with the strategy you presented of splitting it out into two parts.
In general I'd like to have testing that would actually check that the file names and partitions are structured in the way that PUDL expects, so we could catch issues like the one I found with eia860m. I'm not sure of an obvious way to get there though.

As for the rate limiting and file size issues, I like the idea of being able to set the number of concurrent connections per dataset. I think this will be useful in tuning the rate limiting more generally. I also think downloading one file at a time seems like a good approach. We could probably even do something where we download a file, go through the whole deposition update process (uploads/deletes and update datapackage), but just don't publish the new version, and continue this until we're through the whole process. This might be an easy approach without having to change very much.

Sounds like we should make a separate ticket for "streaming deposition update in archiver" - I can do that.
In terms of testing the actual data - how did you find that eia860m issue?
Could we basically download a small subset of the data for each dataset and validate that? Seems like we'd want to run it through the whole ETL flow, so we could try something like this:

create all datasets from scratch on sandbox
update them with as little data as reasonable
run ETL against them
validate ETL outputs

I don't actually know the details of what the nightly build does, but is this similar to that?

So far I've very coarsely tested this by just printing the URLs to terminal and running a spot check to make sure all is expected as I'm developing the code, but in terms of long-term testing the url inputs I could see a few options working here. The download_hyperlinks() method by default only generates hyperlinks which exist on the page, so testing is not an issue for these methods. This leaves download_zipfile() and download_file() as the two methods which take a url as input.

Adding a resp.ok HEAD check into download_zipfile()/download_file(), which would add this check into all the archivers that take urls as input.
Adding a separate url_check() method (perhaps, that can be turned off/on), which would precede the download method. Since the functions are built mostly to take singular URLs, it would be best to write this to take one URL as input.

Even just having the raw EQR archived somewhere (AWS open data...) that doesn't have a global 3-user limitation will dramatically improve data accessibility 😄
@zschira I think once an archiver is up and running and working well, we should probably be using it to create new production archives on a schedule, while also being conservative about ensuring that the archiver fails if something unexpected happens, so we don't end up creating polluted (irrevocable) archives.
My guess is that for many of our datasets, almost every new archive will cause the nightly builds to fail, so if we're going to attempt an auto-PR to switch to a new archive, doing it one dataset at a time will be necessary.  Snapshotting the data is and versioning it has value (and is relatively easy) and should make it easy for us to switch over to a new set of DOIs once a quarter or once a month, address any new brokenness, and cut a release.

Update: this PR is either waiting on the resolution of issue #44 or on the development of an interim workaround. In the meantime, I'll hold off on merging.

I guess one potential workaround is that instead of running this archiver on at GitHub runner, we spin up a GCP instance on a schedule (kicked off by a GitHub action on a schedule?) and run it there instead, with plenty of disk and a fast, reliable net connection. Maybe just monthly or quarterly if it ends up being a bear. 🐻


When a manual tab group is created in chrome, mirror that in auto-group-tabs

I find myself creating manual groups first directly in the browser when I start launching multiple pages and then secondly go to auto-group-tabs and add the same. This might be self induced double work but it would be great if any manually created tabs in chrome were automatically pulled into auto-group and optimally a refresh would then be done to pull in any existing matching tabs.

I don't really like the idea to mirror all manual tab groups to the extension's configuration. However, there is an upcoming feature in the next days that will remove the double work you're facing — see my comment here.

This feature has been published, new version 0.0.14 is out. This makes it easy to create configurations from manual tab groups by clicking the extension icon.


TableViewCell, TableView & TableViewDataSource compilation error

axmol version: 1.0
devices test on: iOS
developing environments

NDK version: n/a
Xcode version: 14.3
Visual Studio: n/a

VS version: n/a
MSVC version: n/a
Windows SDK version: n/a

cmake version:
Steps to Reproduce:

We are migrating from Cocos2d-x to Axmol and we are having issues  with the classes "TableViewDataSource", "TableView", and "TableViewCell". Our assumption is that these classes are in the namespace 'ax::extension'. But when we build our code that we are trying to migrate to Axmol we will have some compilation errors:

error: no type named 'TableView' in namespace 'ax::extension'
error: no type named 'TableViewCell' in namespace 'ax::extension'

My questions would be:

The TableView classes, are they in the namespace 'ax::extension'?
If the answer to the first question is no, did you move them in a different name space. If yes, what would be that namespace
Perhaps these classes were replaced by new ones. If that is case, what would they be?

Thank you for you help.
Stay safe

This kind of question is a little strange, given any modern IDE or text editor has text search functionality.
The classes are in fact there, in the ax::extension namespace, and the files are in the extensions/GUI directory:

You can also look at the cpp-tests to verify that it exists, and how it works in the tests.
So, once you have verified that the code exists within the project (via the aforementioned text search functionality), you then need to look at your own code, and at a guess, it would be either an issue with the include statements, or something incorrect in the CMakeLists.txt of your project.
The extensions are build by ensuring AX_ENABLE_EXT_GUI is set correctly, and it defaults to true in core/CMakeLists.txt:
option(AX_ENABLE_EXT_GUI "Build extension GUI" ON)
Check if you have set AX_ENABLE_EXT_GUI to OFF or false for some reason.

Hi RH,
I hope you are doing great.
There is no strange questions 😊😊😊😊😊😊. Better ask than pretend to know 😂. We tried lot of things but since we couldn’t solved our issue that is why we asked. We will check to make sure that the option “AX_ENABLE_EXT_GUI” is set to ON.
We also saw the example that you are referring. It’s the same like cocos2d-x but it was moved (the folder structure is different).
I’m sure we missed something that will look obvious to us when we will resume the work tomorrow. Thank you very much for your help, I do appreciate. We will look into it tomorrow.

Thank you,
Stay safe.

On Aug 29, 2023, at 7:50 PM, RH @.***> wrote:
This kind of question is a little strange, given any modern IDE or text editor has text search functionality.
The classes are in fact there, in the ax::extension namespace, and the files are in the extensions/GUI directory:
https://user-images.githubusercontent.com/8603230/264188299-6bf5badf-aeea-4593-92d3-37c1549fbc5d.png
You can also look at the cpp-tests to verify that it exists, and how it works in the tests.
So, once you have verified that the code exists within the project (via the aforementioned text search functionality), you then need to look at your own code, and at a guess, it would be either an issue with the include statements, or something incorrect in the CMakeLists.txt of your project.
The extensions are build by ensuring AX_ENABLE_EXT_GUI is set correctly, and it defaults to true in core/CMakeLists.txt:
option(AX_ENABLE_EXT_GUI "Build extension GUI" ON)
Check if you have set AX_ENABLE_EXT_GUI to OFF or false for some reason.
—
Reply to this email directly, view it on GitHub https://github.com/axmolengine/axmol/issues/1314#issuecomment-1698291393, or unsubscribe https://github.com/notifications/unsubscribe-auth/AI54DTGOWUYK55O3BVCZE7DXXZ54RANCNFSM6AAAAAA4DQSFXM.
You are receiving this because you authored the thread.

“AX_ENABLE_EXT_GUI” was set to OFF. We set it up to ON and everything was fine.
Thank you

Issue was fixed


"Change Character" Event crashes the game.

Describe your bug here.
Psych Engine crashes upon triggering the "Change Character" event. I already added the sprites with xml and json, everything already set up and when I change the current characters to the new ones, the game crashes and gives me this error message:
PlayState.hx (line 4182)
openfl/events/EventDispatcher.hx (line 402)
openfl/display/DisplayObject.hx (line 1399)
Uncaught Error: Null Object Reference
Please report this error to the GitHub page: https://github.com/ShadowMario/FNF-PsychEngine

Crash Handler written by: sqirra-rng

Command Prompt/Terminal logs (if existing)
No response
Are you modding a build from source or with Lua?
Lua
What is your build target?
Windows
Did you edit anything in this build? If so, mention or summarize your changes.
No, everything added was made using the mods folder.

Character is probably spelt wrong.

Nope, I had just tested it out again and apparently, the game saves some data that I had deleted a some time ago because I wasn't using them anymore. Even if I change the "events.json" file to match what I want or change the events via debug menu, the game still recognizes the deleted files and crashes.