Electron Helper High CPU

When typing new mails or replies the process "Electron Helper" rises to outrageous high CPU, resulting in a big lag. See attached. I've seen it over a 100%.
Doesn't happen in every email, but I can't seem to find a consistent issue.
Nylas 0.4.25-a22631a on OSX 10.11.4
This might be related as the cpu goes higher when typing; https://github.com/nylas/N1/issues/895

Are you sure it is N1 causing this? Slack also an Electron application. Could you check the path of Electron Helper and see if it is contained in the N1 app bundle.

I'm not sure if this is the data you need, let me know if I can provide more;
/
/Applications/Nylas N1.app/Contents/Frameworks/Electron
Helper.app/Contents/MacOS/Electron Helper
/Applications/Nylas N1.app/Contents/Frameworks/Electron
Framework.framework/Versions/A/Electron Framework
/Applications/Nylas
N1.app/Contents/Frameworks/Squirrel.framework/Versions/A/Squirrel
/Applications/Nylas
N1.app/Contents/Frameworks/ReactiveCocoa.framework/Versions/A/ReactiveCocoa
/Applications/Nylas
N1.app/Contents/Frameworks/Mantle.framework/Versions/A/Mantle
/Applications/Nylas N1.app/Contents/Frameworks/Electron
Framework.framework/Versions/A/Libraries/libnode.dylib
/Applications/Nylas N1.app/Contents/Frameworks/Electron
Framework.framework/Versions/A/Resources/en.lproj/locale.pak
/System/Library/Frameworks/CoreMIDI.framework/Versions/A/CoreMIDI
/usr/lib/libexpat.1.dylib
/private/var/folders/wh/27v_ht3x32n96jnggg71xs1m0000gn/T/.org.chromium.Chromiu
m.dYL1Ve
/private/var/folders/wh/27v_ht3x32n96jnggg71xs1m0000gn/T/.org.chromium.Chromiu
m.aPuO4J
/Users/jorenfrielink/.nylas/edgehill.db-shm
/Applications/Nylas N1.app/Contents/Resources/app.asar.unpacked/node_modules/k
eytar/build/Release/keytar.node
/usr/share/icu/icudt55l.dat
/Applications/Nylas N1.app/Contents/Frameworks/Electron
Framework.framework/Versions/A/Resources/icudtl.dat
/Applications/Nylas N1.app/Contents/Frameworks/Electron
Framework.framework/Versions/A/Resources/snapshot_blob.bin
/Applications/Nylas N1.app/Contents/Frameworks/Electron
Framework.framework/Versions/A/Resources/natives_blob.bin
/Applications/Nylas N1.app/Contents/Frameworks/Electron
Framework.framework/Versions/A/Resources/content_shell.pak
/private/var/folders/wh/27v_ht3x32n96jnggg71xs1m0000gn/0/com.apple.LaunchServi
ces-134501.csstore
/System/Library/Fonts/SFNSText-Regular.otf
/private/var/folders/wh/27v_ht3x32n96jnggg71xs1m0000gn/T/.org.chromium.Chromiu
m.LvGl35
/Applications/Nylas N1.app/Contents/Resources/app.asar.unpacked/node_modules/p
athwatcher/build/Release/pathwatcher.node
/Applications/Nylas N1.app/Contents/Resources/app.asar.unpacked/node_modules
/atom-keymap/node_modules/keyboard-layout/build/Release/keyboard-layout-
observer.node
/Applications/Nylas N1.app/Contents/Resources/app.asar.unpacked/node_modules/s
qlite3/lib/binding/electron-v0.36-darwin-x64/node_sqlite3.node
/System/Library/Keyboard Layouts/AppleKeyboardLayouts.bundle/Contents/Resource
s/AppleKeyboardLayouts-L.dat
/System/Library/Caches/com.apple.IntlDataCache.le.kbdx
/Applications/Nylas N1.app/Contents/Resources/app.asar.unpacked/node_modules/s
pellchecker/build/Release/spellchecker.node
/System/Library/CoreServices/SystemAppearance.bundle/Contents/Resources/System
Appearance.car
/System/Library/CoreServices/SystemAppearance.bundle/Contents/Resources/Assets
.car
/Library/Fonts/Times New Roman.ttf
/System/Library/Fonts/Helvetica.dfont
/private/var/folders/wh/27v_ht3x32n96jnggg71xs1m0000gn/T/.org.chromium.Chromiu
m.3PegLj
/private/var/db/mds/system/mdsDirectory.db
/private/var/db/mds/messages/se_SecurityMessages
/System/Library/Fonts/Times.dfont
/usr/lib/dyld
/private/var/db/dyld/dyld_shared_cache_x86_64h
/dev/null
/dev/null
/dev/null
->0x795253d7f6ffa1c5
count=2, state=0x12
->0x795253d7ef304565
->0x795253d7f0006325
count=0, state=0x8
->0x795253d7fab05565
->0x795253d7f4f6f925
->0x795253d7f5411765
->0x795253d7f4f6ea25
count=0, state=0xa
/Applications/Nylas N1.app/Contents/Frameworks/Electron
Framework.framework/Versions/A/Resources/icudtl.dat
/Applications/Nylas N1.app/Contents/Frameworks/Electron
Framework.framework/Versions/A/Resources/snapshot_blob.bin
/Applications/Nylas N1.app/Contents/Frameworks/Electron
Framework.framework/Versions/A/Resources/natives_blob.bin
/Applications/Nylas N1.app/Contents/Frameworks/Electron
Framework.framework/Versions/A/Resources/en.lproj/locale.pak
/Applications/Nylas N1.app/Contents/Frameworks/Electron
Framework.framework/Versions/A/Resources/content_shell.pak
count=0, state=0xa
->0x795253d7efa347e5
->0x795253d7efd1a5e5
->0x795253d7f5ef1095
/dev/urandom
->0x795253d7f7fb9be5
/Applications/Nylas N1.app/Contents/Resources/atom.asar
/private/var/folders/wh/27v_ht3x32n96jnggg71xs1m0000gn/T/.org.chromium.Chromiu
m.dYL1Ve
/private/var/folders/wh/27v_ht3x32n96jnggg71xs1m0000gn/T/.org.chromium.Chromiu
m.LvGl35
/private/var/folders/wh/27v_ht3x32n96jnggg71xs1m0000gn/T/.org.chromium.Chromiu
m.aPuO4J
/Applications/Nylas N1.app/Contents/Resources/app.asar
/private/var/folders/wh/27v_ht3x32n96jnggg71xs1m0000gn/T/Nylas-N1-10092.10094.
log
count=0, state=0xa
/System/Library/CoreServices/SystemAppearance.bundle/Contents/Resources/System
Appearance.car
/System/Library/CoreServices/SystemAppearance.bundle/Contents/Resources/Assets
.car
/private/var/folders/wh/27v_ht3x32n96jnggg71xs1m0000gn/T/.org.chromium.Chromiu
m.3PegLj
/Users/jorenfrielink/.nylas/config.cson
/Users/jorenfrielink/.nylas/edgehill.db
/dev/null
/Users/jorenfrielink/.nylas/keymap.cson
->0x795253d7f7fbbf0d
/Users/jorenfrielink/.nylas/edgehill.db-wal
/Users/jorenfrielink/.nylas/edgehill.db-shm
I did end the process once while N1 was open and it forced closed N1. Also,
while i'm typing this reply I can see the Electron helper's CPU go up from 1%
to about 14%.
(btw, I have about five instances of Electron Helper running that all close
when N1 is closed. Only one has a high CPU.)
On Apr 29 2016, at 3:33 am, Matt Bilker<EMAIL_ADDRESS>wrote:

Are you sure it is N1 causing this? Slack also an Electron application.
Could you check the path of Electron Helper and see if it is contained in the
N1 app bundle.

—
You are receiving this because you authored the thread.
Reply to this email directly or [view it on GitHub](https://github.com/nylas/N
1/issues/2068#issuecomment-215608276)![](https://github.com/notifications/beac
on/AEhJr-__5Fs1Kx5mfct7qHN6KfhvjIczks5p8V__gaJpZM4IQAoG.gif)

Okay so it is N1's Electron Helper. I see something like this on Linux and that is from the worker process that handles fetching data from the Sync Engine so the CPU usage may be that.

It's also a consistent issue on my side. I think is something related to the Sync process as well. When the Sync message is in the UI this process comes the CPU high to ~90%.

Yikes. It should be lowered in the latest version due to optimizations across the board.

I've got the same problem on the latest version. I installed Nylas N1 last night, no problems. Connected up three gmail accounts (low volume). Turned on the computer and it started N1, then it pretty much hangs. Processor utlization for Electron Helper (I've seen one and two threads) exceeds 100%. OSX Version 0.4.33-e8f137e (0.4.33-e8f137e).
There were two new mail items that took 10 minutes to download.

Another user has reported this on ZenDesk: https://nylas.zendesk.com/agent/tickets/4306 ("Random high CPU usage all the time")

This is the biggest issue preventing me from using Nylas!
Is there an action plan to solve? The whole syncing process seems a bit suspect at the moment.

Another incidence: https://nylas.zendesk.com/agent/tickets/5713

Another incidence: https://nylas.zendesk.com/agent/tickets/5716

I'm having this happen as well. Near 100% all the time even if I let it sit and sync fully. It makes the UI extremely unresponsive to actions. For example, archiving an e-mail does not remove the email from the inbox view until many minutes later (if at all).

Seeing the issue same here! I noticed this last week after a update.

I can confirm this issue on Windows as well.

merging into #3178


[NHK] [NhkVod] follow redirection

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

[X] I understand that I will be blocked if I remove or skip any mandatory* field

Checklist

[X] I'm requesting a site-specific feature
[X] I've verified that I'm running yt-dlp version 2022.11.11 (update instructions) or later (specify commit)
[X] I've checked that all provided URLs are playable in a browser with the same IP and same login details
[X] I've searched the bugtracker for similar issues including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue
[ ] I've read about sharing account credentials and I'm willing to share it if required

Region
worldwide
Example URLs
https://www3.nhk.or.jp/nhkworld/en/tv/72hours/20221129/4026171
Provide a description that is worded well enough to be understood
Some NHK video webpages like this
https://www3.nhk.or.jp/nhkworld/en/tv/72hours/20221129/4026171
include a (seemingly) embedded video with a pulsating play button.
I don't know if this video is thought to be played embedded(ly) or trigger a redirection.
When clicking on the play button, my Firefox instance does the latter and redirects here:
https://www3.nhk.or.jp/nhkworld/en/ondemand/video/4026171
On this landing page, there finally is the playable video.
When running yt-dlp with those URLs,
the 1st URL fails (with the error log provided below)
the 2nd URL is downloaded correctly.
Maybe the NHK extractor can be enhanced to use the 2nd URL when the 1st URL is provided ?
The video in the 1st URL links to the 2nd URL:
Extract from the source code:

Provide verbose output that clearly demonstrates the problem

[X] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[X] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
yt-dlp --ignore-config -v https://www3.nhk.or.jp/nhkworld/en/tv/72hours/20221129/4026171
[debug] Command-line config: ['--ignore-config', '-v', 'https://www3.nhk.or.jp/nhkworld/en/tv/72hours/20221129/4026171']
[debug] Encodings: locale cp1252, fs utf-8, pref cp1252, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version 2022.11.11 [8b64402] (win_exe)
[debug] Python 3.8.10 (CPython AMD64 64bit) - Windows-10-10.0.19043-SP0 (OpenSSL 1.1.1k  25 Mar 2021)
[debug] exe versions: ffmpeg N-105208-gb24f0c82b3-20220108 (setts), ffprobe N-105208-gb24f0c82b3-20220108
[debug] Optional libraries: Cryptodome-3.15.0, brotli-1.0.9, certifi-2022.09.24, mutagen-1.46.0, sqlite3-2.6.0, websockets-10.4
[debug] Proxy map: {}
[debug] Loaded 1723 extractors
[debug] [generic] Extracting URL: https://www3.nhk.or.jp/nhkworld/en/tv/72hours/20221129/4026171
[generic] 4026171: Downloading webpage
[redirect] Following redirect to https://www3.nhk.or.jp/nhkworld/en/tv/72hours/20221129/4026171/
[debug] [generic] Extracting URL: https://www3.nhk.or.jp/nhkworld/en/tv/72hours/20221129/4026171/
[generic] 4026171: Downloading webpage
WARNING: [generic] Falling back on generic information extractor
[generic] 4026171: Extracting information
[debug] Looking for embeds
ERROR: Unsupported URL: https://www3.nhk.or.jp/nhkworld/en/tv/72hours/20221129/4026171/
Traceback (most recent call last):
  File "yt_dlp\YoutubeDL.py", line 1485, in wrapper
  File "yt_dlp\YoutubeDL.py", line 1561, in __extract_info
  File "yt_dlp\extractor\common.py", line 674, in extract
  File "yt_dlp\extractor\generic.py", line 2721, in _real_extract
yt_dlp.utils.UnsupportedError: Unsupported URL: https://www3.nhk.or.jp/nhkworld/en/tv/72hours/20221129/4026171/

Do you have some more examples? So we get an idea what the possible URL patterns look like

I'll look if I can find additional URLs.
But maybe there is no systematic pattern that leads from URL1 to URL2.
Isn't the more foolproof solution to find the  anchor with class="c-tv-episode-info-video-navigate" as it already contains the target URL:

?

ok, here is another example:
start URL: https://www3.nhk.or.jp/nhkworld/en/tv/72hours/20221206/4026137/
target URL: https://www3.nhk.or.jp/nhkworld/en/ondemand/video/4026137/
Ok, so in this case apparently it's sufficient to replace tv/72hours/[date]/[videoID] with ondemand/video/[videoID].
I then assume it would be better to even replace tv/[category]/[date]/[videoID] with ondemand/video/[videoID] because there are very likely other categories than "72hours" that have the same URL scheme.

@pukkandan I am already working on this so can you assign this to me.


Fixes #1 add api

Pretty straight forward. should be no problem.

LGTM! TUTA OCH KÖR!

Didn't mean to do that. 🤦


rename PLAN RECREATOR to PLAN REPLAYER

What problem does this PR solve?
I used the wrong word before, modify it here
What is changed and how it works?
Check List
Tests

Unit test

Code changes

Has exported function/method change
Has exported variable/fields change
Has interface methods change

Side effects

Possible performance regression
Increased code complexity
Breaking backward compatibility

Related changes

Need to cherry-pick to the release branch
Need to update the documentation
Need to be included in the release note

Please resolve the conflicts and update the dependency in TiDB.


[loc][Query][AzureStorageExplorer] Localizability of 0; "AriaPrincipleEditingDescription"

Hi,
please help localization team to answer question from translator.
In case translator is not sure about context/meaning/localizability of string we raise a question to Core team.
Can you help, please?
Thanks!
Source:
type the UPN or OID of the desired %1$s then press enter to save
File Name:
loc\en\src\components\se-adls2-extension\resources\ManagePosixAcl.json
Resource ID:
0; "AriaPrincipleEditingDescription"
Query:
What are the options for the placeholder? Now translated as "type the UPN or OID of the desired element of type %1$s", please confirm.

The placeholder is either "Owner" (LabelOwner) or "Owning Group" (LabelOwningGroup). For example "type the UPN of OID of the desired owner then press enter to save".

Many thanks


vibration pattern issue

Vibration pattern does not work. It always uses default patterns. plz check this.

Code:
vibrationPattern:  Int64List.fromList([0, 1000, 500, 1000, 500, 1000])

/////
Device: Samsung m30s
Version: Android 10 (Q)
/////

After you create a notification channel, the only thing that could be updated is the name and the description.
Anything else (including the vibration pattern) only will be updated if you reinstall the app or if you destroy the original channel and creates a copy with a different channel key. Unfortunately this rule was defined by Android OS since Oreo version.
Try to do any of this alternatives and tell me if they change the vibration pattern.

THere is a bug related to vibration patters.
In somehow dart cannot compare propertly a Type reference and a runtime from object. Because of that, the vibration pattern was discarted as invalid.
This bug will be fixed in the next release.

Version 0.0.5 finally released! The vibration patter was finally fixed.
But you gonna need to protect your native resources against minification inserting the prefix "res_" in your image or sound file names. You can see more about it here in the README file.
Also i simplified the iOS installation. Please, update it if you pretend to use iOS too.
Call me here if you continue with issues on this new version.

Thanks.
i will check.


Add Plotofy; Capabilities to check farming logs

Background
I tried to use chiadog to monitor my farm on windows, but I cant get it to work (always tells me my farm is offline, but i can see it farming...)
So I decided to rebuild the basic capabilities into Plotofy.
It shall be able to do the following:

Continously  monitor debug.log for any error or warning (except known errors/warnings that are not bad) and notify in Discord about those events
Continously (every 60 min) check plot eligibility and time in secods to load plots. Average that out for 24h and send notification
Continously monitor for found proofs and notify in discord
Continously monitor for found proofs that did not end in a block reward and notify in discord
Monitor for no new activity in Log -> Node offline

Approach
A Watchdog function that from time to time (intervall definable) checks your debug.log.
If there is any, found proof, new error or warning that has not been alarmed about yet, notify Discord,

moved to plotofy repo


Parse error with usePreviewSubscription

The Error:
I am trying to use the usePreviewSubscription hook with next-sanithy, though i'm having an issue where I am not receiving draft data.
My code:
query:
const query = groq`
  *[_type == 'product' && slug.current == $handle][0] {
    ...,
    productPage {
      ...,
      related[] -> {
        slug,
        'series': productPage.series,
        'seriesVariant': productPage.seriesVariant,
      }
    }
  }
`;

hook:
  const { data: productData, error } = usePreviewSubscription(query, {
    params: { slug: initialCmsProduct.slug.current },
    initialData: initialCmsProduct,
    enabled: true,
  });

  console.log(error)

Error message
Here is what is outputted when log the error property destructured from the hook:
    at parse (groq-js.esm.js?3052:1166)
    at Module.parse$1 (groq-js.esm.js?3052:5424)
    at eval (groq-store.js?181b:1)

Additional details
It seems to be listening to document updates because when I make a change in the respective document, the error logs once again.

Looks like it was user error. I had something left over that was making my query return undefined.


I would like to know the specifications of the API being called by the class "downloadRevocationRequests" published on GitHub.

① Request parameter specifications, response data return conditions (what state of the certificate is being returned as a response)
https://github.com/microsoft/Intune-Resource-Access/blob/master/src/CsrValidation/java/lib/src/main/java/com/microsoft/intune/scepvalidation/IntuneRevocationClient.java
・CertificateAuthorityRequests/downloadRevocationRequests

I will write the code for the corresponding process.
https://github.com/microsoft/Intune-Resource-Access/blob/eae184eea8f7dab417d3ac29cc3ac39b7db8cace/src/CsrValidation/java/lib/src/main/java/com/microsoft/intune/scepvalidation/IntuneRevocationClient.java#L97C1-L138C6


[2.0] Set frontend settings: dir and theme

Backport of https://github.com/kubic-project/salt/pull/243

It has to be rebased

Rebased.

Had approvals from @kiall and @mjura.


I didn't get airdrop

I registered on November 14 of this month one day before the airdrop, my account is verified and I had the golden icon of steller and I did not receive the airdrop, my username is miloslte

Like me bro


⚠ sandbox-api.piste.gouv.fr healthcheck has degraded performance

In b604d41, sandbox-api.piste.gouv.fr healthcheck (https://sandbox-api.piste.gouv.fr/cassation/judilibre/v1.0/healthcheck) experienced degraded performance:

HTTP code: 200
Response time: 2986 ms

Resolved: sandbox-api.piste.gouv.fr healthcheck performance has improved in a5df40a.


Link Java wrapper in readme

I made a Java wrapper of this API,
I believe it fully wraps the functionality that the API currently offers.
It can be found here: https://github.com/robertlit/SpigotResourcesAPI/
I think linking it in the readme could help some people.

It's not officially supported by the project, so we can't do that as then we would be expected to support it as well. I would talk to @md-5 about making it parented by SpigotMC. If so, then sure. But as of now we can't do that.


Add TSG: The nginx ingress controller installed with the amlarc extension crashes due to out-of-memory (OOM)

#sign-off


[Question] Anchor optimization

:question: Question

Hello, could you explain a bit further what happens inside the method find_anchor of the class BoxC001 in nndet/planning/architecture/boxes/base?
As I understand you are optimizing the anchor size using the normalized bbox in the training set, but the method is not clear for me.
Thank you.

Dear @vankhoa21991 ,
first, all the training boxes are all centered around the origin (since the exact position of them during training will vary due to the patch extraction) and the method aims to optimize the anchors sizes. The anchors sizes are initialized with a fixed default value (this might be improvable) and then optimized by a black box optimizer to maximize the best anchor for each GT. To correctly reflect the Feature Pyramid Networks with its multiple levels, the current set of anchor boxes is extended by scaling them with the individual strides of the network (as is done by the anchor generator). The current default black box optimizer is based on Differential Evolution (I tried some others as well but found this one yields the best and most consistent results), more information can be collected from the nevergrad library. To allow anchors to specialize on individual "object types" only the best fitting anchor per object will be used to compute the final iou score.
So in Summary:
|---------------------------<<-------------------- optimize params ------------------------<<--------------------------|
Set of Anchors ---> Scale with Stride for Pyramid --->  IoU(Anchors, GT) ---> Select best fitting Anchor per GT as Score |
Best,
Michael

Thanks for your explanation, it's very helpful.
Van Khoa

I'll close the Issue for now, please feel free to reopen if any other questions come up.


Issues at install via homebrew

When running brew install bartycrouch I get the following warnings:
Warning: Could not fix @rpath/libswiftCore.dylib in /usr/local/Cellar/bartycrouch/4.0.0/bin/bartycrouch
Warning: Could not fix @rpath/libswiftCoreFoundation.dylib in /usr/local/Cellar/bartycrouch/4.0.0/bin/bartycrouch
Warning: Could not fix @rpath/libswiftCoreGraphics.dylib in /usr/local/Cellar/bartycrouch/4.0.0/bin/bartycrouch
Warning: Could not fix @rpath/libswiftDarwin.dylib in /usr/local/Cellar/bartycrouch/4.0.0/bin/bartycrouch
Warning: Could not fix @rpath/libswiftDispatch.dylib in /usr/local/Cellar/bartycrouch/4.0.0/bin/bartycrouch
Warning: Could not fix @rpath/libswiftFoundation.dylib in /usr/local/Cellar/bartycrouch/4.0.0/bin/bartycrouch
Warning: Could not fix @rpath/libswiftIOKit.dylib in /usr/local/Cellar/bartycrouch/4.0.0/bin/bartycrouch
Warning: Could not fix @rpath/libswiftObjectiveC.dylib in /usr/local/Cellar/bartycrouch/4.0.0/bin/bartycrouch
Warning: Could not fix @rpath/libswiftCore.dylib in /usr/local/Cellar/bartycrouch/4.0.0/lib/libSwiftSyntax.dylib
Warning: Could not fix @rpath/libswiftCoreFoundation.dylib in /usr/local/Cellar/bartycrouch/4.0.0/lib/libSwiftSyntax.dylib
Warning: Could not fix @rpath/libswiftCoreGraphics.dylib in /usr/local/Cellar/bartycrouch/4.0.0/lib/libSwiftSyntax.dylib
Warning: Could not fix @rpath/libswiftDarwin.dylib in /usr/local/Cellar/bartycrouch/4.0.0/lib/libSwiftSyntax.dylib
Warning: Could not fix @rpath/libswiftDispatch.dylib in /usr/local/Cellar/bartycrouch/4.0.0/lib/libSwiftSyntax.dylib
Warning: Could not fix @rpath/libswiftFoundation.dylib in /usr/local/Cellar/bartycrouch/4.0.0/lib/libSwiftSyntax.dylib
Warning: Could not fix @rpath/libswiftIOKit.dylib in /usr/local/Cellar/bartycrouch/4.0.0/lib/libSwiftSyntax.dylib
Warning: Could not fix @rpath/libswiftObjectiveC.dylib in /usr/local/Cellar/bartycrouch/4.0.0/lib/libSwiftSyntax.dylib

After installing, running bartycrouch init fails with the following error:
dyld: Library not loaded: @rpath/libswiftCore.dylib
  Referenced from: /usr/local/bin/bartycrouch
  Reason: image not found
Abort trap: 6

Using Xcode 10.2 beta 4 (the only one I have installed)

Thank you for reporting the issue. I haven't had the change to try out Xcode 10.2 betas yet, but I will have a look into this before next weeks keynote since it's probable that Xcode 10.2 will ship on that they and this should be fixed until then. If you happen to have time investigating this yourself, feel free to do so and posting a PR with the fix if you find one. Please note that the installation instructions can be found in the Makefile.

By the way, you might also try running brew doctor and see if that suggests anything. Maybe something like brew link bartycrouch -f could be suggested in there ...

This problem persists in XCode 10.2 (10E125).
dyld: Symbol not found: _$SBOWV
  Referenced from: /usr/local/Cellar/bartycrouch/4.0.0/lib/libSwiftSyntax.dylib
  Expected in: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/lib/swift/macosx/libswiftCore.dylib
 in /usr/local/Cellar/bartycrouch/4.0.0/lib/libSwiftSyntax.dylib
/Users/jb/Library/Developer/Xcode/DerivedData/App-dqbaiklsjvudqugpgzywlyvdcnar/Build/Intermediates.noindex/App.build/Debug-iphoneos/App.build/Script-296043D31F505C29005A8519.sh: line 6:  2437 Abort trap: 6           bartycrouch update
Command PhaseScriptExecution failed with a nonzero exit code

jb@jb-mac:~ $ brew link bartycrouch -f
Warning: Already linked: /usr/local/Cellar/bartycrouch/4.0.0
To relink: brew unlink bartycrouch && brew link bartycrouch
jb@jb-mac:~ $ brew doctor
Your system is ready to brew.
jb@jb-mac:~ $ bartycrouch --version
dyld: Symbol not found: _$SBOWV
  Referenced from: /usr/local/Cellar/bartycrouch/4.0.0/lib/libSwiftSyntax.dylib
  Expected in: /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/lib/swift/macosx/libswiftCore.dylib
 in /usr/local/Cellar/bartycrouch/4.0.0/lib/libSwiftSyntax.dylib
Abort trap: 6
jb@jb-mac:~ $

Hey @seasox, I've just released version 4.0.1, which should fix the issue. I'm currently creating a PR on the Homebrew core repo so you can install the update via brew upgrade bartycrouch. This shouldn't take longer than 24 hours.
In the meantime, if you need the fix right away, you might want to try this:
brew tap Flinesoft/BartyCrouch https://github.com/Flinesoft/BartyCrouch.git
brew upgrade bartycrouch

If that doesn't work, please post the error output and try this afterwards:
brew remove BartyCrouch -f
brew tap Flinesoft/BartyCrouch https://github.com/Flinesoft/BartyCrouch.git
brew install bartycrouch

Should be fixed via 4.0.1 release. Closing.

Version 4.0.1 is now released via Homebrew Core. 🎉
Just run brew upgrade bartycrouch if you come across this issue.

@Dschee  can you elaborate on what the solution to this issue was?  I am running into the same error on a different project, and I am having trouble finding a solution.

@spencerkohan If i remember correctly, then the fix was to simply remove SwiftSyntax as a dependency since it's now included into Swift 5 directly somehow. Not sure if this helps though.

Same issue with xcode 11.5 and 4.2 version

@jassimkm Can you please provide more info about the context like your OS version, the output of swift -version? Cause I just tested with Apple Swift version 5.2.4 and macOS 10.15.4 and it worked.

I had the same issue. I have in my environment multiple Xcode versions:
➜  / ll /Applications/ | grep Xcode
drwxr-xr-x   3 marco  staff    96B Mar 10 02:56 Xcode_11.4.app
drwxr-xr-x   3 marco  staff    96B May  3 06:45 Xcode_11.5.app
drwxr-xr-x   3 marco  staff    96B Jul  2 08:35 Xcode_11.6.app
drwxr-xr-x   3 marco  staff    96B Jul 18 21:17 Xcode_12_beta_3.app

I solved creating a symbolic link to the desired Xcode version I wanted to use.
➜  ln -s Xcode_11.6.app Xcode.app

Having the following status:
➜  / ll /Applications/ | grep Xcode
lrwxr-xr-x   1 marco  admin    14B Jul 23 13:21 Xcode.app -> Xcode_11.6.app
drwxr-xr-x   3 marco  staff    96B Mar 10 02:56 Xcode_11.4.app
drwxr-xr-x   3 marco  staff    96B May  3 06:45 Xcode_11.5.app
drwxr-xr-x   3 marco  staff    96B Jul  2 08:35 Xcode_11.6.app
drwxr-xr-x   3 marco  staff    96B Jul 18 21:17 Xcode_12_beta_3.app


fix: replace datetime.utcfromtimestamp

datetime.utcfromtimestamp will be deprecated in Python 3.12
https://docs.python.org/3.12/library/datetime.html#datetime.datetime.utcfromtimestamp

Thanks @cdce8p


Fix submission of Dataflow jobs

Today, if you try to submit dataflow jobs with a mix of normal pipeline options and dataflow pipeline options, it does not get submitted correctly.
This is because cfg.command is quoted, so the final command ends up looking like this after adding dataflow_flags:
'
    python3 -m apache_beam.examples.wordcount             --input=gs://dataflow-samples/shakespeare/kinglear.txt         --output=gs://ttl-30d-us-central2/axlearn/users/remyw/dataflow/wordcount' --dataflow_service_options=enable_google_cloud_heap_sampling --dataflow_service_options=enable_secure_boot --experiments=use_network_tags=allow-internet-egress --experiments=use_runner_v2 --machine_type=n2-standard-8 --no_use_public_ips --project=abc --region=us-central1 --runner=DataflowRunner --sdk_container_image=my_container

Note the leading quote as well as the trailing quote after output=gs://ttl-30d-us-central2/axlearn/users/remyw/dataflow/wordcount'
This breaks the processing of this command, and all the subsequent dataflow_flags are ignored, so it gets run locally instead of on Dataflow.
To fix this, we just need to strip the quotes around cfg.command before adding it to our full command.

Thanks! I reformatted to fix the precommit check since it looks like it was failing


Summary projector

This PR primarily creates a simplified projector. Before this, the only projector available was the project_xarray function which is comprehensive and builds up an xarray.Dataset with data from the full run.
That is pretty heavy weight, and potentially overkill for applications when want two things:

a quick summary of a few metadata fields when presenting a list of runs
projected fields

So, this uses the same rules for selecting a projection that the xarray projector uses, but only projects metadata from the start document. It also has a parameter that allows callers to send a list of just a few fields that they want. I had support of GraphQL in mind there.
Maybe we want to add stop document info too? A summary might want to know whether runs completed and how many events they have.

I also snuck some changes for consideration into the projectors related to error handling. In previous projectors, errors found during the course of projection raised issues immediately, suspending processing and raising to the caller. This proved really difficult to deal with in a server environment. Now, the projector returns an "issues" list along with it's payload which can be interrogated by the caller. I'm a little concerned about the API breakage, but it works really well over in splash land.


feature/151_metadata

See #151

Stage tests suggests this feature works as intended:
14:11:09 -     INFO: ****************************
14:11:10 -     INFO: Number of Deposits: 1
14:11:10 -     INFO: Retrieving: 6956014 ...
14:11:11 -     INFO: Retrieving depositor_name for 6956014 ...
14:11:12 -     INFO:   Depositor == author
14:11:12 -     INFO: depository_name : Chun_Ly_6956014/v6
14:11:12 -     INFO: Creating folder : ***/curation/Chun_Ly_6956014/v6/ORIGINAL_DATA
14:11:12 -     INFO: Creating folder : ***/curation/1.ToDo/Chun_Ly_6956014/v6/DATA
14:11:12 -     INFO: Creating folder : ***/curation/1.ToDo/Chun_Ly_6956014/v6/METADATA
14:11:13 -     INFO: DOI already reserved! Skipping...
14:11:14 -     INFO: Total number of files: 1
14:11:14 -     INFO: Retrieving 1 of 1 : figshare_actions2.zip (3406)

Stage tests suggests this feature works as intended:
14:11:09 -     INFO: ****************************
14:11:10 -     INFO: Number of Deposits: 1
14:11:10 -     INFO: Retrieving: 6956014 ...
14:11:11 -     INFO: Retrieving depositor_name for 6956014 ...
14:11:12 -     INFO:   Depositor == author
14:11:12 -     INFO: depository_name : Chun_Ly_6956014/v6
14:11:12 -     INFO: Creating folder : ***/curation/Chun_Ly_6956014/v6/ORIGINAL_DATA
14:11:12 -     INFO: Creating folder : ***/curation/1.ToDo/Chun_Ly_6956014/v6/DATA
14:11:12 -     INFO: Creating folder : ***/curation/1.ToDo/Chun_Ly_6956014/v6/METADATA
14:11:13 -     INFO: DOI already reserved! Skipping...
14:11:14 -     INFO: Total number of files: 1
14:11:14 -     INFO: Retrieving 1 of 1 : figshare_actions2.zip (3406)


Onboarding : fix name field error

Error comes from text field I think : unrecognized selector sent to instance


Optimistic state preference

The Lightener instance seems to try to reflect the real state of associated lights. This on it's own isn't wrong behavior per se, but can severely affect control in the case of physical dimmer control, especially if the instance is comprised of different light types.
Events from a knob on the wall fire at much higher rate than when clicking around in the HA UI as per example GIF in the readme. When that rate collides with Lightener updating it's real state, the brightness slider will eventually start jumping all over the place.
Example:
I can be dimming a group of lights from 50% to 10% and during that attempt the brightness can go all the way up to 100%, all they way down to 0 or anywhere in between.
How to replicate:
In my case, I use the old Ikea Sonos Volume Control zigbee knob via ControllerX with repeat delay set to 100ms — that means when I turn the knob, change to brightness is triggered 10 times in 1 second. While it's default of 500ms would probably solve the issue, the experience is far from "dimmer-like".
Alternatively, clicking violently on the brightness slider (up and down) yields similar results.
Ideally, having an "optimistic" bool attribute or delay number attribute (time after which the real state of lights is updated, say, 1 second after last change), would most certainly help my case.

@jakubheglas, are you able to give a try to Lightener v2.3.0-beta.5? This is a pre-release so HACS doesn't install it by default but it gives you the option to install it ("redownload").
Several things on the Lightener logic changed, including also the way it handles changes from controlled lights.
Does it have any impact in your use case?


Odrive not obeying vel_setpoint set to stop?

As far as I can tell, the odrive isn't obeying the axis1.controller.vel_setpoint, and it moves continuously at the same speed (but will change direction on command). I've followed all the steps for the hoverboard motor instructions (as that's what I'm using), and it works fine to start the motor, but setting vel_setpoint to 0 seems to have no effect, the motor keeps spinning. axis1.controller.config.control_mode is set to CTRL_MODE_VELOCITY_CONTROL, and the state is set to AXIS_STATE_CLOSED_LOOP_CONTROL. Yet the motor keeps running continuously? what am I missing?

Hi Patronics, do you have anything set for current_setpoint?

I believe it was set to zero as well, but I'd have to double check. How should that effect things? I thought that would only be used if control_mode was set CTRL_MODE_CURRENT_CONTROL? Thanks for any help!

I just ran odrivetool dfu and updated the firmware (apparently from 4.11-dev to 4.12), and it seems like that may have fixed the issue. I still need to test a bit more with the control method I've been using, but this issue might have been resolved by the firmware update :)

Oh my yes, 4.11 is quite old.  We just released 5.1, which should get picked up by odrivetool dfu soon..


fix for TIKA-1570 contributed by michaelwda

See https://issues.apache.org/jira/browse/TIKA-1570
Add a stop method that will shutdown the watchdog process and terminate the JVM. This is useful for Apache Commons Daemon, allowing a user to define the StopClass and StopMethod. Under windows, this will allow a user to run tika-server as a windows service with correct start/stop behavior.

Any update on this?  How come it hasn't been merged yet?


Some weirdness in data having to do with Mongolia

A couple regions in Mongolia seem to be inappropriately connected to regions in other countries. Some sort of conflict or collision in the original data?

Yeah; I'm hoping this is just an error in the fake data.
On Tue, Nov 21, 2017 at 6:14 PM, John Osterman<EMAIL_ADDRESS>wrote:

A couple regions in Mongolia seem to be inappropriately connected to
regions in other countries. Some sort of conflict or collision in the
original data?

[image: image]
https://user-images.githubusercontent.com/13643664/33101755-92e41c04-cee7-11e7-9aad-d63c22cc1dbf.png

[image: image]
https://user-images.githubusercontent.com/13643664/33101785-ac529300-cee7-11e7-81b7-ca4b3e1a9902.png
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/EAPTSD/EAP-Map/issues/8, or mute the thread
https://github.com/notifications/unsubscribe-auth/AKBZdRNfa5L4IMTZLCNDQU0uYSeg8ThGks5s41k5gaJpZM4QmoOb
.


remove first six bytes of messages to account for the newest AVRO-version

Merging for test.
TODO:

update avro version


[bugfix] convert milliseconds to seconds.

Summary

convert milliseconds to seconds.

Thank you for review @minjaeli!


Is custom functions supported?

I'm building a GUI formula editor something like Excel Formulas. From the demo I noticed that this library is much like what I need. However I didn't find custom functions support, especially nested functions.  Can you tell me whether it's supported or not? Thank you.

Hi @shijistar
Sorry i'm late too much
The current version does not support complex function expressions. (IF, SUM, FOR)
Did you mean a recursive function callback that is executed at the stage of parsing a formula?
This library is built-in Parser
Check this page
Thank you.
PS. I am watching this document for a while.
If you have any questions, please let me know as soon as possible.


Question about 3D obejct detection results

Hello,mileyan!
Thanks for sharing your great code about Pseudo LiDAR and its ++ version. I am testing your output pseudo lidar on second/pointpillars and other voxel-based 3d object detection methods but found the results of them are relatively poor compared to frustumpointnet/PointRCNN and other methods you mentioned in your paper 1 and 2.
I wonder have you tested your lidar on these voxel-based 3d obejct detection methods? And how will it turn out to be finally?
Thanks a lot!

Hi, thanks for your interest. AVOD and PIXOR are voxel-based methods. We have presented the results of them in our paper. Thanks for pointing it out. I haven't got a chance to test PL on second/pointpillars. I will try PL on these models. If you have any interesting find, please let me know.

I encounter the same issues. Some popular voxel-based methods can not handle the pseudo-lidar properly with poor performance.


cache.hasFrameData ignores cache type

Usage of cache.hasFrameData suggests that you can choose your cache type, but the actual function throws away that parameter and always checks Phaser.Cache.IMAGE instead, leading to errors when trying to add animations when using a bitmapdata key.

hasFrameData doesn't have a cache parameter and it says in the docs specifically that it only checks the Image cache, so I don't believe this is an error here - however I do agree it's a useful feature, so I've added it in.


The link on about section of the repo is broken:

This one ^

It's not really clear where to find this package. Searching in the marketplace yields seemingly no hits at all.


Enhance the ui/ux look of the website

you can see the website live at opentekhub.github.io/blockchain enhance the look by following the contribution guidelines

I would like to work on this issue, please assign me

Hi, I would like to work on this issue. Please assign it to me

Make an pr

Hello, I would like to work on this issue, assign me.

Make an pr

Since this issue was not assigned to anybody, I have worked on this issue and made the PR, please review it.

Sure will look into it


pythonPackages.fs: 0.5.4 -> 2.1.1 refactor move to python-modules

Motivation for this change
#48034 .
Things done
pythonPackages.backports_os: init at 0.1.1
pythonPackages.pyftpdlib: init at 1.5.4
pythonPackages.fs: 0.5.4 -> 2.1.1 refactor move to python-modules

[X] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[X] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[ ] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[X] Fits CONTRIBUTING.md.

Requested changes have been made. Yes LC_ALL and glibcLocales did fix 36/40 of the tests. Ready for merge.

@GrahamcOfBorg build python3Packages.fs python2Packages.fs

Timed out, unknown build status on aarch64-linux (full log)
Attempted: python3Packages.fs, python2Packages.fs
Partial log (click to expand)

----------------------------------------------------------------------
Ran 764 tests in 24.257s

FAILED (failures=6, errors=344, skipped=55)
building of '/nix/store/kl0p49db2dspl4blr2il1ya7aycqjz7w-python2.7-pyftpdlib-1.5.4.drv' timed out after 3600 seconds
building of '/nix/store/pvgmwhf0h6aqcmhl5kg1wp2b6csfib3n-python3.6-pyftpdlib-1.5.4.drv' timed out after 3600 seconds
cannot build derivation '/nix/store/c5zwn1qizd5g72hvyclw7381i43pqx13-python2.7-fs-2.1.1.drv': 1 dependencies couldn't be built
cannot build derivation '/nix/store/j4p741sl4zf7mk286qg85dn0zfhrffq5-python3.6-fs-2.1.1.drv': 1 dependencies couldn't be built
error: build of '/nix/store/c5zwn1qizd5g72hvyclw7381i43pqx13-python2.7-fs-2.1.1.drv', '/nix/store/j4p741sl4zf7mk286qg85dn0zfhrffq5-python3.6-fs-2.1.1.drv' failed


Add Systemd service example

I think the systemd example in this PR no longer works with the new version of pDNS-a, as the path name has changed.  Also, it would benefit from more dependency definitions
We have this:
[Unit]
Description=PowerDNS web administration service
Requires=powerdns-admin.socket
Wants=network.target
After=network.target mysqld.service postgresql.service slapd.service mariadb.service

[Service]
PIDFile=/run/powerdns-admin/pid
User=pdnsa
Group=pdnsa
WorkingDirectory=/opt/powerdns-admin
ExecStart=/usr/bin/gunicorn-3.6 --workers 4 --log-level info --pid /run/powerdns-admin/pid --bind unix:/run/powerdns-admin/socket "powerdnsadmin:create_app(config='config.py')"
ExecReload=/bin/kill -s HUP $MAINPID
ExecStop=/bin/kill -s TERM $MAINPID
PrivateTmp=true
Restart=on-failure
RestartSec=10
StartLimitInterval=0

[Install]
WantedBy=multi-user.target

Then there is the powerdns-admin.socket and tmpfiles.d as in the supplied documentation

I created this PR before I had seen wiki so I it probably can just be closed as there's already example Running PowerDNS Admin with Systemd, Gunicorn and Nginx
Also it's just example, different distributions might install it in different locations.

Yes, please resort to the wiki for systemd unit examples.


Task: remove likely community gardens from dashboard

In order to protect community gardens from predatory development, we can remove any properties that appear in this PHS list: https://services2.arcgis.com/qjOOiLCYeUtwT7x7/ArcGIS/rest/services. It probably has to be through a spatial join because these properties don't have any OPA ID--I'll figure it out.

closed by #231


Distribute 'keyof' intersection types

With this PR we transform keyof applied to an intersection type to a union of keyof applied to each intersection constituent. In other words, we rewrite types of the form keyof (A & B) to keyof A | keyof B.
Some examples:
type A = { a: string };
type B = { b: string };

type T1 = keyof (A & B);  // "a" | "b"
type T2<T> = keyof (T & B);  // keyof T | "b"
type T3<U> = keyof (A & U);  // "a" | keyof U
type T4<T, U> = keyof (T & U);  // keyof T | keyof U
type T5 = T2<A>;  // "a" | "b"
type T6 = T3<B>;  // "a" | "b"
type T7 = T4<A, B>;  // "a" | "b"

Fixes #22291.

keyof (string & {__brand: any}) and similar intersections needs tests documenting their behavior. (Other "empty" intersections like string & number, too)

From #22286 - another test for this change:
type OptionalCommands<C extends string, T> = {[parameter in C]?: T};
type OptionalPropertyOrCommand<C extends string, T> = Partial<T> & OptionalCommands<C, T>;

class T {
    value: OptionalPropertyOrCommand<"this" | "that", T>;
    myfoo<V in keyof T>(property: V, newvalue: T[V]) {
        this.value[property] = newvalue;
    }
    myfoo2(newthing: T) {
        this.value["that"] = newthing;
    }
}


jvm-packages: nWorkers cannot be 0

according to JVM API:

def trainWithDataFrame:

the number of xgboost workers, 0 by default which means that the number of workers equals to the partition number of trainingData RDD

nWorkers can be 0 by default, however,  0 will throw exception because of code here
 require(nWorkers > 0, "you must specify more than 0 workers")

Moreover,  the number of partitions can be greater than the number of executors in Spark, and it may hang forever like #1276. Hence I don't think that it is a good choice as default value. At least for me, I prefer to use the smaller value between the number of executors and the number of partitions.
I'll open a PR later for discussion.

The issue will be resolved by another way, more details to see discuss in #2685. So I close the issue right now.


[Bug]: assist action is not working

Requirements

[X] I have updated Mushroom to the latest available version
[X] I did a search to see if there is a similar issue or if a pull request is open.

Current Behavior
After the core-2023.7.0 update, I tested the 'assist action' of #1173 on a mushroom card. but this doesn't work.
Expected Behavior
open assist from mushroom card
Steps To Reproduce
No response
Context
YAML state

Environment
- Browser: Chrome
- HA Version: core-2023.7.0
- Mushroom: v2.8.1

Anything else?
No response

The Mushroom version that support it is not released yet. It will be available soon 🙂


feat: Improve ivc bench

Makes the goblin bench more representative of the real aztec architecture.

General structure of the bench suite has been updated for clarity
Each "accumulation round" consists of a function and kernel
The first function is size 2^19 and subsequent function circuits are 2^17
Every kernel is size 2^17
Mock circuit logic now consists of "big" primitive operations, e.g. sha256, merkle membership checks etc. rather than simple arithmetic gates. (Methods for constructing these individual circuits have been moved to appropriate locations in the stdlib as discussed).
The "nominal" bench has 6 iterations resulting in 12 UGH circuits/proofs

Benchmark results
Metrics with a significant change:

batch_insert_into_append_only_tree_16_depth_ms (2): 19.0 (+70%)
node_database_size_in_bytes (5): 3,589,487 (-79%)
node_database_size_in_bytes (10): 3,624,667 (-89%)
note_history_trial_decrypting_time_in_ms (10): 444 (+158%)
l2_block_processing_time_in_ms (8): 1,401 (+21%)
l2_block_processing_time_in_ms (32): 5,289 (+21%)
l2_block_processing_time_in_ms (128): 20,903 (+21%)

Detailed results
All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call  to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.
This benchmark source data is available in JSON format on S3 here.
Values are compared against data from master at commit 1c72c0d2 and shown if the difference exceeds 1%.
L2 block published to L1
Each column represents the number of txs on an L2 block published to L1.

Metric
8 txs
32 txs
128 txs

l1_rollup_calldata_size_in_bytes
45,412
179,524
716,068

l1_rollup_calldata_gas
221,572
866,392
3,448,576

l1_rollup_execution_gas
313,991
984,064
3,668,165

l2_block_processing_time_in_ms
:warning: 1,401 (+21%)
:warning: 5,289 (+21%)
:warning: 20,903 (+21%)

note_successful_decrypting_time_in_ms
249 (-1%)
798 (-9%)
3,209 (-4%)

note_trial_decrypting_time_in_ms
60.2
123 (+23%)
143 (+4%)

l2_block_building_time_in_ms
16,137 (+2%)
64,006 (+2%)
256,187 (+2%)

l2_block_rollup_simulation_time_in_ms
11,744 (+3%)
46,642 (+4%)
186,977 (+3%)

l2_block_public_tx_process_time_in_ms
4,358 (-1%)
17,275 (-2%)
68,928 (-2%)

L2 chain processing
Each column represents the number of blocks on the L2 chain where each block has 16 txs.

Metric
5 blocks
10 blocks

node_history_sync_time_in_ms
15,977 (+13%)
30,187 (+12%)

note_history_successful_decrypting_time_in_ms
1,909 (-11%)
3,802 (-10%)

note_history_trial_decrypting_time_in_ms
132 (+3%)
:warning: 444 (+158%)

node_database_size_in_bytes
:warning: 3,589,487 (-79%)
:warning: 3,624,667 (-89%)

pxe_database_size_in_bytes
29,923
59,478

Circuits stats
Stats on running time and I/O sizes collected for every circuit run across all benchmarks.

Circuit
circuit_simulation_time_in_ms
circuit_input_size_in_bytes
circuit_output_size_in_bytes

private-kernel-init
212 (-1%)
44,681
25,561 (-2%)

private-kernel-ordering
165 (-4%)
43,753 (-1%)
14,809

base-rollup
1,198
128,338
881

root-rollup
78.9
4,088
677

private-kernel-inner
291 (-3%)
71,208 (-1%)
25,561 (-2%)

public-kernel-private-input
205 (-2%)
31,863 (-2%)
25,561 (-2%)

public-kernel-non-first-iteration
203 (-2%)
31,905 (-2%)
25,561 (-2%)

merge-rollup
7.62
2,608
881

Tree insertion stats
The duration to insert a fixed batch of leaves into each tree type.

Metric
0 deployed contracts
1 deployed contracts

tx_size_in_bytes
15,455
32,222 (-1%)

Transaction processing duration by data writes.

Metric
0 new commitments
1 new commitments

tx_pxe_processing_time_ms
376 (-2%)
1,083 (-1%)

Metric
1 public data writes

tx_sequencer_processing_time_ms
535 (-2%)

Issues I've raised with you after approving: witness construction time depends on the circuit size and not just it's upper power of 2 magnitude. You said the app circuits are close to the lower end but the kernel circuits are closer to the upper end.

Also: we ran the benchmarks together in a call, but actually we only ran one, and on further inspection I see that there is a segfault when you try to run the full suite.

Looked at your updates, look good, thanks.


Can't create a RAID on an HVM instance

Per the AWS docs:
"Hardware virtual machine (HVM) AMIs (such as the base Windows and Cluster Compute images) do not support the use of trailing numbers on device names (xvd[a-p][1-15])."
The RAID recipe compiles the disk by making device names like sdi1, sdi2, etc., so I get an error like this when trying to create the RAID:
"InvalidParameterValue: Value (/dev/sdi1) for parameter device is invalid. /dev/sdi1 is not a valid EBS device name."

We've removed the aws_raid provider so this bug is no longer valid for this cookbook. I encourage anyone that needs the functionality to take on the provider in its own codebase. As ebs_raid itself is not a core AWS service we don't see it as fitting here.


Implement :w to save notebook

That'd save me from thinking I saved when I didn't (which can bite me unexpectedly).

Agree this would be nice, I'll have to check it out but this may be blocked by #7 as well, which is blocked by JupyterLab.


Updating populated data causes multiple afterUpdates to trigger

When a model contains an associated model, a socket update using fully populated data causes multiple afterUpdates lifecycles functions to trigger. A short demonstration:
Two models:
Person.js
module.exports = {
	attributes: {
		pet: {
			model: 'Pet'
		}
	},
	afterUpdate: function(person, next) {
		console.log('updating', new Date());
		next();
	}
};

Pet.js
module.exports = {
};

A simple socket PUT:
io.socket.put('/person/1', { pet: { id: 2 } });

This will cause afterUpdate for the Person model to trigger 4 times. However, this
io.socket.put('/person/1', { pet: 2 });

will cause a single update, as expected. Essentially, submitting populated data in a PUT will cause multiple lifecycles to trigger. I would expect Person's afterUpdate to trigger once and Pet's afterUpdate to trigger once.
This is for Sails 0.10.4.

@xjpro thanks for the report, will check this out.  Keep in mind that nested updates (sending a whole update to the PUT blueprint) will probably be deprecated in the next Waterline release--they tend to cause more issues than they solve.


fix glib build problems linux-dynamic

Describe the pull request
fix glib build problems linux-dynamic

What does your PR fix? Fixes #15833

Which triplets are supported/not supported? Have you updated the CI baseline?
x64-linux-dynamic

Does your PR follow the maintainer guide?

my error


logs: add support for logs processing with the SDS shared library.

This pull-request:

adapts the log processing pipeline to support the SDS shared library for sensitive data processing
subscribes to 2 new Remote Configuration products to receive configurations for the new logs processing support
adds support for "processing tags" in the logs pipeline: at processing time, the processor can accumulate tags that are added later one to the event

The feature uses a sds Go build flag: if not set, the Agent compiles against a mocked implementation not using the shared library.
Additional Notes
The diff is a bit large but most of the new lines are either isolated in the new package, or tests/go.sum: changes to the existing part of the Agent are limited and so is the impact. That's also a reason I did not add the major_change label: it does not impact multiple teams a lot and it is not changing many things from the existing behaviour of the Logs Agent.
A following PR will adapt the build pipeline to compile the shared library, to run SDS unit tests (they need the shared library), compile the Agent linked to the shared library, and more things related to the build pipeline.
Describe how to test/QA your changes

Run the Agent in an org where this feature is enabled.
Go through the SDS configuration page / Agent and configure/reconfigure rules, make sure looking at the Agent logs that it is receiving the configuration updates and properly applying them
Collect logs matching one or several of these rules and validate the configuration actions are applied.

Ok for @DataDog/agent-developer-tools owned files (tasks)

/merge

/merge -c

/merge


DB Password in clear text in the admin api response

Summary
http://<IP_ADDRESS>:8001/ displays the admin configs. The password field: pg_password (may be cassandra_password) come back in clear text. The same fields shows up as asterisk in the console logs. I think the behavior should be the same in both places.
Additional Details & Logs

Kong version  : 0.9.3

Hi!
Sorry for the response delay, we've been quite busy today since we are hosting the 2016 Lua workshop at Mashape.
What you are referring to has been fixed in #1650, but was not released yet. sadly 0.9.3 only contains an important hotfix and Serf 0.8 compatibility. It will be part of the next 0.10 release for sure!

Awesome, thanks! Do you know the ETA for 0.10?

planning first RC by end of October


Wrong return type for sendCommand.

The return value of sendCommand is unknown, but its actual return value is buffer.

Hey @cweijan 👋
sendCommand() is intended to be an internal method so that's one reason we don't give it a detailed type. Anyway the return type of sendCommand() depends on the context, in standalone context, it's a Promise, in pipeline context, it's a Pipeline instance.

In ioredis4 I used send_command, but this method is gone.

Ok, thanks.

Thanks @luin here's how ioredis@5 works for me after refactoring away from send_command():
await redisClient.call('config', [
    'set',
    'notify-keyspace-events',
    'EKxg',
  ])


Add American Red Cross Icon and Help Icon to Damage Assessment Heat Map Checkbox

Add the American Red Cross logo between the checkbox and the word "Damage."
Add a help button with the caption, casesVue.damage_assessment_help to the right of the word "Damage."

Looks good.

On staging the red cross button has not yet been moved, and on production, it just doesn't appear. Not sure what's going on.

Approved. Ready to push to production.

It goes away when you switch incidents, and does not come back.

This works. Just waiting on @pablo014's PR to add the arrows.


[DISCUSS] Introduce TagRouter, a new route feature.

Hi, community.
This issue is related to this pull request. A simple and incomplete TagRouter implementation has been merged into dubbo v2.7.0-snapshot.In this issue，i will introduce what problem did it solve，while i want to refer to your opinion and proposal, decide the final behavior of  TagRouter .
What is TagRouter
TagRouter is a new implement of Router interface, other exsiting Router : ConditionRouter, ScriptRouter, FileRouter.
It makes any request can carry a request.tag and any service belong to a certain tag
Tag will affect the default route behavior.
Some pain points in the past

fact1: some applications changed at the same time in different branch,like A,B,C.
fact2: some applications didn't change ,but deploy repeatedly，like D,E.
fact3: if a new feature need to be tested, all 5 application need to be deployed.
fact4: isolation by feature is not friendly to parallel development.
Benefited from tag

we consider the RED，YELLOW，BLUE as tagged service , the grey block as origin service or normal service.
The benefit we have is that we have reduced a lot of overhead about application deployment. Only changed applications need deploy incrementally .
A vivid example

Usage
consumer
RpcContext.getContext().setAttachment("request.tag","red");

I suggest you can use filter or SPI to set this attachment, notice that RpcContext is bound to Thread.
provider
@Bean
public ApplicationConfig applicationConfig() {
    ApplicationConfig applicationConfig = new ApplicationConfig();
    applicationConfig.setName("provider-book");
    // instruct tag router
    Map<String,String> parameters = new HashMap<>();
    parameters.put(Constants.ROUTER_KEY, "tag");
    applicationConfig.setParameters(parameters);
    return applicationConfig;
}

Need more discussion

If a tag request can not find any application of the same tag，should it use other application of different tag (NOTICE : different tag is not the default application with grey block)
If a normal request can not find normal application，should it use any tag application?(in my opinion，normal request should not reach the tag application，also the current version).
A forceTag flag  can be considered to decided the behavior of downgrade. forceTag=true means all tag requests must strictly match the application's tag；forceTag=false means tag requests will prefer the application of the same tag，if there is no corresponding application， downgrade to other application，ignore the tag.
On the basis of 3.  what is default value of foreTag TRUE or FALSE.

more suggestions are welcome to make.

We should discuss issues in mail list.

Since the feature has been merged to master, I'll close this issue.

Have been supported in version 2.6.4?

I suggest you can use filter or SPI to set this attachment, notice that RpcContext is bound to Thread.
Hi @lexburner，the Dubbo execute order is routers-->filters, so I wonder how the tag works when the first call a provider.

I suggest you can use filter or SPI to set this attachment, notice that RpcContext is bound to Thread.
Hi @lexburner，the Dubbo execute order is routers-->filters, so I wonder how the tag works when the first call a provider.


Homebrew support

Hi! Congrats for this great work! What you think about add support to install using brew?
brew cask install pacgen

Will be great!

Hi. Thanks for your contribution. I don't have a Mac system. But if you can do that, it will be great.


Consecutive styling and skips

The following experiment uses SILE's standard book class (0.14.8), showing

vertical skips in between sectioning commands
on that occasion, what inhibiting leading in the standard book class' (sub)section does (see https://github.com/sile-typesetter/sile/discussions/1288)

The reason for using the standard book class is shows a few things we also have in resilient.book, but in a simpler way (without the styling stuff on top of that).
See exp. the 2 skips between a chapter and a section = bottom skip from chapter + top skip from section.
In resilient moreover, another similar case occurs with nested blockquotes, e.g.

Here with 2 skips at the bottom of the nested quotes (= bottom skip from inner quote + bottom skip from outer quote).
It doesn't really meet my expectations in terms of proper styling -- It would be quite doable to mark skips and detect consecutive top/bottom skips of a certain type to only use one of those where needed...
The idea is a bit similar (but not completely) to the following possibility in LibreOffice

If we don't do anything (as currently), besides the 2 skips when a chapter is immediately followed by a section header (vs. 1 skip when a chapter is immediately followed by a text paragraph - notwithstanding a potential parskip), then it seems to me there might also be an additional issue: before a section header, there's usually a "goodbreak", which may lower the penalty of page breaking here! This is obviously ok when text precedes the section header, but if the previous content was another section header (= typically, a section title immediately followed by a subsection header), this might contradict the "novbreak" expected there = resulting in a potential page break between the two headers, which wouldn't look good IMHO (I am not fully sure how the pagebuilder honors consecutive penalties, but it seems to me it will occur this way!)
There's some head-scratching topic here, how to both meet user expectations in terms of skips, and to be safe with page breaks.

It doesn't really meet my expectations in terms of proper styling

And now that I noticed it, I can't help seeing all the cases where indeed this is not meeting my expectations.
It kind of change indeed in behavior, which could be considered (slightly) breaking, but honestly the current behavior is typographically bad. Re-assert as a bug.
It's soon enough after 2.0.0 to assume it can be done now.


Avoid copying bundled ressources

I want my app to function offline, so I included the engine as a JAR based on the tutorial, with my model contained within another JAR. This setup is working well thus far.
However, I observed that it still generates the .djl.ai directory containing the model inside a cache folder, and the PyTorch engine is extracted from the pytorch-native-cpu-2.1.1-win-x86.jar to pytorch.
It would be preferable to avoid writing these files, as they essentially double the space requirements for my app installation.
I'm unsure about the process, but the project at https://github.com/JetBrains/skiko managed to keep its skiko-windows-x64.dll alongside the JAR file, referencing them without copying. I believe a similar approach could be employed for the nine DLLs representing the PyTorch engine.
The benefit is using less space on the users disk.

For of all, to load a native shared library in java, it must be file in the system. So extract to disk is a must have.
skiko is also extract to temp folder, and delete it when JVM exit, see:
https://github.com/JetBrains/skiko/blob/5b5ee682e2a1586ea53cc214960fba280d559ca2/skiko/src/jvmMain/kotlin/org/jetbrains/skiko/Library.kt#L34
Since the DJL native file are huge, we keep them in the cache folder to avoid repeatedly download. There are other desktop application using DJL. Most of them download the native library at runtime. The size of offline distribution binary size is huge (linux/mac/windows X x86_64/aarch64  X cpu/gpu).

Understood, thanks for the pointer.


Could NOT find OpenSSL

some machine have not this
if add
sudo apt install libssl-dev in readme file
that is better!

Thanks for reporting, would you mind adding such a pull request to fix that?

something is not work when step by step follows your steps,
I guess some environment are different，
but you do not write it.
---Original---
From: "Tao @.>
Date: Mon, Jun 28, 2021 09:47 AM
To: @.>;
Cc<EMAIL_ADDRESS>Subject: Re: [etcd-cpp-apiv3/etcd-cpp-apiv3] Could NOT find OpenSSL (#71)
Thanks for reporting, would you mind adding such a pull request to fix that?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub, or unsubscribe.

For more detailed settings on Ubuntu you could refer to https://github.com/etcd-cpp-apiv3/etcd-cpp-apiv3/blob/master/.github/workflows/build-test.yml.


refining menu UI for empty submenus

right now, when a submenu is empty, the parent menu item will open an empty/compressed submenu, or vertical bar (see screenshot below). This can get a little confusing in the UI, especially in cases where the submenu context is set dynamically and not known before runtime.

May be nice to add some visual indication that the submenu is empty (maybe disabling the parent menu item, or adding an 'Empty' or 'No Items' type row to the submenu that makes it clearer in the UI that the submenu is intentionally empty?)
Opening this issue to start a conversation around possible ways to refine the UI for explicitly empty/disabled submenus.
(@jasongrout and @ivanov for awareness)

I like this as a general idea.
For what it's worth, you could possibly implement this yourself right now with a custom Menu.IRenderer.


Changing the title updates the slug

Trello

Changing the title updates the slug only for documents that have never been published

Alters base_paths in test data as they differed from the document title causing test failures

Looks good. It seems to be that we have the case covered where the title changes in draft. Would it be worth adding a feature test for the case when the title does not change after it has been published? That might be one test or potentially more for each of the states.
What do you think?

Looks good to me. I like the idea of adding a check for a;ready published documents not changing

@tuzz @Seraphiana Thanks! Have added a test which checks that the base path is not updated for published and unpublished documents.


where example code?

Trying to figure out myself how to use it. @miduga Could you please provide some information? I tried:
import ReactSlidy from 'react-slidy'
...
<ReactSlidy>

</ReactSlidy>

But only the first picture shows up, without any control. It is like a static image. Though I see the structure in the HTML file. Is there a function or something one has to call to initialize it? Thanks

Hi guys! I'll work this weekend on the slider in order to fix the demo page and also fixing some issues. I'll let you know :)

Hi guys! Working on the new slider with a URL with the demo: http://react-slidy-demo.surge.sh/

@balazsorban44 Did you ever figure out how to import this, or get it working in general?

Hi @schuylermk, I went with react-slick instead

Hey guys! Just pointing that the docs are live now! https://react-slidy.midu.dev


cannot load such file -- redcloth

This is a new project with:
ruby 1.9.3p194 (2012-04-20 revision 35410)
Rails 3.2.9
The gem file has, among others:
gem 'irwi', :git => 'git://github.com/alno/irwi.git'
gem 'haml-rails'
I added the gem, did the migration and then tried to create the first page.  The editor came up just fine but then when I tried to save I got:
=========================================
ActionView::Template::Error (cannot load such file -- redcloth):
6: <%= wiki_page_actions %>
7:
8:
9:   <%=wiki_content @page.content %>
10:
activesupport (3.2.9) lib/active_support/dependencies.rb:251:in require'   activesupport (3.2.9) lib/active_support/dependencies.rb:251:in block in require'
activesupport (3.2.9) lib/active_support/dependencies.rb:236:in load_dependency'   activesupport (3.2.9) lib/active_support/dependencies.rb:251:in require'
/home/mdoering/.rvm/gems/ruby-1.9.3-p194/bundler/gems/irwi-df0c21c14b33/lib/irwi/formatters/red_cloth.rb:4:in initialize'   /home/mdoering/.rvm/gems/ruby-1.9.3-p194/bundler/gems/irwi-df0c21c14b33/lib/irwi/config.rb:19:in new'
/home/mdoering/.rvm/gems/ruby-1.9.3-p194/bundler/gems/irwi-df0c21c14b33/lib/irwi/config.rb:19:in formatter'   /home/mdoering/.rvm/gems/ruby-1.9.3-p194/bundler/gems/irwi-df0c21c14b33/lib/irwi/helpers/wiki_pages_helper.rb:42:in wiki_content'
=========================================
It looks like redcloth is not happy with the erb file?  Any thoughts?
Thank you

Rewrited README section so it should be more clear. Also, now (still on master) formatter is automatically detected based on gems loaded.


Searching and replacing with regular expressions

There isn't any example on how to use tagged values when searching and replacing with use of regular expressions.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 5d570cd4-8dc2-f840-2693-8af14ed7da13
Version Independent ID: 6e3d0508-081e-e4dc-3510-753320c5a660
Content: Find and Replace - SQL Server Management Studio (SSMS)
Content Source: docs/ssms/scripting/find-and-replace.md
Product: sql
Technology: ssms
GitHub Login: @markingmyname
Microsoft Alias: maghan

@rzeq -- Rafal, thank you for your feedback.  Please see this page:  Search Text with Regular Expressions, and consider these resources:

SQL Server on Microsoft Q&A
DBA Stack Exchange
Stack Overflow

@markingmyname -- please look into this issue.

@rzeq
First, we apologize for the late response.
Second, are you referring to info such as on this article? - https://docs.microsoft.com/en-us/sql/ssms/scripting/search-text-with-regular-expressions
Please advise.
Thank you.

@markingmyname
Yes, indeed. I think it would be very helpful with some examples there, including replacing strings with tagged values.
This RegEx implementation varies from other standards and if someone doesn't use it too often can struggle with finding correct syntax or in the end not using search and replace since it takes so much time to figure out. Also finding anything on SO and other sources is hard because you get a lot of other RegEx examples and few from Search And Replace dialog.

@rzeq Hello, I'm looking into the regex articles with Mark, and I'm wondering if this topic still applies to the most recent releases of SQL Server Management Studio. I ran a test from the article here:

But "zo{1}" matched Alonzo2 in addition to Alonzo1, which was not the behavior in the article. @Matteo-T could you verify whether SSMS is still using the regular expression syntax documented in Search Text with Regular Expressions. See the NOTE about the differences in regular expressions and my test in the above screenshot. I was using 18.5 of SSMS. #reassign:rothja

I'm using SSMS 18.6
As side note, I've been using SSMS VS on and off for 15 years now and can never remember what syntax is where. Although I understand that for historical reasons it might be hard to implement/change existing behavior but I wish RegEx implementations would use the same syntax in VS, VSCode, SSMS as well as .NET and SQL. Switching between all those standards is highly inconvenient.

I would imagine that the behavior observed in SSMS 18.x should match the behavior in Visual Studio 2017, since SSMS is based on the VS 2017 Shell. Is this not the case?

@Matteo-T This is why I think the docs might be outdated for the SSMS dialog. Take a look at the VS 2017 help for find-and-replace using regular expressions, and you'll see this statement about curly brace usage:

But in the SSMS documentation, it states that the find-and-replace has a different usage for the curly braces:

It doesn't look like SSMS uses tagged expressions with the curly braces anymore. Maybe the article should just refer the user to the Visual Studio 2017 help for detailed syntax and just provide a few examples with SQL regular expressions in this article?

@rzeq You have a great suggestion about standarizing the regex flavor in our tools!

@rothja - yeah, it looks like @rzeq's suggestion is going to be a nice push for us to cleanup our documentation. Or, at least, we should warn the users that some of that stuff applies to "really old versions of SSMS" which some users may still be using [and while at it, we should remind them to move forward].
I like the idea of using the general VS2017 topic and avoid unnecessary replication of information: few examples, in the context of T-SQL, would be enough.
My Team and I will be happy to review the PR.

Thanks, Matteo! I'm going to assign the git issue to you, but I am free to help and I know @markingmyname is as well. If there are quick changes we could make to inform the readers, maybe we should do that, close out the issue, and create a work item to more extensive suggestions in the future. Note that there are two articles involved (maybe more?):

Find and Replace - SQL Server Management Studio (SSMS)
Search Text with Regular Expressions

@rzeq Rafal, thanks for filing the issue and bringing the need to refresh these docs to our attention! #reassign:Matteo-T

@rothja Thank you Jason, Matteo and  Mark for taking action.

Temporarily added the extra row @Jason mentioned in the article.
As @rothja mentioned, we will reevaluate these articles at a future date.
Thank you, @rzeq, for bringing this to our attention.

We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion, and we will reopen the issue. To see what the community is wanting, please visit the SQL Server User Feedback site.


Multistage docker builds

Multistage docker builds for Go are considered best practice. Typically the destination image does not contain the Go SDK. This example includes single stage Dockerfiles... Does this mean one should maintain two Dockerfiles (dev & prod) when taking advantage of Tilt's live update functionality?

Good question! There's two common setups we see:

You include the entire go toolchain in your destination image, so that Tilt can do the live-update in-image.

You cross-compile the Go static binary, and then copy the static binary into the image

(1) is the easiest to get started with, which you can see in this example. If you use a multi-stage docker build, you can tell Tilt to do docker_build(target='the-target-with-the-go-toolchain') to get the right stage.
(2) takes a bit more expertise. Here's a good project that demonstrates a static binary approach for building Docker images: https://github.com/thockin/go-build-template
To do this with Tilt, you create a local_resource that compiles the static binary, and use live_update to sync the static binary into the container.
Hope that helps! It can be a bit hard to get your head around the different options and trade-offs involved; it depends a lot on how you're willing to trade complexity for a faster dev loop.

Does this mean that I need to use a separate Dockerfile for Tilt development?

we now have an official Go guide, that shows best practices for Tilt with Go
https://docs.tilt.dev/example_go.html
The approach described there should work with multi-stage dockerfiles.
It might make sense to delete this repo


Blank jfrog-cli.conf causes concurrency issues

Summary of the Issue
Our team has noticed a large number of errors from the cli along the lines of:

access denied
can not access file because it is in use by another program
(might be 1 more variant, but you get the idea)

These errors seem to occur more frequently when our build servers are under heavy load.  Additionally, with the blank jfrog-cli.conf we notice that the "last modified" time is updated after every single exe invocation.
System Information:
OS - Windows
CLI Version - 1.13.1
A blank jfrog-cli.conf
relevant env vars:

JFROG_CLI_OFFER_CONFIG = false
JFROG_CLI_HOME = default

Workaround Implemented
We provided a valid cli config and the issues appear to have subsided.  Additionally the file is no longer updated after every invocation of the exe.
Root Cause Best Guess
After poking around the source a bit it seems that if for any reason the cli pulls a partial or invalid or blank config it will attempt to write back out a blank configuration file -- even if the exact same file already exists.  While the behavior in isolation isn't particularly offensive, in an environment where the exe is being aggressively called (such as a build server) it seems to run into issues.  It seems that if the cli attempts to write out a conf file while there is already another instance of the process running an error will (rightly) be thrown.
I could see an argument that this isn't really a bug,  it's poor behavior on the end users.  However, I would contend that as this is the "out of the box" configuration of the cli,  it should support multiple concurrent invocations without further configuration.  If it is decided that the current behavior is correct, it would be nice to update the documentation to indicate that high performance environments must be configured to avoid contention issues.

Thank you for sharing @el-gee.
This is definitely something we want to improve. We'll try to come up with an improved approach for managing the jfrog-cli.conf file. We'll share here the details soon.

@el-gee,
The code has been  further improved in version 1.19.0, to completely prevent this concurrency issue.
Please let us know if the latest release resolves the issue.


API for the license submittal feature

API for the existing license submittal feature.

@techytushar @goneall I have added the API for the license submittal feature. It would be really great if you guys could try and give your feedback. Although, the first ever time implementing is a lot of steps(i know) but only for the very first time registering.

Firstly, I use firefox as my browser if you have firefox as well then just download the geckodriver and put it into PATH. And if you use chrome then change the line 536 in views.py to browser = webdriver.Chrome() and then download the chrome driver for your browser from here. finally, set it in PATH variable using export PATH=$PATH:$PWD/geckodriver.
make sure to install the requirements again(possibly in a venv) using pip install -r requirements.txt
create a superuser using python manage.py createsuperuser then runserver and go to admin then, create a new application by going to the Add application section. Copy the client id and client secret of the app and paste it in secret.py file under getOauthToolKitAppID and secret and fill the other details of the app as follows:
User: <admin you created>
client type: confidential
authorization grant type: resource owner password based
and SAVE the app.
While the server is still running just paste the below command in the new tab of the terminal and it will open your browser and ask you for your github credentials inorder to authorize the app. It then generates a authentication code which is used to generate a access token for github to access github api.
curl -X POST http://localhost:8000/api/submit_license/ -F 'fullname=<your-fullname>' -F 'shortIdentifier=<your-identifier>' -F 'licenseAuthorName=<license-author>' -F 'userEmail=<your-email>' -F 'text=<text>' -F 'osiApproved=<osi>' -F 'sourceUrl=<url>'

@Ugtan If someone wanted to use the API from their server based application, would they need to interactively enter credentials in a web browser?

@goneall This was one of my concerns and I have spent a lot of time finding a solution for the same. The only reason for doing the same is to ensure the user doesn't have to hardcode their credentials along with the API request and it is a bit safer if I could say this as GitHub is involved. Let me know your thoughts. Also, just to mention I have followed this tutorial for the whole OAuth process.

Its showing me this error, when I log into my GitHub account on the webdriver, do we have to add something to the redirect_uris while creating the django application? When I check the Access Tokens section I see tokens generated there.

Its showing me this error, when I log into my GitHub account on the webdriver

The state parameter is actually not required it is just an unguessable random string used to protect against cross-site request forgery attacks as mentioned here. And it shouldn't affect the working on the working of the API.

You have commented a line in the views.py file, which defines state, is that creating the problem?

Yes, it wasn't required but I will still include it and will update the branch tomorrow. Also, did you get the response like " the license was submitted successfully" after entering the curl command? @techytushar

Nice work with the code and documentation @Ugtan , I have left a few comments on some minor issues that I found out, I would like your feedback on them. Also yes I was able to submit a license using the API and received the message Success! The license request has been successfully submitted. Before I was closing the webdriver window as soon as that error appeared but this time I waited for a while and it made the license submission.
@goneall The licenses submitted using the API, should they also appear on the app/license_requests/ page ?

Nice work with the code and documentation

Thank you so much :) @techytushar

Before I was closing the webdriver window as soon as that error appeared but this time I waited for a while and it made the license submission.

I will definitely improve it.

The licenses submitted using the API, should they also appear on the app/license_requests/ page ?

I think it should IMO. Good point tho.

Hello, I have updated the branch with the requested changes as well as added some tests for the license submittal feature.
The API now uses the approach as suggested by @goneall. So, the user will have to go to http://github.com/login/oauth/authorize/?client_id=<github-client-id> copy the authentication code from the URL query string into either the cURL command or into the secret.py file(for tests) under getAuthCode. I have also updated some of the dependencies so just make sure you run the pip install -r requirements.txt again. I have also run the tests locally, you can see the SC. Also, as suggested by @techytushar, license submitted by API will appear on the license requests from now. Let me know you guys feedback on the improved version of the API. It took me a lot of time then I have anticipated but I really hope you guys like the final product.

The code changes look good to me.

So, the user will have to go to http://github.com/login/oauth/authorize/?client_id= copy the authentication code ...

We should add this to the documentation.  There's an API section at the end of the README file.

I ran into some problems migrating the DB.  After updating the requirements, I ran makmigrations and migrate.  I got the following warning:
WARNINGS:
?: (rest_framework.W001) You have specified a default PAGE_SIZE pagination rest_framework setting,without specifying also a DEFAULT_PAGINATION_CLASS.
        HINT: The default for DEFAULT_PAGINATION_CLASS is None. In previous versions this was PageNumberPagination. If you wish to define PAGE_SIZE globally whilst defining pagination_class on a per-view basis you may silence this check.
Operations to perform:
  Apply all migrations: admin, api, app, auth, contenttypes, oauth2_provider, sessions, social_django
Running migrations:
  Applying api.0003_auto_20190609_1535... OK
  Applying app.0008_auto_20190609_1535... OK
  Applying oauth2_provider.0005_auto_20170514_1141... OK

When running the test, I got the following:
  File "manage.py", line 22, in <module>
    execute_from_command_line(sys.argv)
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\core\management\__init__.py", line 364, in execute_from_command_line
    utility.execute()
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\core\management\__init__.py", line 356, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\core\management\commands\test.py", line 29, in run_from_argv
    super(Command, self).run_from_argv(argv)
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\core\management\base.py", line 283, in run_from_argv
    self.execute(*args, **cmd_options)
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\core\management\base.py", line 330, in execute
    output = self.handle(*args, **options)
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\core\management\commands\test.py", line 62, in handle
    failures = test_runner.run_tests(test_labels)
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\test\runner.py", line 601, in run_tests
    old_config = self.setup_databases()
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\test\runner.py", line 546, in setup_databases
    self.parallel, **kwargs
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\test\utils.py", line 187, in setup_databases
    serialize=connection.settings_dict.get('TEST', {}).get('SERIALIZE', True),
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\db\backends\base\creation.py", line 69, in create_test_db
    run_syncdb=True,
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\core\management\__init__.py", line 131, in call_command
    return command.execute(*args, **defaults)
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\core\management\base.py", line 330, in execute
    output = self.handle(*args, **options)
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\core\management\commands\migrate.py", line 204, in handle
    fake_initial=fake_initial,
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\db\migrations\executor.py", line 115, in migrate
    state = self._migrate_all_forwards(state, plan, full_plan, fake=fake, fake_initial=fake_initial)
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\db\migrations\executor.py", line 145, in _migrate_all_forwards
    state = self.apply_migration(state, migration, fake=fake, fake_initial=fake_initial)
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\db\migrations\executor.py", line 244, in apply_migration
    state = migration.apply(state, schema_editor)
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\db\migrations\migration.py", line 129, in apply
    operation.database_forwards(self.app_label, schema_editor, old_state, project_state)
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\db\migrations\operations\models.py", line 97, in database_forwards
    schema_editor.create_model(model)
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\db\backends\base\schema.py", line 319, in create_model
    self.execute(sql, params or None)
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\db\backends\base\schema.py", line 136, in execute
    cursor.execute(sql, params)
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\db\backends\utils.py", line 64, in execute
    return self.cursor.execute(sql, params)
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\db\utils.py", line 94, in __exit__
    six.reraise(dj_exc_type, dj_exc_value, traceback)
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\db\backends\utils.py", line 62, in execute
    return self.cursor.execute(sql)
  File "C:\Users\gary\git\spdx-online-tools\venv\lib\site-packages\django\db\backends\sqlite3\base.py", line 326, in execute
    return Database.Cursor.execute(self, query)
django.db.utils.OperationalError: table "app_licenserequest" already exists

I ran into some problems migrating the DB. After updating the requirements, I ran makmigrations and migrate. I got the following warning:

I don't think that warning has anything to do with the error you are getting. The warning is generated due to changes in the django rest framework (3.6.1 ~> 3.9)
Also, I am not able to replicate the error you are getting. Just curious are you using --keepdb flag while running the tests? cuz whenever we run the tests django creates a blank database which has no scope of a table being exists already or else there may be an error in the migration file.
If you want to run the submit license API tests just try running python manage.py test api.tests.SubmitLicenseModelsTests and if you still get the same error just lemme know. @goneall

Just curious are you using --keepdb

No - just running test.  It is probably a problem with my local environment and not a problem with the recent code changes.  I see this is passing the Travis build.  I'll try to debug it later this week.

It is probably a problem with my local environment

Probably cuz it is working for me, Although we can wait for @techytushar to confirm. Also, just let me know if you face any of the issues while debugging. For now I think I should move on to the next task.

We should add this to the documentation. There's an API section at the end of the README file.

Also, I will update the documentation soon. @goneall

Yes, the tests are running fine for me and also I am able to submit the license using the API. Nice work so far!!

@techytushar @goneall I just wanted to make sure everything is fine and working. Thanks for the update.

The warning that is being showed up is due to the changes in the new version of DRF, IMO this should be an easy fix.

Yeah. I will make a commit to fix it as soon as we are done with this.

Nice work so far!!

Thank you so much 😊

@goneall @techytushar I have added the documentation for the API as well. Please take a look at it. Thanks

@Ugtan Looks good - nice work.
@techytushar Just confirm it looks good to you and I'll merge.

@goneall @techytushar I have updated the documentation with the suggested changes. Please have a look.


Admin user documentation needs GRANT OPTION

This issue is being filed by Ben from Abby's machine, where we discovered the problem.
Where the documentation currently reads:
CREATE USER 'foobar'@'localhost' IDENTIFIED BY 'mysecret';
GRANT ALL PRIVILEGES ON *.* TO 'foobar'@'localhost';
FLUSH PRIVILEGES;

It seems it should reflect also granting GRANT privileges or the build will break at the end.
CREATE USER 'foobar'@'localhost' IDENTIFIED BY 'mysecret';
GRANT ALL PRIVILEGES ON *.* TO 'foobar'@'localhost' WITH GRANT OPTION;
FLUSH PRIVILEGES;

Fixed: https://github.com/Bookworm-project/BookwormDB/commit/037bd716525ce076a49d73f2b1d9464d5ece2e89


Add a new transform for enums?

Hi Matthew,
It would be great to have support for enums as well in JSONTransformer.
Great work!

I don't believe we can add a transformer for all enums unless maybe they conform to a certain protocol. Do you have a sample for what you might want that to look like?

On Oct 5, 2015, at 4:52 PM, Greg Gentling<EMAIL_ADDRESS>wrote:
Hi Matthew,
It would be great to have support for enums as well in JSONTransformer.
Great work!
—
Reply to this email directly or view it on GitHub.

Maybe string enums, below is what I implemented.
public enum TemperatureFormat: String {
case Automatic, Celsius, Fahrenheit
}
public init?(JSONDictionary: [String : AnyObject]) {
do {
celsius = try JSONDictionary.decode("celsius")
fahrenheit = try JSONDictionary.decode("fahrenheit")
format = try TemperatureFormat(rawValue: JSONDictionary.decode("format"))!
}
catch {
print(error)
return nil
}
}

You can now use enums (without a transformer!)


tarmac-profile crashes on windows side for large Tarmac files

I build the binaries on Windows using visual studio 2017 as mentioned and when i try to get the profile information for large tarmac trace files (>1.5GB), the tools crash during indexing and it refers me towards this line: https://github.com/ARM-software/tarmac-trace-utilities/blob/main/lib/calltree.cpp#L247
I would like to understand if there is a limitation on how big the trace file can be?

I'm sure it's possible to create a tarmac file large enough to exceed what tarmac-trace-utilities can cope with, but 1.5GB does not seem that big to me, and I believe I've successfully indexed files larger than this, but this was on Linux or MacOS platforms --- I have not tried Windows. Have you been able to index smaller tarmac traces ? Would you have a chance to use a linux build of the tarmac-trace-utilities on the very same 1.5GB tarmac trace to compare ? The problem could come from types like "int" having a different size on Windows vs Linux.

I tried to index smaller files (<500MB) and that seems to work fine. I just tried the larger tarmac file on WSL and i get the same assertion failed error triggered from this line: https://github.com/ARM-software/tarmac-trace-utilities/blob/main/lib/calltree.cpp#L249

I think the problem is the use of off_t that is 32-bits on MSVC, and it seems to be used everywhere
It should probably be changed to int64_t

FWIW, I'm running this on MacOS, where off_t happens to be 64-bits --- and everything seems to be working just fine. I'll do a test with a large tarmac trace to confirm it solves the problem. I have a patch almost ready if it just works.

I've pushed a patch (eb710a613ac8ae325bdbb06cec2d1f6865deeb76) that improves large Tarmac file support. I would be very interested in getting feedback from the Windows / WSL platforms which I have no way to test. For the platforms I've been able to test (MacOS, Ubuntu), tarmac-trace-utilities happily deals with 5.8+G bytes Tarmac trace files.
Switching off_t to int64_t may not always be a solution, because off_t is used both as a file offset and a pointer offset as the index files are memory mapped at some point. This implies that we can only use 64-bit file offsets when the platform actually has 64-bit pointers as well.

Sorry for the delay, i will have a look into it in the upcoming days and get back to you

Thanks a lot four your feedback, I'll close this issue.
You're not missing any magic option --- index files are large indeed unfortunately.