chore: Temporarily disable ingress rules for GraphQL

While debugging APIM, allow direct access to service container

#1113


Feature/541 skeleton loader

👋 Thanks for creating a pull request! 🚀 Checkout the storybook we've created for it: chlorophyll


Jpostcode::Address.zip_code is not set

I am using latest version of jpostcode-rb in my product.
I noticed that I could not get Address.zip_code so I fixed it.
[126] pry(main)> a = Jpostcode.find("1500022")
=> #<Jpostcode::Address:0x00007fe3d04f4c80 @city="渋谷区", @city_kana="シブヤク", @office_name=nil, @office_name_kana=nil, @prefecture="東京都", @prefecture_code=13, @prefecture_kana="トウキョウト", @street=nil, @town="恵比寿南", @town_kana="エビスミナミ", @zip_code=nil>

[127] pry(main)> a.zip_code
=> nil

@nishio-dens thx!

released 0.1.11


How do I prevent users from logging on on multiple devices at the same time?

I've looked around for a bit and can't find out how to do this in Unity using Firebase. Is there any proper way to manage sessions/ensure that a user can only be "logged in" and "playing the game" on one device at a time? E.g., if they are signed in on their phone playing the game, they shouldn't be allowed to grab their tablet and log into the game on that same account.

If you could find deviceID by any means. You could do that system by yourself using the realtime database
Simply put. You would have your client set a database with there userID paired with deviceID. After that, any interaction with your system must also checking with the only one deviceID of that user, else reject it

@Thaina Thanks for the post. Unfortunately, this wouldn't quite do the trick. Because what if the user doesn't log out on their one device but doesn't have the app open, or, for example, the app crashes while they're playing and they couldn't log out of the app. They would be forced to open up the app on their old device, manually log out, and only then they would be able to play on their new device. What you suggest could be done with setting a simple "isOnline" flag in the database when they boot up the app, but in the case, they don't manually log out of the app and I send an "isOnline = false" they would NOT be able to log in on their other device. I'm sure you see the issue.

@exzizt There are 2 ways, one is, instead of trying to protect logged in from multiple device, you just logged out every device when any device logged in. That would be easier
Second is having timestamp and let it able to changed after some timeframe, 1 minute for example, and having your device periodically change timestamp

@Thaina Unfortunately these two approaches also won't work.

Nearly all apps I can think of don't use this approach because it is unfair to boot a device from playing just because another device wants to sign in. This can cause a "booting battle" if people share the same account. Again, the proper and desired approach is to deny the user from logging in if they are already playing the game on a different device--not booting the player off who is playing minding their own business just so the person who wants to sign in can play.
The only annoying issue with this approach is even if one device turns off, the second device will not be able to log in until say the minute has passed, even though the other user stopped playing.

@exzizt 1st approach, you wrong. I have seen so many online game do that. Any double logged in will result in both failure from trying to cheat. And if you got this double logged in you should contact provider
2nd approach, I know and that why I write the 3rd solution. It more complicate than 2 though so it's up to you

@Thaina What do you mean contact provider? Sure I guess some do implement this--however it shouldn't be thought of as "cheating" automatically. It could be a harmless mistake and have no "cheating" impact on the game, e.g., one sibling is playing the game on their iPhone while their younger brother tries to sign in and play on the same account on his iPad. It's just a harmless mistake, and the person currently playing should take priority (i.e., they are not booted).
What's your third solution?
If there's no API for figuring this out via Google Play Services/Firebase I guess the best "roll-your-own" approach would be to do something with timestamp checking.


reverting back to minor

the change is breaking. so creating the major release version

@calvinmetcalf please help and review

#41 will be resolved due to this

closing this in favor of #41

@calvinmetcalf #41 suggestion is only a work around.


simple-mtpfs 0.2.1

Created with brew bump-formula-pr.

$ sudo brew cask install osxfuse
Error: Running Homebrew as root is extremely dangerous and no longer supported.
As Homebrew does not drop privileges on installation you would be giving all
build scripts full access to your system.


Browser Picker

Browser picker so you can have rule-based default browsers
This is something I've wanted to write, but just haven't had time to do so. I originally considered this a store app, but I think PowerToys is a much better fit because this is more of a power user thing.
Many of us use multiple browsers so we can keep cookies separate. Most apps, however, want to launch just the default browser. In apps that support it, right now, I have to right-click and copy the URL and then paste it into the browser I want to use. That's clumsy.
Instead, it would be great to be able to set up rules for which browser to open. For example:

Links from app  (example: Outlook, or VS Code, or Terminal) always open in browser
Links to domain  (example: outlook.com, or localhost) always open in browser
Links from app  or domain  always prompt for the browser
Would include protocol handling in there as well
And you can set a fall-though, which becomes your new effective default browser for when no rules apply. That default may be to prompt.

The browser would be an actual browser on the system, and also options like inprivate/incognito as appropriate.

Proposed technical implementation details
The Browser Picker would be registered as the default browser. It would apply the rules and, if there's a match, open the browser selected. No UI needed in this case.
There would also need to be either a config UI, and/or a well-understood JSON file with the rules.
If no match, the default could be to use a specific browser, or to prompt.

You pretty much described - in detail - a wish I have had for quite a long time now.
Probably redundant, but in my words: I use an MS/outlook account for my "business" things (like work, financial stuff et cetera) and a Google/Android account for personal stuff. I also want to use the apps from each company - as much as possible - for the corresponding things. I would like to be able to control the browser for (links to) certain domains/websites. So, having MS Edge as the default browser on my PC, it would be nice if links to a personal list of domains will automatically open in Google Chrome. Or Firefox.

Not a solution, but if there are certain website you often use and would rather open in a non-standard browser, you can turn some of them into a browser-app. That way you can open it from Start menu - or anywhere else.

Is this much different from #3982 ?

@gmyx Are you still interested in contributing with the solution you made?

Yes, but it will take a long time to do anything. The current tool is written in VB.Net. A lot of work is needed to convert.

Not just the Web Browser, email also (and probably others)...
As an end user, it's great to have a UI/functionality that gives us the ability to select a default app for things like emails, web browsers, videos, music, etc., but there scenarios where there's multiple apps:

Web Browser

UI Testers have to test the handling of hyperlink to different browsers.
MS Teams runs apps like MS Planner and OneNote within MS Teams, with the ability to "Open in Browser", I use Edge for displaying Office/Azure stuff and Chrome for software development
Edge offers multiple profiles, it would be nice to have choose which profile to run (mm this should probably be a separate feature request). It would be useful for UI Testers:

Open in Edge Profile - English
Open in Edge Profile - French
Open in Edge Profile - Developer

Email

Since the pandemic, more and more people are working from home and their PC is used for personal and for work. Clicking on a "send email" button from an app would be work vs personal related.

Not just the Web Browser, email also (and probably others)...
As an end user, it's great to have a UI/functionality that gives us the ability to select a default app for things like emails, web browsers, videos, music, etc., but there scenarios where there's multiple apps:

Web Browser

UI Testers have to test the handling of hyperlink to different browsers.
MS Teams runs apps like MS Planner and OneNote within MS Teams, with the ability to "Open in Browser", I use Edge for displaying Office/Azure stuff and Chrome for software development
Edge offers multiple profiles, it would be nice to have choose which profile to run (mm this should probably be a separate feature request). It would be useful for UI Testers:

Open in Edge Profile - English
Open in Edge Profile - French
Open in Edge Profile - Developer

Email

Since the pandemic, more and more people are working from home and their PC is used for personal and for work. Clicking on a "send email" button from an app would be work vs personal related.

Check out this solution: https://github.com/mortenn/BrowserPicker by Morten Nilsen
Would make a great additional to PowerToys 😀

@daltskin Morten's project is a good start, for sure. Thanks for bringing it up here :)

Since the pandemic, more and more people are working from home and their PC is used for personal and for work. Clicking on a "send email" button from an app would be work vs personal related.

People should keep work and private things apart as much as possible.  :)

@Jay-o-Way , cc @gmyx
I would love to work on this power toy, if currently none are working on this.
I already have a similar project - Hurl. Supports a few of the features from mentioned projects.

@crutkas , @Jay-o-Way , cc @gmyx
I would love to work on this power toy, if currently none are working on this.
I already have done a similar project - Hurl. Supports a few of the features from mentioned projects.

@U-C-S I have seen your Hurl project, nice one and I have some additional request, for example ability to pick different Chrome profiles automatic instead of having them in a setup file.  Anyway it would be nice to have everything inside this Powertoys app instead.   So I would love to help out on this :-)

for example ability to pick different Chrome profiles automatic instead of having them in a setup file

Yeh, Im currently working on that for Hurl
About this powertoy, Im still open to work on it, I was previously waiting for maintainer's reply (and my laptop upgrade, which is done recently). For now, I'll experiment with this repo and see how if full integration with Hurl is directly feasible (im very much new to this)

Hi @U-C-S I'm sorry we have missed your offer for collaboration. I will add @jaimecbernardo and @crutkas

It's actually harder than you think, especially if you want to detect browser profiles of different browsers, and not just the browsers themselves. Add massive implementation differences between Chrome-based ones, Firefox etc. Try https://www.aloneguid.uk/projects/bt/

I found these similar (closed-source) utilities today, maybe they'll be helpful for the folks implementing this feature.

https://switchbar.com/en/
https://choosy.app/

@crutkas @jaimecbernardo have you contacted @U-C-S ? If not, please do.

Looking at Hurl from @U-C-S . Thanks for the collaboration proposal. Looks like it's basically setting itself up as the default browser in the machine. I suppose this could be a PowerToys where when enabling, it would set itself as a selectable browser (possibly would require user interaction too). @crutkas , is this something that would make sense in PowerToys?

Hi. If you are interested in parsing profiles of chromium based browsers and profiles and containers of firefox based browsers you can check out some source from my repository https://github.com/Browsers-software/browsers
It doesn't have Windows support right now but that part should be same between platforms.
If you are really interested, I'd consider making rust crates just for parsing this info out of popular browsers, so everybody benefits. Not sure if you want to integrate with rust though.
Cheers,
Madis

I would LOVE this! I do work for my primary company, and also for our sister-company. Each company has it's own TFS/AzureDevOps account. But whenever I click a notification link in a TFS email, it always wants to go to the default browser (of course).
However I use different browsers for each company, like stated above, for keeping cookies/logins separate, so I don't need to keeping logging out of one and then into the other.
It would be amazing to be able to set up system-level rules like
if URL matches "https://company1.visualstudio.com/" then open in Firefox
if URL matches "https://company2.visualstudio.com/" then open in Edge

@U-C-S

I would love to work on this power toy, if currently none are working on this.
I already have done a similar project - Hurl. Supports a few of the features from mentioned projects.

Hurl looks beautiful! And with the addition of the auto-launch rules you're currently working on, it sounds like it would already be the perfect drop-in for this tool-request. Just bring it inline with whatever PT common code is needed, and BAM - Done! 😎

+1

This applies to files too. If I have multiple image editors/viewers installed I would like to be able to configure rules based on the image file path. I use 'Always Ask` app that I wrote myself. It currently does not have rules and only works with web links. I plan to extend it to all files when I have time.

+1

+1


(18)+NEW~VIRAL@X.X@S.E.X@VIDEOS]*Anu Kanu Video Original Video Link TikToker Anu Kanu Video Viral On Social Media X Trending Now #269 #1878

12 seconds ago Anu Kanu L𝚎aked Video TikToker Viral Original Dark Video Viral Video
Anu Kanu FULL VIDEO Video Link Original Short Clip Viral Video X Telegram Link
Watch 🟢 ➤ ➤ ➤ 🌐 Click Here To link (Full Viral Video Link)
🔴 ➤►DOWNLOAD👉👉 (Full Viral Video Link)
Watch 🟢 ➤ ➤ ➤ 🌐 Click Here To link (Full Viral Video Link)
🔴 ➤►DOWNLOAD👉👉 (Full Viral Video Link)
An obscene video of another internet personality, emerged which went viral on social media drawing criticism from netizens.
Artist Involved in Viral Nude Video The entertainment world often makes the lives of children of musicians or artists often in the public spotlight.
Especially when one of them is involved in a scandalous video and its aroma comes to the surface.
Not only female artists, but also male artists have been involved in the scandalous video.
Whether intentionally or not, the circulation of this video has made social media busy until netizens hunt it down.
Several video recordings featuring with her boyfriend have circulated on social media until netizens hunted them down.
Anu Kanu Dark Video Female Dark Video Link Viral On Social Media X TikTok Trending Now
Anu Kanu Original Video video took the internet by storm and amazed viewers on various social media platforms. , a young and talented digital creator, recently became famous thanks to this interesting video.
Anu Kanu Laked Video Original Video Viral Video Laked on X Twitter
Anu Kanu Original Video video oficial twitter
Anu Kanu Laked Video Original Video Viral Video Laked on X Twitter.
Original Video Viral Video Laked on X Twitter
Watch Video Original Video Link Video Viral On Social Media X Trending Now
Anu Kanu Original Video video took the internet by storm and amazed viewers on various social media platforms. , a young and talented digital creator, recently became famous thanks to this interesting video.
Laked Video Original Video Viral Video Laked on X Twitter
Original Video video oficial twitter
Laked Video Original Video Viral Video Laked on X Twitter
Watch Video Original Video Link Video Viral On Social Media X Trending Now
Original Video video took the internet by storm and amazed viewers on various social media platforms. , a young and talented digital creator, recently became famous thanks to this interesting video.fghfgh
Laked Video Original Video Viral Video Laked on X Twitter
Original Video video oficial twitter
Laked Video Original Video Viral Video Laked on X Twitter Watch Video Original Video Link Video Viral On Social Media X Trending Now
Video Original Video Link Video Viral On Social Media X Trending Now
Original Video video took the internet by storm and amazed viewers on various social media platforms. , a young and talented digital creator, recently became famous thanks to this interesting video.


Upgrade docker python package to latest release

docker is upgraded in production build03 and it's not reporting errors. It seems it's safe to merge this and include in the next deploy.
Closes #3999

I didn't find anything related to docker issues in Sentry. I'm going to merge it so this goes out in the next deploy to all of our builders.


Update DetectLM.py

Kestrel analytics cannot change a view which is resulted from applying the SORT transformer on a variable. Thus, I set the first_observed column of the dataframe representing observations to the column of the other two dataframes, obtained from parguet files, which shows the time of observations. Also, I edited the first line of function "process" which was causing error.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Thanks @leila-rashidi for the PR!
Two items:

If I understand correctly, this PR and PR #18 are related. Could you put the commit in PR #18 into this one as well and close #18? You can just push the additional commit to leila-rashidi:patch-1 and it will automatically show here.
Could you create a test case for the DetectLM analytics? Basically have a minimal STIX bundle to run the Kestrel huntflow you posted at the end of the README. You can just put the test bundle in this directory if small. If big, you can use https://github.com/opencybersecurityalliance/data-bucket-kestrel repo to host it (github LFS enabled).

Hi Dr. Shu,
Please see the new open pull requests. We cannot load the required data using STIX bundles. We should use STIX-Shifter and read data stored in a database. I added a sample database. Also, my colleague, Dr. Jafari, had uploaded an SQL file in the test folder previously.


Line Chart - Simple Design

I'm a huge fan of the second line chart graph on the README. Is there any example code for this chart?
In particular, I can't seem to figure out how the line was turned off and replaced with the bubbles.

Just turn off the line and set color for the circles :-)


Add new parameter for SIGv4 auth.

Description
Add new optional parameter for use with AWS_SIGv4 authentication to connect to a cluster via SSH tunnel (for example - OpenSearch cluster is a VPC endpoint).
This parameter is required to fix request header to comply SIGv4 requirements. Ref: link.
New UI config parameter + new connection string parameter:

TODOs

[ ] Update docs
[ ] Test on Windows
[ ] Test on Mac
[ ] Test compatibility with older version
[ ] Update logging
[ ] Fix UI to show second word and/or rename
[ ] Fix UI to auto-activate new field when SIGv4 auth type is chosen
[ ] Trim string prefix and postfix
[ ] Add fix for #39
[ ] Add fix for #35

Issues Resolved
Fixes #41
Check List

[ ] New functionality includes testing.

[ ] All tests pass, including unit test, integration test and doctest

[ ] New functionality has been documented.

[ ] New functionality has javadoc added
[ ] New functionality has user manual doc added

[x] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Make sure to update documentation for connections and mention how to connect basic/sigv4 through a tunnel (and what to set as the tunnel host): https://github.com/opensearch-project/sql-odbc/blob/main/docs/user/configuration_options.md


Bash completion for flags

🎉 New feature
Part of https://github.com/ignitionrobotics/ign-tools/issues/1
Used together with https://github.com/ignitionrobotics/ign-tools/pull/87
Summary
Bash completion script for flags available to this subcommand.
This is a standalone function that depends on a new script in https://github.com/ignitionrobotics/ign-tools/pull/87 to call this.
Test it
After sourcing the dependent script in ign-tools, source the script in this PR:
. src/cmd/gui.bash_completion.sh

If you just tab, you get the default system tab-completion that shows the files in the current directory:
$ ign gui <tab>

If you type -, and then tab, you get the tab-completion for all the flags available for this subcommand:
$ ign gui -<tab>
--config         --help           --standalone     --versions       -h               -s
--force-version  --list           --verbose        -c               -l               -v

Then you can type partial flags, and it'll do tab-completion normally for you, such as
$ ign gui --ver
--verbose   --versions

It also works for multiple flags, like ign gui --<flag1> --<flag2> ...
Checklist

[x] Signed all commits for DCO
[ ] Added tests
[ ] Added example and/or tutorial
[ ] Updated documentation (as needed)
[ ] Updated migration guide (as needed)
[ ] Consider updating Python bindings (if the library has them)
[ ] codecheck passed (See contributing)
[ ] All tests passed (See test coverage)
[ ] While waiting for a review on your PR, please help review another open pull request to support the maintainers

Note to maintainers: Remember to use Squash-Merge and edit the commit message to match the pull request summary while retaining Signed-off-by messages.

I think the comments are addressed. Ready for another pass.

Fixed the tests in 2866b7a, inspired by https://github.com/gazebosim/gz-plugin/pull/57

@mabelzhang This PR introduced a regression in the Gazebo Citadel Windows buildfarm, see:
ign_gui-ign-3-win#93/testReport/junit/(root)/ignTest/GuiHelpVsCompletionFlags/
C:\Jenkins\workspace\ign_gui-ign-3-win\ws\ign-gui\src\ign_TEST.cc:131
Expected: (std::string::npos) != (helpOutput.find(flag)), actual:<PHONE_NUMBER>3709551615 vs<PHONE_NUMBER>3709551615
'HAVE_IGN_TOOLS-NOTFOUND' is not recognized as an internal or external command,
operable program or batch file.

Would you please take a look? It seems like an extra environment variable has to be set on Windows to get the proper output from the command line on that test.

This PR introduced a regression in the Gazebo Citadel Windows

Ah sorry that's on me, I totally missed the failing Windows test. On it.


Add frequency masks in get_detector_response_relative_binning

First question: Did you do a consistency check with init_params?

Yup. I basically cross-checked the output of get_detector_response_relative_binningwith the output of get_detector_response. I also ran the bilby_likelihood_error.py script for different epsilon values.
Have there been any new changes to relbin since last night?

No, but the commit history is different for the branches. Hence asked.

Fixed it.

Did you run the tests also?

Yup. I basically cross-checked the output of get_detector_response_relative_binningwith the output of get_detector_response. I also ran the bilby_likelihood_error.py script for different epsilon values.

Just these.

Merging this PR, by noting #18.


Does the standalone builds support non jack audio output ?

Hi, there was something i've been wondering about standalone, basically I'd like to make a software that works both as a standalone and a vst, that's why standalone is also a focus for me, however, i'd want it to be a very simple install for end users not using jack and all, so it should also work on simple pulseaudio on linux and wasapi/mme etc on windows, even if there's more latency in my use case it wouldn't be a big deal
is this supported by DPF ? if not i feel like it would be a pretty good addition

It is yes. There is RtAudio in place and used by default for the cases where JACK is not available.
With the caveat that it will always connect to the default audio interface, with no chance to configure this besides buffer size.
See the calls in https://github.com/DISTRHO/DPF/blob/main/distrho/DistrhoStandaloneUtils.hpp
Still a bit experimental, so try it out and let me know how that works.

I see, thanks, I'll look into it
would be a good addition to find a way to modify at runtime the interface, but it's already a good thing that it's there at all


Fix /analyze

Traceback (most recent call last):
File "/home/akkie100/.local/lib/python3.9/site-packages/discord/ext/tasks/init.py", line 198, in _loop
raise exc
File "/home/akkie100/.local/lib/python3.9/site-packages/discord/ext/tasks/init.py", line 169, in _loop
await self.coro(*args, **kwargs)
File "/home/akkie100/FinTwit_Bot/src/cogs/loops/nfts.py", line 174, in top_p2e
p2e = await p2e_games()
File "/home/akkie100/FinTwit_Bot/src/cogs/loops/nfts.py", line 342, in p2e_games
allItems = items.find_all('tr')
AttributeError: 'NoneType' object has no attribute 'find_all'

Traceback (most recent call last):
File "/home/akkie100/.local/lib/python3.9/site-packages/discord/commands/core.py", line 124, in wrapped
ret = await coro(arg)
File "/home/akkie100/.local/lib/python3.9/site-packages/discord/commands/core.py", line 970, in _invoke
await self.callback(self.cog, ctx, **kwargs)
File "/home/akkie100/FinTwit_Bot/src/cogs/commands/analyze.py", line 53, in analyze
table = table_div.find("table")
AttributeError: 'NoneType' object has no attribute 'find'


Why the evaluate results is changing sometimes? Anyone got the same problem like me?

I got the same problem too.

Here is the answer: https://github.com/pytorch/pytorch/issues/7068。

I got the same problem too.

You might miss some parameters. See https://github.com/TAMU-VITA/ABD-Net/issues/21


Extension does not work inside DevContainers

I can install the extension inside a DevContainer with javascript-node:16-buster image, but I cannot run pac inside the bash. I tried with 12-buster - same issue.

I did some digging around. The nupkg files exist but it has not been extracted into globalStorage

Compare this with Windows.

@rajyraman yes, this is currently by design: the only 2 OS supported for now are Windows and macOS; you're running in a Linux subsystem which this extension does not support yet. We're working on enabling both running in WSL on Windows and on a full linux w/ window manager/GUI VSCode.
It's not a secret that we have a linux version of the pac CLI, we have GitHub Actions running with both Win and linux runner OS. That support has not been tagged yet as @v0 or @latest but is available as HEAD or by commit id for the adventurous for now...

closing for now, as WSL and linux are planned feature work for later. In the meantime, please use the extension in VSCode on Win (no WSL or DevContainers) and macOS only


Fix possible memory leak in NetworkInterface WinPcap port.

pcap_freecode() is used to free up allocated memory pointed to by a bpf_program struct generated by pcap_compile(3PCAP) when that BPF program is no longer needed, for example after it has been made the filter program for a pcap structure by a call to pcap_setfilter(3PCAP).

Delete deprecated files arch.c and netif.h that have Amazon FreeRTOS licenses on them.

This addresses issue: #389

Checklist:

[x] I have tested my changes. No regression in existing tests.
[ ] My code is Linted.

https://amazon-freertos-ci.corp.amazon.com/job/pc/job/windows/job/sim-win-2/26/
All tests pass except Greengrasss core connections. None of the platforms pass this test in the parallel setup. This is because a new thing is created for each test and it not automatically associated with a Greengrass group/core.


multiple observations of the pytsk/libtsk attribute interface

While working on https://github.com/log2timeline/dfvfs/issues/504 some observations about the pytsk/libtsk attributes interface:

for ext2, ext4 and for FAT12 test images the data stream is returned as an attribute
for ext2 and ext4 test images no extended attributes are returned

looks like the libtsk ext code path is not setting extended attributes as part of the "TSK attributes"

for HFS+ test images an additional internal TSK attribute type is exposed

https://github.com/sleuthkit/sleuthkit/blob/0239c5934e348699d0be38f694fb6320252a91fc/tsk/fs/tsk_fs.h#L224

Unclear why pytsk does not expose at least 1 attribute for the ext4 test image (the second attribute is not shown due to https://github.com/sleuthkit/sleuthkit/issues/2487)
istat test_data/ext4.raw 13
inode: 13
Allocated
Group: 0
Generation Id:<PHONE_NUMBER>
uid / gid: 1000 / 1000
mode: rrw-rw-r--
Flags: Extents,
size: 53
num of links: 1

Extended Attributes  (Block: 1331)
user.myxattr=My extended attribute

Inode Times:
Accessed:	2021-07-22 16:07:32.841610817 (CEST)
File Modified:	2021-07-22 16:07:32.841610817 (CEST)
Inode Modified:	2021-07-22 16:07:32.846610831 (CEST)
File Created:	2021-07-22 16:07:32.841610817 (CEST)

Direct Blocks:
1332

pytsk uses tsk_fs_file_attr_get_idx https://github.com/py4n6/pytsk/blob/eeb7b69845668e52390d1fdfe9d12806b43f302f/tsk3.cpp#L562

So it looks like libtsk claims to have only 1 attribute
import pytsk3
pytsk3.__file__
img = pytsk3.Img_Info('dfvfs/test_data/ext4.raw')
fs = pytsk3.FS_Info(img)
f = fs.open_meta(inode=13)
[a for a in f]

istat ext2.raw 15
inode: 15
Allocated
Group: 0
Generation Id:<PHONE_NUMBER>
uid / gid: 1000 / 1000
mode: rrw-rw-r--
size: 22
num of links: 1

Extended Attributes  (Block: 162)
security.selinux=unconfined_u:object_r:unlabeled_t:s0

Inode Times:
Accessed:	2021-07-22 16:07:32 (CEST)
File Modified:	2021-07-22 16:07:32 (CEST)
Inode Modified:	2021-07-22 16:07:32 (CEST)

Direct Blocks:
515

But attribute interface returns 2x TSK_ATTR_RUN (offset: 515, size:1 and sparse size:15)


[Dashboard] Add Data Observatory catalog (I) - STRUCTURE

Context
https://github.com/CartoDB/product/issues/464
Main tasks

[x] Create new page (/dashboard/datasets/location_data_streams)
[x] Create tabs component (to switch between Your Datasets and Location Data Streams)
[x] Add tabs component to Your datasets page

@cmongut @urbanphes let me know here when we have a final name for the page (Data catalog, Data Observatory catalog ...) so I can start replacing the temporary content and the URL

@cmongut, What will be the definitive name?


config: allow four byte-size config to be specified using human-readable units ("100 GiB")

What problem does this PR solve?
Several config specifies a large byte size, which is not very readable (and some DBAs are still unfamiliar with the underscore-as-number-separator TOML feature).
What is changed and how it works?
Using docker/go-units (already used by Dumpling and PD), we support parsing human-readable byte size for the following config:

tikv-importer.region-split-size (100_663_296 → '96 MiB')
mydumper.read-block-size (65536 → '64 KiB')
mydumper.batch-size (107_374_182_400 → '100 GiB')
mydumper.max-region-size (268_435_456 → '256 MiB')

Byte size can be specified using integers (65536 or 65_536, backward-compatible with existing config), floating point (6.5536e+4), or a string involving byte units ('64k', '64 K', '64KiB', '64 kb', '0.0625 MB', all equivalent).
(This PR is submitted mainly because we expect that disk-quota is also going to need some huge numbers in a custom config, similar to TiKV's ReadableSize struct. Interestingly no such thing exists in TiDB except in dealing with INSPECTION_RULES.)
Check List
Tests

Unit test

Side effects
Related changes

Need to update the documentation
Need to be included in the release note

Release notes

The 4 configuration specified above can now accept human-readable format in the form "2.5 GiB".

LGTM


startercode cargo check utxo-runtime error

cargo check -p utxo-runtime
Compiling utxo-runtime v2.0.0-alpha.5 (C:\Users\Mwaki\utxo-workshop\runtime)
Checking parity-util-mem v0.6.0
error[E0308]: mismatched types
--> C:\Users\Mwaki.cargo\registry\src\github.com-1ecc6299db9ec823\parity-util-m\allocators.rs:76:30
|
76 |                 if HeapValidate(heap, 0, ptr) == 0 {
|                                          ^^^ expected enum winapi::ctypes::cd enum std::ffi::c_void   |    = note: expected raw pointer*const winapi::ctypes::c_void              found raw pointer*const std::ffi::c_void`
error[E0308]: mismatched types
--> C:\Users\Mwaki.cargo\registry\src\github.com-1ecc6299db9ec823\parity-util-m\allocators.rs:80:23
|
80 |                 HeapSize(heap, 0, ptr) as usize
|                                   ^^^ expected enum winapi::ctypes::c_void,std::ffi::c_void
|
= note: expected raw pointer *const winapi::ctypes::c_void
found raw pointer *const std::ffi::c_void
error: aborting due to 2 previous errors
For more information about this error, try rustc --explain E0308.
error: could not compile parity-util-mem
To learn more, run the command again with --verbose.
warning: build failed, waiting for other jobs to finish...
error: build failed
any help to solve the above error would be highly appreciated.

I've encountered the same issue. Have you been able to fix this @motomoto-254 ? I'd appreciate any pointers, thank you.

I didn't solve the problem, i changed my approach. So i started the tutorial on the official substrate website with rust to get up n running with the rust language n substrate dev.
Link to the website:
https://substrate.dev/docs/en/tutorials/create-your-first-substrate-chain/index

yes same problem please help,any solution ?

Hi, sorry to disappoint. I haven't followed up, though from the website it
explains the set up of your "work station" i think i got it wrong from the
start.
They have updated the website, you could get more help from there..
https://docs.substrate.io
On Wed, 15 Dec 2021, 13:54 bhavesh20-mb, @.***> wrote:

yes same problem please help,any solution ?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/substrate-developer-hub/utxo-workshop/issues/85#issuecomment-994672533,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AOCJU3MCTHXPVICWEI2DC5TURBXU7ANCNFSM45ZETFBA
.


x/sys/unix: some SYS constants disappeared on Darwin

We updated our golang.org/x/sys dependency from v0.0.0-20200812155832 to v0.0.0-20201008064518-c1f3e3309c71 and got a build breakage on GOOS=darwin:
../../wireguard-go/tun/tun_darwin.go:141:3: undefined: unix.SYS_IOCTL
../../wireguard-go/tun/tun_darwin.go:162:3: undefined: unix.SYS_CONNECT
../../wireguard-go/tun/tun_darwin.go:241:4: undefined: unix.SYS_GETSOCKOPT
../../wireguard-go/tun/tun_darwin.go:346:3: undefined: unix.SYS_IOCTL
../../wireguard-go/tun/tun_darwin.go:380:3: undefined: unix.SYS_IOCTL

/cc @ianlancetaylor @tklauser

git bisect reports CL 250437 (approved by @bradfitz)

These were dropped because (as you know) macOS doesn't want us to make direct system calls anyhow.  They want us to go through libSystem in all cases.

The build breakage in wireguard-go should be addressed by WireGuard/wireguard-go#42

@tklauser, thanks for that!
What do you think about reverting the zsysnum file deletions from CL 250437? I don't think Go's migration away from raw system calls should force other people's schedules on when they migrate away from direct system calls.

@tklauser, thanks for that!
What do you think about reverting the zsysnum file deletions from CL 250437? I don't think Go's migration away from raw system calls should force other people's schedules on when they migrate away from direct system calls.

@bradfitz yeah, good point. Let's not force other people to migrate away just yet. I'll send a CL to re-add the zsysnum files.


Fix #1684 by handling exceptions while becoming a leader

The driver is created outside the try block (was there a reason for that?)
If the creation of the driver fails (which involves the frameworkId lookup) the whole election process is stalled.
Fixes #1684

LGTM, if it is easy, a test that makes sure we abdicate on exceptions would be nice!

The Option[Driver] was created rather recently. Despite that, I have no idea why it was outside of the try block.
https://github.com/mesosphere/marathon/commit/7c0a389719043ebd2d8cfaeaa0f6a1a06c5e2a8d
I think that is no use in asking the question in the commit message if we do not know the answer.
But I am to late to change this ;)

We've recently upgraded to v0.9.0 and have ran into problems with the marathon leader in zk where there would somehow be multiple leaders in zk even though we only had one instance of marathon running. However, that marathon wouldn't even think it was the leader:
[2015-08-05 18:18:51,450] INFO Waiting for consistent leadership state. Are we leader?: false, leader: Some(mesos-master0-aws.dev.banno-internal.com:8080) (mesosphere.marathon.api.LeaderProxyFilter$:100)

Is this something that should be in v0.9.x release line?

Hi @rubbish, is this related to this issue? Otherwise please create a separate issue.

@kolloch I had thought it might be. As I was searching for an existing issue and saw this. It doesn't appear that this PR made it into the 0.9.0 or 0.9.1 release.
I'll further verify with the 0.10.0-RC4 release and see if I can recreate it.


A Little Help?

There are a dizzying number of things going on with this project. I'm supposed to use Bazel in the form of Baselisk (no idea what either one is). There are folders for Python, GO, Java, etc.
I'm using Microsoft C++ with MFC and would like include a compiled library for Windows to add encryption. Any place I can go to get the steps to do just this?

See the https://github.com/google/tink/blob/master/docs/CPP-HOWTO.md
With bazel you can go to the example directory at https://github.com/google/tink/tree/master/examples/cc and build it with "bazel build ...". We try this only with the version of bazel which is marked in the .bazelversion file in this directory. Bazelisk is a small wrapper for bazel which downloads this version and uses it. You can also use CMake as in the description there.
Note that we currently do not officially support Windows. Tink might not work for windows. Note also https://github.com/google/tink/issues/284: it might be difficult to use openSSL and Tink in your binary.


feat: add support for agent overrides

Add support for Agent Override
Add support for custom messages

Tested all incremental functionality (agent overrides + custom LLM body) with updated demo.


[TW#23298] Esp_mesh_send doesn't sends message to external address (IDFGH-3215)

I'm not sure it is an issue, or its working properly and I'm doing something wrong.
Esp_mesh_send doesn't sends message to external address.
Environment

Development Kit:       none
Core (if using chip or module): ESP-WROOM32
IDF version: 64b56be
Development Env:		VSCode
Operating System:		Ubuntu 16.04
Power Supply:         USB

Note: I'm using only one ESP.
Problem Description
Esp_mesh_send doesn't sends message to external address.
I'm using a modified version of the idf mesh example (https://github.com/espressif/esp-idf/tree/master/examples/mesh/internal_transceiver) to send a messsage to my server, without success.
I checked the API's esp_mesh_send part:
http://esp-idf.readthedocs.io/en/latest/api-reference/mesh/esp_mesh.html#_CPPv213esp_mesh_sendPK11mesh_addr_tPK11mesh_data_tiA_K10mesh_opt_ti
It says "if the packet is outgoing to external IP network such as an IP server address, translate IPv4:PORT known as “to”."
I tried to use MESH_PROTO_BIN, MESH_PROTO_JSON, MESH_PROTO_HTTP data types without any success.
Expected Behavior
It should send some message to an external server.
Actual Behavior
It doesn't sends anything.
I can ping the ESP32 and my port is open.
Current monitor log:
I (6193) mesh: [SCAN][ch:4]AP:1, otherID:0, idle:0, mAP:1, root:0, top mAP:0[Layer:0/1.ing]router found
I (6193) mesh: 916, [SCAN]init rc[30:ae:a4:1b:c4:55,-69], mine:0, voter:0
I (6203) mesh: [SCAN:13/13+extra+]rc[128][30:ae:a4:1b:c4:55,-69], self[30:ae:a4:1b:c4:54,-69,reason:0,votes:1,idle][mine:1,voter:1(1.00)percent:1.00][128,1,30:ae:a4:1b:c4:55]

I (6213) mesh: [DONE]connect to router:TP-LINK_7DFE, rssi:-69, 18:d6:c7:a7:7d:fe[layer:1], rc[30:ae:a4:1b:c4:55/-69]
I (12363) wifi: n:4 1, o:4 0, ap:4 1, sta:4 0, prof:4
I (13343) wifi: state: init -> auth (b0)
I (13353) wifi: state: auth -> assoc (0)
I (13363) wifi: state: assoc -> run (10)
I (13583) wifi: connected with TP-LINK_7DFE, channel 4
I (13593) wifi: pm start, type: 0

E (13593) event: invalid static ip
I (13593) mesh_main: <MESH_EVENT_PARENT_CONNECTED>layer:0-->1, parent:18:d6:c7:a7:7d:fe<ROOT>
I (13603) mesh_main: <MESH_EVENT_ROOT_ADDRESS>root address:30:ae:a4:1b:c4:55
E (13603) mesh_main: Routing table
W (13613) mesh_main: [#RX:1/1][L:1] parent:18:d6:c7:a7:7d:fe, receive from 30:ae:a4:1b:c4:54, size:1460, heap:187240, flag:0[err:0x0, proto:0, tos:0]
I (14573) mesh_main: <MESH_EVENT_ROOT_GOT_IP>sta ip: <IP_ADDRESS>, mask: <IP_ADDRESS>, gw: <IP_ADDRESS>
I (14573) event: sta ip: <IP_ADDRESS>, mask: <IP_ADDRESS>, gw: <IP_ADDRESS>
E (14623) mesh_main: Send to server

Steps to repropduce

set SSID and PASSWORD for your wifi in menuconfig
connect to the same network with your pc
get IP with ifconfig
start netcat in your PC nc -l -k -p 8089
Clone my repo: https://github.com/ugallu/esp-mesh-socket
Modify the IP number and port number at line 112,113.
Make and Flash the program to the esp
Check monitor and netcat. It should try to send a message when it got an IP.

Code to reproduce this issue
https://github.com/ugallu/esp-mesh-socket

If you want to send a message to external address, socket shoud be created by yourself. And using esp_mesh_recv_toDS() to receive packets destined to external IP network.

Here's the brief of esp_mesh_recv_toDS()

  * @brief     receive a packet targeted to external IP network
  *            root uses this API to receive packets destined to external IP network
  *            root forwards the received packets to the final destination via socket.
  *            if no socket connection is ready to send out the received packets and this esp_mesh_recv_toDS()
  *            hasn't been called by applications, packets from the whole mesh network will be pending in toDS queue.
  *            Use esp_mesh_get_rx_pending() to check the number of packets available in the queue waiting
  *            to be received by applications in case of running out of memory in root.
  *            Use esp_mesh_set_xon_qsize() could configure the RX queue size, default:72. If this size is too large,
  *            and esp_mesh_recv_toDS() isn't called in time, there is a risk that a great deal of memory is occupied
  *            by the pending packets. If this size is too small, it will impact the efficiency on upstream. How to
  *            decide this value depends on the specific application scenarios.

More examples may help you in  https://github.com/espressif/esp-mdf

Will there be official border router implementation?

@negativekelvin
 "that's not included in mesh"
 "normal router is able to establish a connection between mesh networks."

@ugallu did you get this working? I am finding esp_mesh_send is hanging when trying to send data to an external IP.

I made a workaround. I sent data from nodes to root via
esp_err_t err = esp_mesh_send(NULL, &data, 0, NULL, 0);
and on the root, I got the message with esp_mesh_recv.
Then I opened a standard socket to my server (or simply to netcat) and sent it with the socket's write method (this maybe can help, I called write(socket, message, messageLength), instead of read: https://github.com/espressif/ESP8266_RTOS_SDK/issues/46)
Please send a message if you get further.

@JerrysGarage @ugallu
You could refer to the examples in https://github.com/espressif/esp-mdf
The lastest esp-idf master is not fully tested on ESP-MESH.
You'd better use esp-mdf submodule before v3.1 release.

I think you use the receiving API a bit off.
The first parameter needs a pointer, and the api will write the address of the sender to the allocated variable. Then you can process this address.
I created a branch named send2Root in my repo for you with a working and tested (I have only one esp32 at home, so I sent from root to root, but I think it should work) example:
https://github.com/ugallu/esp-mesh-socket/blob/send2Root/main/mesh_main.c
ps: I would use as few dynamic memory allocation as possible.
And be sure you use the correct esp-idf, I currently use this:
https://github.com/espressif/esp-idf/tree/a2556229aa6f55b16b171e3325ee9ab1943e8552
with upgraded submodules (git submodule update --init --recursive)

@JerrysGarage

root receive to DS： https://github.com/espressif/esp-mdf/blob/master/components/protocol_stacks/mdf_wifi_mesh/mdf_wifi_mesh.c#L376
node send data： https://github.com/espressif/esp-mdf/blob/master/components/protocol_stacks/mdf_wifi_mesh/mdf_wifi_mesh.c#L210

Thank you both! What is the best way for a node to get the address dest_addr for Root?

Its NULL, if you need it just for sending message.
From the esp_mesh_send API: to: the address of the final destination of the packet (1)if the packet is to root, just set “to” to NULL and set flag to zero

NULL works for me when using esp_mesh_send however when using the mdf_wifi_mesh_send function, the first line is MDF_PARAM_CHECK(dest_addr); which prevents me from passing a NULL.

@dongdong004 @ugallu Got it working, Thanks for all the help!

hi @JerrysGarage
could you explain me how you did it? that what im looking for my project.
Regards
Daniel

@JerrysGarage

root receive to DS： https://github.com/espressif/esp-mdf/blob/master/components/protocol_stacks/mdf_wifi_mesh/mdf_wifi_mesh.c#L376
node send data： https://github.com/espressif/esp-mdf/blob/master/components/protocol_stacks/mdf_wifi_mesh/mdf_wifi_mesh.c#L210
Use the esp-idf @ugallu said.

Hi @dongdong004 , could you please update the "node send data" example? (:

Hi @dongdong004 , could you please update the "node send data" example? (:

Hi @vcmorini,

esp-mdf:

https://github.com/espressif/esp-mdf

esp_mesh_send:

https://github.com/espressif/esp-mdf/blob/master/components/mwifi/mwifi.c#L631

esp_mesh_recv_toDS

https://github.com/espressif/esp-mdf/blob/master/components/mwifi/mwifi.c#L1275


Pending file formats

List of pending file formats:

Skill.SData
NpcSkill.SData
NpcQuest.SData (for episode 6 and above)
Monster.SData
.MON
.dg (world/dungeon)
.wld (world)
.wtr (Entity/Water)
.grp (Entity/Group)
.pc (cloak/Character/)
.ctl (cloak/ClothTexture)
.dat (cloak/Emblem)

.MON added on 5c95cc30d330995b0ecf5d4859ac7d4f21e3cbf5

Monster.SData added on 506b0a7fe232849ae977175320352ee28adf9434


Tx Pool not correctly updated after warp sync

Currently the EnactmentState instance maintained by the BasicPool is not updated after a warp sync.
2022-11-06 15:20:08 ⏩ Warping, Importing state, 595.78 Mib (40 peers), best: #0 (0x91b1…90c3), finalized #0 (0x91b1…90c3), ⬇ 730.4kiB/s ⬆ 12.8kiB/s
2022-11-06 15:20:13 ⏩ Warping, Importing state, 595.78 Mib (40 peers), best: #0 (0x91b1…90c3), finalized #0 (0x91b1…90c3), ⬇ 5.7kiB/s ⬆ 6.6kiB/s
2022-11-06 15:20:20 ⏩ Warping, Importing state, 595.78 Mib (40 peers), best: #0 (0x91b1…90c3), finalized #0 (0x91b1…90c3), ⬇ 1.4kiB/s ⬆ 1.5kiB/s
2022-11-06 15:20:25 ⏩ Warping, Importing state, 595.78 Mib (40 peers), best: #0 (0x91b1…90c3), finalized #0 (0x91b1…90c3), ⬇ 2.1kiB/s ⬆ 1.9kiB/s
2022-11-06 15:20:30 ⏩ Warping, Importing state, 595.78 Mib (40 peers), best: #0 (0x91b1…90c3), finalized #0 (0x91b1…90c3), ⬇ 1.7kiB/s ⬆ 1.6kiB/s
2022-11-06 15:20:33 Warp sync is complete (595 MiB), restarting block sync.
2022-11-06 15:20:35 ⏩ Block history, #2816 (39 peers), best: #12807414 (0x12c4…e3e9), finalized #12807386 (0x52e5…60b4), ⬇ 429.1kiB/s ⬆ 7.7kiB/s
2022-11-06 15:20:40 ⏩ Block history, #9024 (39 peers), best: #12807414 (0x12c4…e3e9), finalized #12807386 (0x52e5…60b4), ⬇ 399.9kiB/s ⬆ 6.2kiB/s
2022-11-06 15:20:44 Error occurred while computing tree_route from 0x91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3 to 0x12c4610ab2e336928827bfacab2918033847c69629efe820d6244909c522e3e9: Blockch
ain error: UnknownBlock: Header was not found in the database: 0xaf0e4794bf12464f6649d07da234cf62e3ba098fb190b9f1f4cd22c94ed3589e
2022-11-06 15:20:45 ⏩ Block history, #16320 (39 peers), best: #12807414 (0x12c4…e3e9), finalized #12807414 (0x12c4…e3e9), ⬇ 622.4kiB/s ⬆ 7.3kiB/s
2022-11-06 15:20:50 ⏩ Block history, #22144 (39 peers), best: #12807414 (0x12c4…e3e9), finalized #12807414 (0x12c4…e3e9), ⬇ 401.5kiB/s ⬆ 11.0kiB/s
2022-11-06 15:20:55 ⏩ Block history, #28800 (38 peers), best: #12807414 (0x12c4…e3e9), finalized #12807414 (0x12c4…e3e9), ⬇ 625.3kiB/s ⬆ 6.1kiB/s
2022-11-06 15:21:00 ⏩ Block history, #33856 (38 peers), best: #12807414 (0x12c4…e3e9), finalized #12807414 (0x12c4…e3e9), ⬇ 593.6kiB/s ⬆ 5.7kiB/s
2022-11-06 15:21:04 ✨ Imported #12807415 (0x8b3f…7c44)
2022-11-06 15:21:04 Error occurred while computing tree_route from 0x91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3 to 0x8b3f1b261a5438a808a94571cf7def8d8cdf061766d7ded5ee4af44032127c44: Blockch
ain error: UnknownBlock: Header was not found in the database: 0xaf0e4794bf12464f6649d07da234cf62e3ba098fb190b9f1f4cd22c94ed3589e
2022-11-06 15:21:04 ✨ Imported #12807416 (0x68ca…0e38)
2022-11-06 15:21:04 Error occurred while computing tree_route from 0x91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3 to 0x68cafeb1a489c932669d8504f37b737d3208f9b8449459a3cdf43f9de2af0e38: Blockch
ain error: UnknownBlock: Header was not found in the database: 0xaf0e4794bf12464f6649d07da234cf62e3ba098fb190b9f1f4cd22c94ed3589e
2022-11-06 15:21:04 Error occurred while computing tree_route from 0x91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3 to 0x68cafeb1a489c932669d8504f37b737d3208f9b8449459a3cdf43f9de2af0e38: Blockch
ain error: UnknownBlock: Header was not found in the database: 0xaf0e4794bf12464f6649d07da234cf62e3ba098fb190b9f1f4cd22c94ed3589e

As can be seen from the log, there are attempts to find a route from the best block the EnactmentState is aware of (in this case the genesis one) to the one contained within the blockchain event notification (finality or best).
The end result is an early exit from the BasicPool::update before being able to perform any action on the pool or update the enactment state instance.
https://github.com/paritytech/substrate/blob/cafbb668d2e57ede83f11f59d8bf291aa8d0c765/client/transaction-pool/src/enactment_state.rs#L95
https://github.com/paritytech/substrate/blob/cafbb668d2e57ede83f11f59d8bf291aa8d0c765/client/transaction-pool/src/lib.rs#L747-L753

This should be fixed by updating the Pool at the end of a warp sync.
Maybe a (good enough) simple strategy is to directly use the route found within the event (as before the introduction of EnactmentState struct) as a fallback in case we're not able constructing the route using the backend.

Current workaround: restart the node. EnactmentState is initialized using the most fresh data found. The situation is thus recovered

Block record is missing from the pruning window, block number 0
… thousands of these lines about missing blocks …
Block record is missing from the pruning window, block number 0

@ggwpez do the lines about missing blocks have exactly this format?
Error occurred while computing tree_route from <from> to <to>: Blockch
ain error: UnknownBlock: Header was not found in the database: <from>

Just to be sure that are produced here:
https://github.com/paritytech/substrate/blob/cafbb668d2e57ede83f11f59d8bf291aa8d0c765/client/transaction-pool/src/lib.rs#L742

Maybe a (good enough) simple strategy is to directly use the route found within the event (as before the introduction of EnactmentState struct) as a fallback in case we're not able constructing the route using the backend.

I also think that this is the best solution. So, basically if there is any error for new best we take the given tree route. If tree route fails for new finalized, we just update the last finalized block in the enactmentstate, same for best block. So, when there is an error we print this as debug and still let the internal state progress.

Simple solution could be ignoring the tree_route and simply updating the recent_best_block / recent_finalized w/o calling enactment/finalization process. This is easiest solution that can be implemented.
If we cannot compute tree_route because there are no blocks in backend, we also cannot handle enactment process (and cannot trigger any tx-related events).

So warp sync is currently broken? Maybe we should add a test to the release-process.

do the lines about missing blocks have exactly this format?

Yes @davxy.
Error occurred while computing tree_route from 0x91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3 to 0x9f438cfb998cb88819341fbd3b6bb4c2315ceddaa11eb95384810149a229b075: Blockchain error: UnknownBlock: Header was not found in the database: 0x86ac5317963836b1792efbcd428bccf4e5618b7c61a392c1d6618114f6104ef2


Journey layout fixes

Fixes column styling on journey pages.
Changes

Adds column classes for 1-4 and 3-4 cols

Preview

Testing

check out branch locally
run sh frontendbuild.sh
view /process and /process/sources and verify that columns are working correctly:

http://localhost:7000/process/
http://localhost:7000/process/sources

Review

@cfarm or @amymok

Checklist

[X] Changes are limited to a single goal (no scope creep)
[X] Code can be automatically merged (no conflicts)
[X] Code follows the standards laid out in the front end playbook
[ ] Visually tested in supported browsers and devices

Looks great!

So, when might we see these changes on production?


Fix flake8 errors

Yesterday, I commited a README change directly to master and technically the build is broken due to flake8 changes/errors. Fix these errors. Related to #161, flake8 errors appear to be related to optional typing not being imported

Closed by #166


Fix buttons and the date picker at the post list page

use el-button to solve the shadow of buttons.

Before:

After:

Change the border radius of date picker to unify the user's visual effect (could be updated in the future)

looks good


Feature/issue 147 add support for messages that arent replies to application worker base class

See https://gist.github.com/1665811 for an analysis of the way outbound messages are used by our current transports and a description of how I see the new outbound messages being used.
Let the dissecting and bike-shedding begin. :)
(#147)

At least some of the discussion in the gist should go into our documentation but I'm not quite sure how much of it and where it should go.

Another attempt at creating something people are happy to have land. This one pushes the question of whether to use transport_name or something more advanced for routing send_to messages out into application configuration (and as such, I quite like it).

Anything outstanding?

Nothing major from my side, only small and not very critical stuff about possibly having to catch AssertionError when a ConfigError could have been expected from a dev-perspective.

Closing fixes #147.


a little typo in the localdev www config

What are the relevant tickets?
https://github.com/mitodl/ocw-studio/pull/1101
What's this PR do?
Had a small typo in https://github.com/mitodl/ocw-studio/pull/1101, this fixes it
How should this be manually tested?
change should make sense

Codecov Report

Merging #1146 (c2d0349) into master (07c939b) will increase coverage by 4.42%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #1146      +/-   ##
==========================================
+ Coverage   90.95%   95.38%   +4.42%
==========================================
  Files         207       98     -109
  Lines        8067     2684    -5383
  Branches     1394      553     -841
==========================================
- Hits         7337     2560    -4777
+ Misses        637      124     -513
+ Partials       93        0      -93

Impacted Files
Coverage Δ

gdrive_sync/__init__.py

main/tasks.py

main/views.py

content_sync/apps.py

videos/api.py

websites/factories.py

main/constants.py

...ds/markdown_cleaning/legacy_shortcodes_data_fix.py

...cw_import/management/commands/repair_dupe_repos.py

content_sync/pipelines/concourse.py

... and 99 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 07c939b...c2d0349. Read the comment docs.


KYLIN-3317, replace UUID.randomUUID with new UUID(ThreadLocalRandom.current().nextLong(), ThreadLocalRandom.current().nextLong())

…urrent().nextLong(), ThreadLocalRandom.current().nextLong()).

Can one of the admins verify this patch?

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@ddfed27). Click here to learn what that means.
The diff coverage is 29.62%.

@@            Coverage Diff            @@
##             master     #197   +/-   ##
=========================================
  Coverage          ?   21.06%
  Complexity        ?     4292
=========================================
  Files             ?     1070
  Lines             ?    67825
  Branches          ?     9837
=========================================
  Hits              ?    14285
  Misses            ?    52169
  Partials          ?     1371

Impacted Files
Coverage Δ
Complexity Δ

...che/kylin/rest/controller/StreamingController.java
0% <0%> (ø)
0 <0> (?)

...e/kylin/source/kafka/util/KafkaSampleProducer.java
0% <0%> (ø)
0 <0> (?)

...apache/kylin/storage/hbase/HBaseResourceStore.java
0% <0%> (ø)
0 <0> (?)

.../apache/kylin/rest/controller/ModelController.java
0% <0%> (ø)
0 <0> (?)

...kylin/storage/hbase/lookup/HBaseLookupMRSteps.java
0% <0%> (ø)
0 <0> (?)

...g/apache/kylin/rest/controller/CubeController.java
0% <0%> (ø)
0 <0> (?)

...kylin/common/persistence/RootPersistentEntity.java
20.45% <0%> (ø)
4 <0> (?)

...ylin/rest/controller/ExternalFilterController.java
0% <0%> (ø)
0 <0> (?)

...va/org/apache/kylin/rest/service/TableService.java
13.13% <0%> (ø)
9 <0> (?)

...apache/kylin/common/persistence/ResourceStore.java
59% <0%> (ø)
25 <0> (?)

... and 10 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ddfed27...ffe9757. Read the comment docs.


Outline says No Symbols Found for the current doc. start type and symbols appear

Originally opened as microsoft/vscode-python#2434 , which was closed as duplicate of microsoft/vscode-python#2334
I updated to 1.27.1 this am to get the fix for microsoft/vscode-python#2334
I opened existing file that had problem before. Same problem as 2334. Hit space and symbols appear.
Cut and paste all code from that file to new file, saved and closed new file. On open of new file, symbols appear. On Open of old file with identical code no symbols until hit space.
Environment data
VS Code version: 1.27.1
Extension version (available under the Extensions sidebar): 2018.8.0
OS and version: Ubuntu 16.04.3
Python version (& distribution if applicable, e.g. Anaconda): 3.5.2
Type of virtual environment used (N/A | venv | virtualenv | conda | ...): N/A
Relevant/affected Python packages and their versions: N/A
Actual behavior
Outline view does not display any symbols after file open. Outline view shows 'No symbols found in document xxx'. On editing the file symbols appear in couple of seconds
Expected behavior
Symbols appear in outline window after opening file
Steps to reproduce:
Open file
Logs
None
Original file

New file with same code

@brettcannon Our side is #1823 (so I guess I could this as a dupe), but as far as I'm concerned, issues with the outline only appearing after typing are squarely in the client or VS Code's domain and need to be fixed there. We don't even get the request for the outline when this happens.
We're only at the stage where we need to reproduce this and then debug it in the Python extension to see.

Same issue as of now for rust-analyzer language server.

Tw, hoq ro ciew it.

I am on version 1.87 (February 2024) and experience the same problem.
In outline, it always shows "no symbols found for file.py"
All consoles (problems, output, terminal ) are empty.
I am on RHEL8, projecting UI using X. (no code server etc)

@dbabits, this issue has been closed for a long time. Please open a new one. If you're really not seeing anything in the output pane, not just under Python Language Server, but in any of the logs, I'd guess that this is a VS Code issue rather than a Pylance issue, so I'd suggest opening it here: https://github.com/microsoft/vscode/issues


[Hub Generated] Review request for Microsoft.Quantum to add version preview/2019-11-04-preview

This is a PR generated at OpenAPI Hub. You can view your work branch via this link.
Contribution checklist:

[x] I commit to follow the Breaking Change Policy of “no breaking changes
[x] I have reviewed the documentation for the workflow.
[ ] Validation tools were run on swagger spec(s) and errors have all been fixed in this PR. How to fix?

If any further question about AME onboarding or validation tools, please view the FAQ.
ARM API Review Checklist

[x] Ensure to check this box if one of the following scenarios meet updates in the PR, so that label “WaitForARMFeedback” will be added automatically to involve ARM API Review. Failure to comply may result in delays for manifest application. Note this does not apply to data plane APIs, all “removals” and “adding a new property” no more require ARM API review.

Adding new API(s)
Adding a new API version
Adding a new service

[ ] If you are blocked on ARM review and want to get the PR merged with urgency, please get the ARM oncall for reviews (RP Manifest Approvers team under Azure Resource Manager service) from IcM and reach out to them.

Breaking Change Review Checklist
If there are following updates in the PR, ensure to request an approval from API Review Board as defined in the Breaking Change Policy.

[ ] Removing API(s) in stable version
[ ] Removing properties in stable version
[ ] Removing API version(s) in stable version
[ ] Updating API in stable version with Breaking Change Validation errors
[ ] Updating API(s) in preview over 1 year

Please follow the link to find more details on PR review process.

/azp run automation - sdk

Please remove the draft flag if you would like to get the review started.

While adding new version the recommendation is to copy the existing version into new directory structure for first commit and then push new changes for easy review. Please create new branch with this recommendation for faster review.
In case this is a new RP please schedule meeting with ARM API review board, if the review meeting was done please share the review notes with the ARM api review board for reviewing.

/azp run automation - sdk

@chiragg4u , I have incorporated all feedback. Let me know what else is needed.

some comments from ARM reviewers around property name renames makes sense. But it will cause a breaking change for current customers.

some comments from ARM reviewers around property name renames makes sense. But it will cause a breaking change for current customers.

@njuCZ Could you help in merging this PR? Thanks in advance.

@njuCZ Could you help in merging this PR? Thanks in advance.

/azp run unifiedPipeline

/azp run unifiedPipeline

/azp run unifiedPipeline

/azp run unifiedPipeline

/azp run unifiedPipeline

/azp run unifiedPipeline


Use port env when present.

Use port env by default when present.
https://github.com/pocketbase/pocketbase/blob/20653ef786db55dc77ad13461a659a0e5a960083/cmd/serve.go#L33C1-L37C5.
if len(args) > 0 {
        if httpAddr == "" {
                httpAddr = "<IP_ADDRESS>:80"
        }
        if httpsAddr == "" {
                httpsAddr = "<IP_ADDRESS>:443"
        }
} else {
        if port := os.Getenv("PORT"); port != "" {
		httpAddr = "<IP_ADDRESS>:" + port
	} else httpAddr == "" {
	        httpAddr = "<IP_ADDRESS>:8090"
        }
}

This can help make it easier to deploy with docker on platforms that give us a random port.

I don't there is need for magic env variables.
It will require documentation and could results in collisions if we don't prefix them.


Replace legacyInsert with RawIndexer

Adds a new RawIndexer that pre-processes _raw into target columns
(Reference[]) and insert values (Object[]) to be able to re-use
Indexer for the _raw indexing operations.
Opposed to https://github.com/crate/crate/pull/14653 (which we might do anyway in addition), this has the advantage that this also works for mixed cluster cases.

retest this please
MetadataTrackerITest.test_subscription_to_multiple_publications_should_not_stop_on_a_single_publication_drop failed


🐛 Bug Report: Organization deletion does not work

👟 Reproduction steps
Click the delete button to delete the organization under the /console/organization-[organizationId]/settings, it will show no modal.
👍 Expected behavior
Shows a modal to make sure that you want to delete the organization
👎 Actual Behavior
Doesn't show the modal to delete it, so the button will do nothing
🎲 Appwrite version
Version 1.5.x
💻 Operating system
Linux
🧱 Your Environment
Applies to every environment using Appwrite 1.5.5
👀 Have you spent some time to check if this issue has been raised before?

[X] I checked and didn't find similar issue

🏢 Have you read the Code of Conduct?

[X] I have read the Code of Conduct

@docimin, thanks for creating this issue! 🙏

Duplicate of #1030


fix(husky): revert stdin tty workaround of #766 for npm

Git Bash workaround for using tty, which is officially recommended by
husky in their documentation, is only relevant for yarn, not for npm.
Removed isWindows condition make sure projects made by Linux devs are
fully accessible to Windows users. Updated husky in a parent project.
Added --no-install to npx to avoid accidental installation by default
if a project uses different than latest version, but isn't installed.

To add a link between PRs for future reference, the --no-install change affects #774 where this perspective of using incorrect version wasn't discussed


[Bug]build script failed, must exit now', /root/.cargo/registry/src/github.com-1ecc6299db9ec823/cmake-0.1.40/src/lib.rs:832:5

CMake Error at CMakeLists.txt:8114 (target_compile_options):
Error evaluating generator expression:
$<COMPILE_LANGUAGE:CXX>

Expression did not evaluate to a known generator expression
thread 'main' panicked at '
command did not execute successfully, got: exit code: 1
build script failed, must exit now', /root/.cargo/registry/src/github.com-1ecc6299db9ec823/cmake-0.1.40/src/lib.rs:832:5
note: Run with RUST_BACKTRACE=1 environment variable to display a backtrace.
warning: build failed, waiting for other jobs to finish...
error: build failed

Hi @wbm0701 please try installing the latest version of cmake.

I got the same build error.
I had run ./scripts/dev_setup.sh and cargo build.
OS Version: macOS 10.15 beta2
Go: go1.12.4 darwin/amd64
cmake: 3.14.5 or 3.15-rc
error is below:
error: failed to run custom build command for libtitan_sys v0.0.1 (https://github.com/pingcap/rust-rocksdb.git?rev=8d6cda70f22da2cd15ed7351fcffa9add3444595#8d6cda70)`
Caused by:
process didn't exit successfully: /Users/chen/sourcetree/libra/target/debug/build/libtitan_sys-0e1aa4108f8f088a/build-script-build (exit code: 101)
--- stdout
running: "cmake" "/Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan" "-DROCKSDB_DIR=/Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb" "-DWITH_TITAN_TESTS=OFF" "-DWITH_TITAN_TOOLS=OFF" "-DWITH_ZLIB=ON" "-DWITH_BZ2=ON" "-DWITH_LZ4=ON" "-DWITH_ZSTD=ON" "-DWITH_SNAPPY=ON" "-DCMAKE_INSTALL_PREFIX=/Users/chen/sourcetree/libra/target/debug/build/libtitan_sys-36c7dd4a027b620e/out" "-DCMAKE_C_FLAGS= -ffunction-sections -fdata-sections -fPIC -m64" "-DCMAKE_C_COMPILER=/usr/bin/cc" "-DCMAKE_CXX_FLAGS= -ffunction-sections -fdata-sections -fPIC -m64" "-DCMAKE_CXX_COMPILER=/usr/bin/c++" "-DCMAKE_BUILD_TYPE=Debug"
-- The C compiler identification is AppleClang <IP_ADDRESS>00020
-- The CXX compiler identification is AppleClang <IP_ADDRESS>00020
-- Check for working C compiler: /usr/bin/cc
-- Check for working C compiler: /usr/bin/cc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Found snappy: /Users/chen/sourcetree/libra/target/debug/build/snappy-sys-e1e69101c91499f8/out/build/libsnappy.a
-- Found bzip2: /Users/chen/sourcetree/libra/target/debug/build/bzip2-sys-c87b19b7c69fbc99/out/lib/libbz2.a
-- Found lz4: /Users/chen/sourcetree/libra/target/debug/build/lz4-sys-d724b89235dc6fd2/out/liblz4.a
-- Found zlib: /usr/lib/libz.dylib
-- Found zstd: /Users/chen/sourcetree/libra/target/debug/build/zstd-sys-cfe41a66a86244fb/out/libzstd.a
-- Performing Test HAVE_SSE42
-- Performing Test HAVE_SSE42 - Success
-- Performing Test HAVE_THREAD_LOCAL
-- Performing Test HAVE_THREAD_LOCAL - Success
-- Enabling RTTI in Debug builds only (default)
-- Performing Test HAVE_FALLOCATE
-- Performing Test HAVE_FALLOCATE - Failed
-- Performing Test HAVE_SYNC_FILE_RANGE_WRITE
-- Performing Test HAVE_SYNC_FILE_RANGE_WRITE - Failed
-- Performing Test HAVE_PTHREAD_MUTEX_ADAPTIVE_NP
-- Performing Test HAVE_PTHREAD_MUTEX_ADAPTIVE_NP - Failed
-- Looking for malloc_usable_size
-- Looking for malloc_usable_size - not found
-- Looking for sched_getcpu
-- Looking for sched_getcpu - not found
-- Configuring done
-- Generating done
-- Build files have been written to: /Users/chen/sourcetree/libra/target/debug/build/libtitan_sys-36c7dd4a027b620e/out/build
running: "cmake" "--build" "." "--target" "titan" "--config" "Debug" "--"
Scanning dependencies of target titan
[  4%] Building CXX object CMakeFiles/titan.dir/src/base_db_listener.cc.o
--- stderr
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/base_db_listener.cc:1:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/base_db_listener.h:3:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/db_impl.h:4:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/db_impl.h:23:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/compaction_job.h:24:
/Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/internal_stats.h:111:5: error: declaration shadows a variable in namespace 'rocksdb' [-Werror,-Wshadow]
WAL_FILE_BYTES,
^
/Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/include/rocksdb/statistics.h:191:3: note: previous declaration is here
WAL_FILE_BYTES,   // Number of bytes written to WAL
^
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/base_db_listener.cc:1:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/base_db_listener.h:3:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/db_impl.h:4:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/db_impl.h:23:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/compaction_job.h:24:
/Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/internal_stats.h:112:5: error: declaration shadows a variable in namespace 'rocksdb' [-Werror,-Wshadow]
WAL_FILE_SYNCED,
^
/Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/include/rocksdb/statistics.h:190:3: note: previous declaration is here
WAL_FILE_SYNCED,  // Number of times WAL sync is done
^
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/base_db_listener.cc:1:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/base_db_listener.h:3:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/db_impl.h:4:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/db_impl.h:23:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/compaction_job.h:24:
/Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/internal_stats.h:113:5: error: declaration shadows a variable in namespace 'rocksdb' [-Werror,-Wshadow]
BYTES_WRITTEN,
^
/Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/include/rocksdb/statistics.h:126:3: note: previous declaration is here
BYTES_WRITTEN,
^
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/base_db_listener.cc:1:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/base_db_listener.h:3:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/db_impl.h:4:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/db_impl.h:23:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/compaction_job.h:24:
/Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/internal_stats.h:114:5: error: declaration shadows a variable in namespace 'rocksdb' [-Werror,-Wshadow]
NUMBER_KEYS_WRITTEN,
^
/Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/include/rocksdb/statistics.h:119:3: note: previous declaration is here
NUMBER_KEYS_WRITTEN,
^
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/base_db_listener.cc:1:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/base_db_listener.h:3:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/db_impl.h:4:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/db_impl.h:23:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/compaction_job.h:24:
/Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/internal_stats.h:115:5: error: declaration shadows a variable in namespace 'rocksdb' [-Werror,-Wshadow]
WRITE_DONE_BY_OTHER,
^
/Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/include/rocksdb/statistics.h:196:3: note: previous declaration is here
WRITE_DONE_BY_OTHER,  // Equivalent to writes done for others
^
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/base_db_listener.cc:1:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/base_db_listener.h:3:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/db_impl.h:4:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/db_impl.h:23:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/compaction_job.h:24:
/Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/internal_stats.h:116:5: error: declaration shadows a variable in namespace 'rocksdb' [-Werror,-Wshadow]
WRITE_DONE_BY_SELF,
^
/Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/include/rocksdb/statistics.h:195:3: note: previous declaration is here
WRITE_DONE_BY_SELF,
^
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/base_db_listener.cc:1:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/base_db_listener.h:3:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/titan/src/db_impl.h:4:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/db_impl.h:23:
In file included from /Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/compaction_job.h:24:
/Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/db/internal_stats.h:117:5: error: declaration shadows a variable in namespace 'rocksdb' [-Werror,-Wshadow]
WRITE_WITH_WAL,
^
/Users/chen/.cargo/git/checkouts/rust-rocksdb-82ef6e5337b3fbe6/8d6cda7/librocksdb_sys/libtitan_sys/../rocksdb/include/rocksdb/statistics.h:198:3: note: previous declaration is here
WRITE_WITH_WAL,       // Number of Write calls that request WAL
^
7 errors generated.
make[3]: *** [CMakeFiles/titan.dir/src/base_db_listener.cc.o] Error 1
make[2]: *** [CMakeFiles/titan.dir/all] Error 2
make[1]: *** [CMakeFiles/titan.dir/rule] Error 2
make: *** [titan] Error 2
thread 'main' panicked at '
command did not execute successfully, got: exit code: 2
build script failed, must exit now', /Users/chen/.cargo/registry/src/github.com-1ecc6299db9ec823/cmake-0.1.40/src/lib.rs:832:5
note: Run with RUST_BACKTRACE=1 environment variable to display a backtrace.
warning: build failed, waiting for other jobs to finish...
error: build failed`

@wbm0701 did @wqfish comment help you fix your issue?


Some questions

First of all, thanks for open sourcing this client. While very useful, I have some questions too.
In your documentation, it mentions the following code sample to send a message:
$message = $api->getTicketApi()->postMessage(['ticket_id' => 1, 'user_id' => 1, 'text' => 'Message']);

That doesn't work. This should probably be getApiClient()->postMessage($messageArray) as postMessage only accepts a CreateMessage class. It's not really a problem, but since this class doesn't come with a constructor, you have to use setters to set its properties, which to me, feels like a step back these days, especially as 7.4 is there for a while now.
When would you expect to bump the client to PHP >7.4? This way, all properties can be type hinted and public.
I'm lost when it comes to attachments. I have an instance of CreateMessage. This comes with a setAttachment property but it only accepts an array or null. Where can I find how to add one or more attachments to the message I'm sending?

Thank you for using the client. It looks like the documentation is using a slightly older version of the client, we will update it shortly.  The current simpler way to do this now is by using the fill method.
$createMessage = (new CreateMessage)->fill(['ticket_id' => 1, 'user_id' => 1, 'text' => 'Message']);
$message = $api->getTicketApi()->postMessage(createMessage);

As for the setAttachment,  following https://api.supportpal.com/api.html#ticket-message-post, this would currently expect an array of the key-valued array as follows:
$attachments = [
    ['filename' => 'test', 'contents' => 'base-64-string',],
     ['filename' => 'test2', 'contents' => 'base-64-string-2',]
 ];
$createMessage->setAttachment($attachments);

We're not sure when we'd be able to bump this to PHP-7.4 due to having other internal dependencies, but we'd love to do that asap.
Sorry for the confusion, hope that this makes it clearer!

I got things working, but the attachment implementation feels off. I posted parts of the below in the PR too, but that got closed around the same time so you have probably missed it.
Out of curiosity, why are you using arrays to create an attachment? There is an Attachment model. Why don't you modify this model so it accepts the base64 encoded content? Or have two properties, one of encoded, the other for unencoded?
Just to show our own abstracted implementation of your client, we're now doing this:
$message = (new Message(content: ''))
    ->addAttachment(new Attachment(
        filename: 'filename.txt',
        base64content: base64_encode('content'),
    ));

This is PHP8 by the way, so we got named properties ❤
It feels more intuitive for me/us. We've abstracted the message because we don't want to closely couple your implementation with ours. We're not planning to use another system, but this gives us flexibility.
Also, your client is very literal. I get that. It's easier and the client code matches 1 to 1 with the API. It isn't very fluid though. Our abstraction allows us to take this message and reply to a ticket like so:
$ticket->as($operator)->postReply($message);

In the background this will still use CreateMessage and add attachments, of course 😄
I am very happy that you've made this client though. We would have to abstract things away either way. But it would be great if future changes would be easier to grasp, without having to know if we have to use getTicketApi with what method.

The Attachment object we currently have maps another endpoint. The way I try to think about our models is that every attribute would map to an attribute in the API.
The idea was to minimize instantiations as we could since previous implementations were using arrays, thus, the transition would mostly be easier this way, but yes I agree that including an Attachment object, and having constructors would make things easier. This is definitely something to look at for the next iterations of this work to see how we can improve.
Your feedback is very highly appreciated, and will surely be put into consideration.


CMSIS-Core Cortex-M's Register Map is missing armv8-m registers

This page does not detail the mapping for Arm v8-m registers.
The source lives at: https://github.com/ARM-software/CMSIS_6/blob/2e095d0e84ac837b52e21c5b6930c3732cf527a3/CMSIS/Documentation/Doxygen/Core/src/register_mapping.md

Jonatan, do we have the mapping info somewhere?


Persisting ZFP compressed arrays

Thought'd be better to capture discussion here instead of email ;)
I don't have a lot of experience designing C++ objects or their interfaces but I am wondering...from the perspective of a ZFP compressed array, what is the proper/ideal interface for persisting it?
Here is an idea I have with the goal of making it easy to integrate ZFP's compressed array implementation with HDF5 without having to introduce HDF5 dependencies to ZFP.

Add static, private members to these classes, _load_fptr and _store_fptr  which are function pointers to two global functions to load or store a ZFP array.
Add static methods load and store to ZFP compressed array base class. Something like...

int store(char const *path=0, void *storage_id=0)
{
    if (!_store_fptr) return 1;
    return (*_store_ftpr)(path, storage_id);
}
int load(char const *path, void *storage_id=0)
{
    if (!_load_fptr) return 1;
    return (*_load_fptr)(path, storage_id);
}

By default, the above function pointers point to two default methods implemented in ZFP for writing ZFP arrays to files in the file system (e.g. just write the zfp stream to a file). Something like...

int store(char const *path, void *storage_id)
{
    char const *name = path ? path : <make a name up>;
    FILE *f = fopen(name, "w");
    if (!f) return 1;
    if (fwrite(this->compressed_data(), 1 this->compressed_size, file) =this->compressed_size())
    { fclose(f); return 1;}
    fclose(f);
    return 0;
}

Define a global function that allows a caller to update the function pointers, above, to those of their own choosing (e.g. ones that will read or write ZFP arrays to an HDF5 file). Something like...

static void set_persistents_methods((*load)(char const *, void*), (*store)(char const *, void*));

storage_id is interpreted as needed by the implementation of a given load/store pair. For HDF5 it would be a hid_t loc_id
Now, an application can include a library that supports writing ZFP array classes with HDF5 but the ZFP classes themselves are agnostic to this.
This design allows caller to wholly switch the persistents methods of all instances, those in existence now or created in the future, in a single, simple call. But, maybe this is too heavy handed? Ok, so do it both ways...allow the ability to set these global properties, but also allow any ZFP array instance to override the global settings. New instances that are constructed inherit initially the globally defined behavior but caller can override.

Mark, I think the issue of storing a compressed array to file is a little out of scope for the zfp API itself.  The 0.5.5 release will have support for serializing a compressed array to memory and a factory function for constructing an array from an in-memory compressed buffer (see https://github.com/LLNL/zfp/tree/feature/compressed-array-header).  These functions use zfp's header to fully describe array rank, dimensions, scalar type, compression mode, etc., and will allow you, for instance, to write out a compressed array and later decompress it using the command-line tool, as if the compressed file had been generated by the command-line tool in fixed-rate mode.
As your code example illustrates, zfp already has a method that return a pointer to the compressed byte stream (array::compressed_data()) that  the caller can use to write the compressed data to disk (or read compressed data into).  And as you point out, there are many ways of writing data to disk, e.g., via fwrite, HDF5, ADIOS, or other container formats or I/O interfaces.  You might also want to communicate arrays to other processors, e.g., via MPI, over a socket, over a named pipe, etc.  I think it's best to leave this out of the zfp API while providing the functionality necessary to construct and serialize arrays.
If you want to have a generic interface for doing this, then I don't think C-like function pointers are the right approach.  The natural C++ way of doing this would be via inheritance, possibly using virtual functions.  Though I'm not convinced these need to be member functions.
With respect to HDF5, I'm not sure I understand what problem these two functions address.  Can you please elaborate?

Regarding other forms of writing (or reading) a ZFP compressed array...I agree.
You don't want to complicate ZFP implementation with this or add depdendencies on other packages people might serialize ZFP arrays through (e.g. MPI, HDF5, etc). I get that. I agree.
But, without providing some abstraction in ZFP itself (you don't have to call it load or store, call it stream_out and stream_in or something more general), everyone is forced to inheret to embue any ZFP instance with this ability. I know that is the C++ way of doing this kind of thing. I just view it as common use case that is then made more complicated for many consumers of the ZFP compressed array classes interface for lack of some abstraction in ZFP itself to support/facilitate it.
Case in point, don't a lot of the ZFP array classes example codes in ZFP write ZFP arrays to files. Seems like a common use case.
My reason for suggesting a static approach is to make it easy, a single function call, to ensure any ZFP array class instance existing or created in the future, is them embued with this ability.
Maybe its worth considering the following use case....Suppose I am using ZFP array classes throughout my code. Now, I want to save them to disk, or MPI send them to different ranks, etc. What is the coding involved to do that given how ZFP array classes work now and is there anything ZFP array classes can do to simplify that. I think there is. But, I don't think it comes for free. I think ZFP array classes then need some kind of a supporting abstraction.
Thats all I am saying.

Currently we do not have a code example that writes zfp arrays to disk.  Nor am I aware of an application that does this, although I do expect this to become a more common use case in the future as apps start adopting zfp arrays in their computations.  This is one reason why we're adding  a mechanism to Conduit for expressing zfp arrays as Conduit nodes.
What I am still unsure about is what your proposed two function pointers accomplish that cannot already be done as easily through other means.  Note that the load & store functions still have to be implemented by the application, and will likely require additional arguments (e.g., file descriptor) as source/target that are not naturally handled through a fixed function prototype.
Here are a few alternatives I see.  (1-3) are already available.

Use compressed_data() and compressed_size() in application-defined load/store functions to read/write the compressed data, as in the example you provided.  Metadata can either be stored by the application verbatim or via zfp's header.  By accessing the compressed data through a pointer, this avoids copying any data.

Use the soon to be released factory function to load (construct) a zfp array from memory and a combination of write_header() and compressed_data() to store.  The caller would either fwrite() the header and compressed data directly or concatenate them to a user-allocated memory buffer before outputting.  One disadvantage is that this makes a separate copy of the compressed data before doing I/O.  I agree that this could be made simpler.  @salasoom, do we not have a single function that serializes the array as an inverse of the factory function?

Derive a new class from a zfp array that adds load & store functions.  The programming effort is essentially identical to your proposal of adding function pointers to the zfp array classes.  A little less, actually, since you do not need to set function pointers and define the functions and their prototypes externally.  One benefit of this approach is that load & store could take any number of other arguments  of any type needed for I/O.

Add virtual load & store functions to zfp's classes, making these officially part of the zfp API.  The programming effort is the same as in the previous solution, although this approach would officially extend the zfp API.  One benefit over (3) is a more uniform API; one drawback is that other arguments needed for I/O must be passed through a common API (or encapsulated in the derived class itself).

Your proposed solution differs from these, and I'd like to understand better its advantages of these alternatives.

What about mmap-backed ZFP compressed arrays? I ended up modifying array/zfparray.h and array/zfparray3.h after importing the whole zfp-0.5.4 into own github project:
https://github.com/jvo203/FITSWebQL
The 3D cubes that need to be handled in the near future are astronomical (they come from radio-astronomy and their sizes are "astronomical"): over 256TB uncompressed per cluster node. There is no way ZFP-compressed arrays can all fit in RAM. Also, the data contains NaN so there is a need to substitute 0.0 for NaNs and track non-values via separate compressed bit arrays.

@jvo203 We will not have mmap support right away.  The main issue is dealing with ownership of memory.  Currently zfp arrays own their own memory, and our (de)serialization API will make a deep copy in case the user allocates data for compressed storage themselves (as would be needed with mmap).  We're considering adding support for shallow copies by maintaining who owns the relevant memory buffer, e.g., so that zfp does not attempt to deallocate user-allocated memory when arrays are destructed or resized.
As for NaNs, this is something that we've been working toward for quite some time.  We don't have a solution yet that is ready for release, but we will handle NaNs in the future.  I will caution that replacing NaNs with zeros will in most cases introduce artificial discontinuities that hurt compression.  zfp has to deal with the same problem for arrays whose dimensions are not multiples of four, in which case it inserts padding for partially filled blocks that promotes compression.  We ought to include a utility function that does something similar for more general cases of partially filled blocks, but I doubt this could be accomplished before the next release.  If this is a problem for you, please file a separate issue and I'll see if we can provide such a function on a feature branch after we're done with the 0.5.5 release.

Thank you for a prompt response. Regarding NaNs, what would be the recommended optimum replacement value to put in partially-filled blocks? The arithmetic mean of all the other non-NaN values? We also have blocks that contain nothing but NaNs, in which case I guess 0.0 would be OK.
Checking for NaN and putting 0.0 is done in a separate SIMD code that goes through each widthxheight 2D plane at once (it also converts from big-endian to little-endian) without considerations for 4x4 block boundaries. As this is ultimately a 3D cube, checking each 4x4x4 block for NaN and calculating block-specific optimum replacement value prior to pushing values to a mutable private_view  (OpenMP multithreading operating on widthxdepthx4 private views) seems a bit burdensome.
Typically NaNs appear at the boundary of the data so I guess we can live with sub-optimum compression here and there, as long as it is not pervasive.

Thank you for a prompt response. Regarding NaNs, what would be the recommended optimum replacement value to put in partially-filled blocks? The arithmetic mean of all the other non-NaN values?

Unfortunately, the optimal padding is not a single fill value but depends on the spatial configuration of available values.  For partial blocks, zfp uses one of the up to three available values within the same block of four values along one dimension.  For optimal compression, a better solution would be to perform a polynomial fit, but that can result in overshoots that lead to overflow.

We also have blocks that contain nothing but NaNs, in which case I guess 0.0 would be OK.

Yes, that would be ideal.

Checking for NaN and putting 0.0 is done in a separate SIMD code that goes through each widthxheight 2D plane at once (it also converts from big-endian to little-endian) without considerations for 4x4 block boundaries. As this is ultimately a 3D cube, checking each 4x4x4 block for NaN and calculating block-specific optimum replacement value prior to pushing values to a mutable private_view (OpenMP multithreading operating on widthxdepthx4 private views) seems a bit burdensome.

It may not be all that bad.  If you're using AVX for this, then you're processing groups of four values anyway.  You'd want to use zfp's iterators to initialize one block at a time.  Unfortunately zfp's views do not yet have iterators, which is something that will be addressed in the coming year.
Can this preprocessing be done to the uncompressed data before "converting" it to zfp?
What is the third dimension in this case?  Color/spectral band?  If so, then there may not necessarily be any correlation across bands, in which case you might favor 4 2D arrays.

Typically NaNs appear at the boundary of the data so I guess we can live with sub-optimum compression here and there, as long as it is not pervasive.

In the case of zfp's compressed arrays, the compression ratio is fixed, so what would suffer is accuracy rather than compression.  You'd most certainly be better off replacing NaNs with some kind of average rather than zeros, in case you're looking for a simple solution.

Yes, the pre-processing part (endianness, NaNs, non-value bit masks) only needs to be done once, upon the first-time reading of an astronomical FITS file containing a 3D data cube. Afterwards, all the subsequent data accesses only read the FITS file header (skipping the FITS data cube) and go directly to an offline already-compressed ZFP cube (mmapped file).
Radio-astronomy FITS data cubes: width x height x depth x polarisation . I am not handling the polarisation part for now, it will come later. The depth dimension is frequency bands. So we are dealing with 2D planes for a number of frequency bands, with the pixels containing intensity values [Jy/beam]. Yes, in most cases there is a fair amount of correlation between neighbouring 2D planes, hence there is a single 3D ZFP cube instead of a collection of separate 2D ZFP planes.

@markcmiller86, @jvo203: I wanted to let you know that we have released zfp 0.5.5, which adds support for (de)serializing compressed arrays.  This is actually quite straightforward (see the examples here for how to do this using fread and fwrite).
The API does not yet support mmap, for the reasons already discussed.  Doing so would require a more general mechanism for tracking who owns the compressed data buffer.  I do not foresee any particular challenges with supporting this, but we just didn't have time to add such functionality to this release.
@jvo203, since this issue has more to do with managing memory ownership (an issue not limited to mmap) and less to do with (de)serialization, I would prefer if you'd submit a separate issue that more directly addresses your request so we can close the issue opened by @markcmiller86.  We should be able to support mmap in the next release.