Syscall and HLE callback handler

Problem
For syscalls alone, #2 is a bit unclear of what it does, and after some elaboration, some parts of it don't make much sense and unnecessarily complicates things (like multilayer syscall handling and letting syscall handler's process() instead of using the callback object itself to handle host-guest data conversion).
We also wanted to have a unified way to handle guest callbacks for both syscall and HLE modules. This proposal takes both use cases into account.
Proposal
Some basic points

Inside the Unicorn hooks, queue an event for the main loop to process and trigger a scheduler yield by calling uc.emu_stop(). Then in the main loop, run the appropriate GuestRequestHandler, schedule the next thread or panic depending on the yield reason.
Both handlers have a list of available modules but behave differently. Syscall handler holds a Sequence of handler classes that gets instantiated sequentially on creation, while HLE modules holds a Mapping of handler classes that need to be queried and loaded manually elsewhere.
HLEModule does not need to map the memory pages. This should be handled by the Loader. The Loader will also be responsible for initializing the HLE module and installing it using GuestRequestHandler#register_guest_module() on the HLEModuleHandler instance.

Workflow
Emulator context: on_intr(2) or on_page_fault() -> set flag and signal the emulator to stop
Emulator context main loop:
stop due to svc ->
  extract syscall num and reformat stack frame ->
  self._states.grh_syscall.process_request(syscall_num) ->
  look up corresponding GuestModule object ->
  GuestModule#process(syscall_num) ->
  GuestCallback#respond_to(self._uc)

stop due to prefetch abort ->
  self._states.grh_hle_func.process_request(addr) ->
  look up corresponding GuestModule object ->
  GuestModule#process(addr) ->
  GuestCallback#respond_to(self._uc)

Modeling
GuestRequestHandler:
A _uc
A _states
A _table: dict[int, GuestModule]
A _modules: list[GuestModule]
M __init__(_uc, _states)
M process_request(req_key) -> query _table and run GuestModule#process(req_key)
M register_guest_module(module: GuestModule) -> read available_keys, do intersection check and index them in table -> return index in _modules
M unregister_guest_module(module_index: int) -> fetch _modules[module_index] and delete all entries in _table before del itself

SyscallHandler(GuestRequestHandler):
A ENABLED_MODULES： list[SyscallModule]
M __init__(_uc, _states) -> super() -> self.register_guest_module(module) for module in ENABLED_MODULES

HLEModuleHandler(GuestRequestHandler):
A AVAILABLE_MODULES: dict[str, HLEModule]
M find_guest_module(name) -> search AVAILABLE_MODULES

GuestModule(Protocol):
G available_keys: set[int]
M process(key) (usually this will be only one line, no need to subclass it tbh)

SyscallModule:
A _uc
A _states
A _table: dict[int, GuestCallback]
M __init__(_uc, _states) -> scan methods decorated with @syscalldef, make GuestCallback objects for each entry and store them in _table
M process(key) -> get from _table and execute it.
G available_keys

HLEModule:
A _uc
A _states
A _table: dict[int, GuestCallback]
A _names: dict[str, int]
M __init__(_uc, _states, base) -> scan methods decorated with @fcndef, make GuestCallback objects for each entry and store them in _table with an allocated address based on base. Extract names set by @fcndef and populate _names with the names and allocated addresses.
M process(key) -> get from _table and call GuestCallback#respond_to(self._uc).
G available_keys
G sizeof -> calculates the minimum memory size required for this handler. This will not be page-aligned.

GuestCallback:
A callback
A ret
A args
M __init__(callback, ret, args)
M respond_to(uc) -> parse APCS args, pass result to underlying callback and set return value

There are also requests that need to be handled asynchronously (specifically any handlers that need to hand over the control to other threads while still be able to return results at a later time e.g. anything related to synchronization and things like Buzzer() which delays or yields in syscall via OSSleep())
We need to change this proposal slightly to handle this preferably with asyncio and perhaps a separate emulator execution thread controlled by an asyncio event loop.


Improve verification of steady and unsteady Navier-Stokes

Also use Firedrake's nullspace feature

I meant to squash and merge and must have hit the wrong button, because the PR wasn't merged, though it was closed. The checks has already passed before and I don't want to wait on Travis to do this again. The commit to master will be checked by Travis.


adding source column to the model spec

MSFT employees can try out our new experience at OpenAPI Hub  - one location for using our validation tools and finding your workflow.

Changelog
Add a changelog entry for this PR by answering the following questions:

What's the purpose of the update?

[ ] new service onboarding
[ ] new API version
[x] update existing version for new feature
[ ] update existing version to fix swagger quality issue in s360
[ ] Other, please clarify

When are you targeting to deploy the new service/feature to public regions? Please provide the date or, if the date is not yet available, the month. ~ end of April
When do you expect to publish the swagger? Please provide date or, the the date is not yet available, the month. ~end of April
If updating an existing version, please select the specific language SDKs and CLIs that must be refreshed after the swagger is published.

[x] SDK of .NET (need service team to ensure code readiness)
[ ] SDK of Python
[ ] SDK of Java
[ ] SDK of Js
[x] SDK of Go
[ ] PowerShell
[ ] CLI
[x] Terraform
[ ] No refresh required for updates in this PR

Contribution checklist:

[x] I commit to follow the Breaking Change Policy of "no breaking changes"
[x] I have reviewed the documentation for the workflow.
[ ] Validation tools were run on swagger spec(s) and errors have all been fixed in this PR. How to fix?

If any further question about AME onboarding or validation tools, please view the FAQ.
ARM API Review Checklist

Applicability: :warning:
If your changes encompass only the following scenarios, you should SKIP this section, as these scenarios do not require ARM review.

Change to data plane APIs
Adding new properties
All removals

Otherwise your PR may be subject to ARM review requirements. Complete the following:

[ ] Check this box if any of the following apply to the PR so that label "WaitForARMFeedback" will be added automatically to begin ARM API Review. Failure to comply may result in delays to the manifest.

Adding a new service
Adding new API(s)
Adding a new API version
-[ ] To review changes efficiently, ensure you are using OpenAPIHub to initialize the PR for adding a new version. More details, refer to the wiki.

[ ] Ensure you've reviewed following guidelines including ARM resource provider contract and REST guidelines. Estimated time (4 hours). This is required before you can request review from ARM API Review board.

[ ] If you are blocked on ARM review and want to get the PR merged with urgency, please get the ARM oncall for reviews (RP Manifest Approvers team under Azure Resource Manager service) from IcM and reach out to them.

Breaking Change Review Checklist
If any of the following scenarios apply to the PR, request approval from the Breaking Change Review Board as defined in the Breaking Change Policy.

[ ] Removing API(s) in a stable version
[ ] Removing properties in a stable version
[ ] Removing API version(s) in a stable version
[ ] Updating API in a stable or public preview version with Breaking Change Validation errors
[ ] Updating API(s) in public preview over 1 year (refer to Retirement of Previews)

Action: to initiate an evaluation of the breaking change, create a new intake using the template for breaking changes. Addition details on the process and office hours are on the Breaking change Wiki.
Please follow the link to find more details on PR review process.

Version change is not required since we are passing a read-only field/property as part of response. We can update the documentation to reflect that.
PR also falsely claims that there are credentials, but the update includes only a new property inclusion and no credential info.


Rename config server names to reflect the new naming for servers.

We have decided not to implemented this change


Adding fix and test for issue reported within 620

Summary of changes (Bug fix, feature, docs update, ...)

There was a bug reported in relation to Issue 620, which was related to observation data (specifically ICOS and TAC). When the sampling_period attribute has a value of 'NOT_SET', this raised a ValueError when trying to combine observations and data with ModelScenario (using ModelScenario.combine_obs_footprint).
The ValueError was raised because this was trying to cast the string 'NOT_SET' as a float but this line could just be removed.

Please check if the PR fulfills these requirements

[x] Tests added and passed if fixing a bug or adding a new feature
[x] All code checks passing - black --line-length 110 run over code, mypy and flake8 not showing any errors
[x] Added an entry in the latest CHANGELOG.md file if fixing a bug or adding a new feature

Codecov Report
Attention: 4 lines in your changes are missing coverage. Please review.

Comparison is base (20e7f83) 33.59% compared to head (4daf865) 33.65%.

:exclamation: Current head 4daf865 differs from pull request most recent head 299cb50. Consider uploading reports for the commit 299cb50 to get more accurate results

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@            Coverage Diff             @@
##            devel     #808      +/-   ##
==========================================
+ Coverage   33.59%   33.65%   +0.05%
==========================================
  Files         180      180
  Lines       14030    14045      +15
==========================================
+ Hits         4714     4727      +13
- Misses       9316     9318       +2

Files
Coverage Δ

tests/analyse/test_scenario.py
100.00% <100.00%> (ø)

openghg/analyse/_scenario.py
0.00% <0.00%> (ø)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


reorder.js doesn't work with 8x8 video conference site.

8x8 is the paid version of Jitsi. Meetings are hosted from https://app.8x8.vc
When using the reorder.js shortcut, the following error appears in the console:
reorder.js:10 Uncaught ReferenceError: $ is not defined
    at addDragulaStyles (reorder.js:10)
    at reorder.js:108
    at reorder.js:114
addDragulaStyles @ reorder.js:10
(anonymous) @ reorder.js:108
(anonymous) @ reorder.js:114

Sounds like their version of Jitsi is a bit different than the open source version.
A pull request to add support for 8x8 is welcome. But I have no interest in doing this myself.

I get this same error with jitsi not the 8x8 version, and I am hosting on my own server. Trying to get the reorder to work.

It's very pity this script does not work with current jitsi meet. May be there is update one?


Update logo and styles

fixes #221

Looks great. Thanks @avdata99.
Don't call me a maniac (hahaha), but before deploying could you align the OKFN logo with the Open Definition logo?

Then we are good to go.

fixed @lucpretti


Refactoring Components

Side Nav Bar has it's own component and there is a easy way to add or remove links.
Router now renders a components from the views folder instead of a render function.
Added a background-color to the active class (change it to the desired color).
Changed the title from "React App" to "Resource Center".
I also wanted to add React Helmet to dynamically change the title based on the render component but I didn't know if you wanted it.
The linting stuff gave me some headache when I was trying to commit but managed to fix the errors.
See you in the livestream (hopefully).
Sebastian.

I just saw the other PR #2 . If you like that style better you can easily change it but maintain it in it's own component.

Thanks Sebastian! This was really great. I was able to use some of the code from #2 in the form of a separate SideBarItem.js component.


JoinPoints on more than 2 connectors omits last strut when re-opening a file

The problem appears to occur only when opening an existing file. JoinPoints works OK interactively.
Steps to reproduce problem:

From a new blank model, draw three blue struts from the ball at the origin. I drew one on the X axis, one on the Y axis, then one on the Z axis.
Select the three new balls, but not the one at the origin. I selected them in the same order that I drew them: X, then Y then Z.
Click on the topmost icon in the tool bar to "Join two or more selected balls".
This generates 3 new green struts that form an equilateral triangle. Including the three original blue struts, the model now consists of 4 balls and 6 struts forming a right angled tetrahedron.
Save the model as a .vZome file.
Open the .vZome file that was saved in the previous step.
Note that only two of the green struts are drawn. In my case, the strut joining the first ball I had selected (X) and the last one (Z) was the one that was missing.

Note that if only two balls are selected so the JoinPoints command generates a single strut, then the saved file opens correctly. It's only when three or more balls are selected, generating more than one strut, that the problem occurs.

Good catch.  It happens in vZome 4.0, also, so it is an old bug.
If you use the menus, there are two forms of the join command, one that closes the loop and one that does not.  Looks like the mode attribute is not getting saved with the right value, in the XML.

Found it: JoinPoints.java, line 36.  I used to use XOM, which would give a null attribute value string.  DOM, however, returns the empty string.
There are very likely other bugs in this pattern.


html corrupt Cyrillic symbols

Strange, but img is ok.

Sorry, chrome encoding detection is garbage...


Add chrome headless dependencies to python images

Add chrome headless dependencies to

Tags

3.0, 3.0-python3.6

3.0-appservice, 3.0-python3.6-appservice

3.0-python3.7

3.0-python3.7-appservice

3.0-python3.8

3.0-python3.8-slim

3.0-python3.9

3.0-python3.9-slim

Closes #407
PR information

[x] The title of the PR is clear and informative.
[x] There are a small number of commits, each of which has an informative message. This means that previously merged commits do not appear in the history of the PR. For information on cleaning up the commits in your pull request, see this page.
[x] If applicable, the PR references the bug/issue that it fixes in the description.
[ ] New Unit tests were added for the changes made and CI is passing.

@pragnagopa @CooperLink
They were initially added just for node, yes. To support puppeteer and playwright. But it seems that some python customers also need them. This is adding them to the python images as well.

@cooperlink - Please see if this can be moved to base image


First Android app: Android Basics with Compose

https://developer.android.com/codelabs/basic-android-kotlin-compose-first-app?continue=https%3A%2F%2Fdeveloper.android.com%2Fcourses%2Fpathways%2Fandroid-basics-compose-unit-1-pathway-2%3Fhl%3Den%23codelab-https%3A%2F%2Fdeveloper.android.com%2Fcodelabs%2Fbasic-android-kotlin-compose-first-app&hl=en#6
Step 7 (Add Padding)
Using the parameter as Modifier.padding(24.dp) does nothing. Rather it should be Modifier.padding(all = 24.dp).
Steps to reproduce?

Go to...
Click on...
See error...

Versions
Android Studio version:
API version of the emulator:
Additional information
Include screenshots if they would be useful in clarifying the problem.

Good morning, it just worked for me, but for the whole subtitle background only after editing the text it worked fine.

@SebastianWozniczka
Both code snippets you gave should work the same way.
Seems like you figured it out. Closing this issue.


nixos/top-level: change extraDependencies from packages to paths

I was once again trying to work around https://github.com/NixOS/nix/issues/3995 by (recursively) adding my flake inputs to system.extraDependencies; this time nixd, which depends on flake-parts, which depends on the lib subdirectory of nixpkgs.
This fails because the subdirectory flake does not pass types.package.check: it's not a derivation, and it's not a store path either (it's a subdirectory of a store path).
Change the type to path, because there's no "store path or descendant" type. Honestly I'm not sure why anyone would ever use types.package at this point.
Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

because there's no "store path or descendant" type.

We could call that types.pathInStore perhaps.

Honestly I'm not sure why anyone would ever use types.package at this point.

Packages and paths should be treated differently, because packages can have multiple outputs. I'm pretty sure extraDependencies doesn't treat packages like packages. What even is the implied usage for those packages? Should it keep .doc? Does that even make sense? We should probably rename it to extraPaths, so that you can guess the behavior correctly, as it effectively just takes the outPath.

Added pathInStore.
I'm not sure extraPaths is less ambiguous than extraDependencies so I've left the option name alone.


Expanding 16-bit PCM to 32-bit PCM

Hi. @pschatzmann. Thank you for your contribution.
A few years ago, I managed to modify the ESP-IDF a2dp_sink sample for an external DAC to get a very clean sound from the external DAC.
I thought about applying the fix at that time to this library.
And I forked your library and made some modifications.
I considered sending a pull request to your library, but couldn't figure out a good fix.
Could you take a look at my fix? Please tell me even when you have time.
The modified part is BluetoothA2DPSink :: audio_data_callback ().
I used i2s_write_expand () to extend the input of 16-bit sampling to 32-bit sampling. Replaced i2s_write () with i2s_write_expand ().
However, I didn't understand the relationship between the source below and i2s_write ().
https://github.com/riraosan/ESP32-A2DP/blob/f93979c5e5212bd46fc9c806957d79f49f1f9384/src/BluetoothA2DPSink.cpp#L687-L698
This is the i2s setting part of the application class. I have confirmed that this application can output sound from an external DAC.
Under what conditions should I write code that uses i2s_write () and i2s_write_expand () properly?

Is it possible to replace all i2s_write () with i2s_write_expand ()?

A2DP will in any case only provide 16 bit data, so I doubt that expanding it to 32 bit will have any impact on the sound quality. I guess this only makes sense if your DAC can only support 32 bit - but so far I haven't seen such a thing.
If you want to go ahead with this, my suggestion would be that you make it dependent on i2s_config_t bits_per_sample: if this is set  > 16 you would call the  i2s_write_expand. I am not sure however if this is will work since I never tried this myself....

Hi. @pschatzmann

If you want to go ahead with this, my suggestion would be that you make it dependent on i2s_config_t bits_per_sample: if this is set > 16 you would call the i2s_write_expand. I am not sure however if this is will work since I never tried this myself....

I only have a DAC dedicated to 32bit samples, so I can't check with a 16bit sample DAC. I'll give it a try anyway, maybe I can check with ESP's internal DAC.
Thank you for your suggestion!👍

Can you maybe send me a link to the spec of your DAC ?
32 bit dacs usually also support 16 and 24 bits...

ES9038Q2M VR1.07 DAC Board(eBay item number:263908779821)
This is my DAC.
https://www.ebay.com/itm/263908779821?_ul=JP
Input support:
Coaxial: PCM44.1K-192K 24BIT / DOP DSD64
Fiber: PCM44.1K-192K 24BIT / DOP DSD64
IIS / DSD: PCM44.1K-384K 32BIT / DSD64, DSD128, DSD256
IIS / DSD pin definition:
Maybe IIS input fixed 32BIT.🤔

Thank you for your contribution.👍
I closed this issue.👋

Did you finally manage to make it work with 32 bit?
If so, I would be interested in a pull request...

Hi. @pschatzmann
Don't get your hopes up, just wait and see.
My work has temporarily stopped, so I'm taking a vacation tomorrow (the 4th).
I'm going to stay home and do some serious work on your library for my DAC.
I'm addicted to a certain song that was recently distributed. I'd like to use your library to listen to it on my DAC and my home audio system. 👍
If I can fix it, please review it on my pull request.👍
Thanx!

Hi. @pschatzmann
I would like to send a pull request for this issue. Please review it. It would be nice to get some pointers.
I have done a simple unit test with PlatformIO.
As it turns out, only 32-bit samples work with my DAC.
I would like you to confirm if it works with 16-bit samples or not.
Thanks!👍


Question: Account specific credential view?

Question: The Trust Anchor issued a member credential, and the member then issued a user credential. Both are "attached" to their corresponding addresses (Altme asks to which account I want to present the credential if I'm not mistaken). However, shouldn't the corresponding credential on the main page of Altme only be visible to the account owner?
View of the user:

yes, all credential accounst are displayed currently
we are going to take that into account

new ticket https://github.com/TalaoDAO/AltMe/issues/2680

Thx @dansan566 for raising this question, that would defnitly help our users an lead to less conusion by using the  altme to generate a USER and MEMBER Credential via our DEMIM plattform.


ld: symbol(s) not found for architecture x86_64

Getting following linking error:
Undefined symbols for architecture x86_64:
"_sqlite3_bind_double", referenced from:
-[RNSqlite2 bindStatement:withArg:atIndex:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_bind_int64", referenced from:
-[RNSqlite2 bindStatement:withArg:atIndex:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_bind_null", referenced from:
-[RNSqlite2 bindStatement:withArg:atIndex:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_bind_text", referenced from:
-[RNSqlite2 bindStatement:withArg:atIndex:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_close", referenced from:
-[RNSqlite2 dealloc] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_column_bytes", referenced from:
-[RNSqlite2 getSqlValueForColumnType:withStatement:withIndex:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_column_count", referenced from:
-[RNSqlite2 executeSql:withSqlArgs:withDb:withReadOnly:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_column_double", referenced from:
-[RNSqlite2 getSqlValueForColumnType:withStatement:withIndex:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_column_int64", referenced from:
-[RNSqlite2 getSqlValueForColumnType:withStatement:withIndex:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_column_name", referenced from:
-[RNSqlite2 executeSql:withSqlArgs:withDb:withReadOnly:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_column_text", referenced from:
-[RNSqlite2 getSqlValueForColumnType:withStatement:withIndex:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_column_type", referenced from:
-[RNSqlite2 executeSql:withSqlArgs:withDb:withReadOnly:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_errcode", referenced from:
+[RNSqlite2 convertSQLiteErrorToString:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_errmsg", referenced from:
+[RNSqlite2 convertSQLiteErrorToString:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_finalize", referenced from:
-[RNSqlite2 executeSql:withSqlArgs:withDb:withReadOnly:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_last_insert_rowid", referenced from:
-[RNSqlite2 executeSql:withSqlArgs:withDb:withReadOnly:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_open", referenced from:
-[RNSqlite2 openDatabase:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_prepare_v2", referenced from:
-[RNSqlite2 executeSql:withSqlArgs:withDb:withReadOnly:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_step", referenced from:
-[RNSqlite2 executeSql:withSqlArgs:withDb:withReadOnly:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_stmt_readonly", referenced from:
-[RNSqlite2 executeSql:withSqlArgs:withDb:withReadOnly:] in libRNSqlite2.a(RNSqlite2.o)
"_sqlite3_total_changes", referenced from:
-[RNSqlite2 executeSql:withSqlArgs:withDb:withReadOnly:] in libRNSqlite2.a(RNSqlite2.o)
ld: symbol(s) not found for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)
Is anyone facing the same issue for using 'react-native-sqlite-2' for iOS react-native app?

Link libsqlite3.tbd to your project
https://github.com/craftzdog/react-native-sqlite-2#ios

No response. Closing.


Validation set query

Hi,
Thanks for the code and the great paper.
In your paper you state that for TF-gene prediction you did three-fold CV, and the 38 TFs were divided into roughly equal 3 folds, (13, 13, 12). It seems like in the code the validation set the TFs are not separated out from the training but a mixture of TFs are selected from the training set. Is this how you ran the code for the results in the paper? Just checking as trying to replicate your results to then run on some of my own!
Thanks

Hi,
Thanks for your interest. You are correct, we did not particularly separate train and validation. Of course you can try it if you would like to.


If you log too much you get "too many requests" errors

using ConfigEnv
dotenv()

using Telegram, Logging, LoggingExtras

# Setting up Telegram for logging.
tg = TelegramClient()
tg_logger = TelegramLogger(tg; async = false)
demux_logger = TeeLogger(
    MinLevelLogger(tg_logger, Logging.Info),
    ConsoleLogger()
)
global_logger(demux_logger)

counter = 0
while counter < 10000
    @info "counter is $(counter)"
    global counter += 1
end

After 100 this gives me
ERROR: LoadError: HTTP.ExceptionRequest.StatusError(429, "POST", "/BOTINFO/sendMessage", HTTP.Messages.Response:
"""
HTTP/1.1 429 Too Many Requests
Server: nginx/1.18.0
Date: Thu, 03 Nov 2022 23:26:19 GMT
Content-Type: application/json
Content-Length: 111
Connection: keep-alive
Retry-After: 10
Strict-Transport-Security: max-age=31536000; includeSubDomains; preload
Access-Control-Allow-Origin: *
Access-Control-Expose-Headers: Content-Length,Content-Type,Date,Server,Connection

{"ok":false,"error_code":429,"description":"Too Many Requests: retry after 10","parameters":{"retry_after":10}}""")
Stacktrace:

It is possible to set an option so that it continues without errors in this case? In some applications it doesnt make sense to crash a program due to not being able to log it.

Thank you for this issue, it is fixed in v1.1.4


Beta release rework

Purpose
Added shuffling examples code. Added more documents to knowledge base.
Does this introduce a breaking change?
When developers merge from main and run the server, azd up, or azd deploy, will this produce an error?
If you're not sure, try it out on an old environment.
[ ] Yes
[X] No

Does this require changes to learn.microsoft.com docs?
This repository is referenced by this tutorial
which includes deployment, settings and usage instructions. If text or screenshot need to change in the tutorial,
check the box below and notify the tutorial author. A Microsoft employee can do this for you if you're an external contributor.
[ ] Yes
[X] No

Type of change
[ ] Bugfix
[X] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Documentation content changes
[X] Other... Please describe: more documents to knowledge base

Code quality checklist
See CONTRIBUTING.md for more details.

[ ] The current tests all pass (python -m pytest).
[ ] I added tests that prove my fix is effective or that my feature works
[ ] I ran python -m pytest --cov to verify 100% coverage of added lines
[ ] I ran python -m mypy to check for type errors
[ ] I either used the pre-commit hooks or ran ruff and black manually on my code.

Ran AZD up and it worked.

Want to merge beta release changes to main branch. Added feature to shuffle examples on landing page and improved knowledge base.


Profile Page Added

resolve #12
Completed profile page for logged-in users as well as other users.

Looks good!


Geeting error when trying to run the select_taxa.py script

Originally posted by shahed30 July 12, 2023
Hi all
I encountered an error while attempting to run the select_taxa script. My input command was "select_taxa.py --to_exclude exclude.txt --to_include include.txt".
In order to build my dataset, I utilized two .txt file containing single column taxa information to include and exclude taxa. Please refer to the attached image.

Traceback (most recent call last):
  File "/opt/anaconda/envs/fisher/bin/select_taxa.py", line 174, in <module>
    matrix = update_df_ortho(matrix)
  File "/opt/anaconda/envs/fisher/bin/select_taxa.py", line 92, in update_df_ortho
    gene, _, include = line.split()
ValueError: too many values to unpack (expected 3)

I am using phylofisher ver. 1.2.9.
I would greatly appreciate any assistance you can provide. Thank you.
Best
Shahed

Hi @shashed30,
Can you please provide the command you ran?
Thanks,
Robert

My input command was
select_taxa.py --to_exclude exclude.txt --to_include include.txt

Did you run select_orthologs.py first? If so, did you edit select_orthologs.tsv?

I ran select_taxa.py before select_orthologs.py

Can you try removing select_orthologs.tsv and re-running select_taxa.py?

Hi @shahed30,
I am just checking in to see if this has been resolved.
Best,
Robert

After removing the old select_orthologs.tsv file, I re-ran the
select_taxa.py, now it's working fine. Thank you.
Best
SHAHED
On Mon, Aug 14, 2023 at 10:54 AM Robert E. Jones @.***>
wrote:

Hi @shahed30 https://github.com/shahed30,
I am just checking in to see if this has been resolved.
Best,
Robert
—
Reply to this email directly, view it on GitHub
https://github.com/TheBrownLab/PhyloFisher/issues/87#issuecomment-1677485296,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ALFDLQPX4R5DQKJNANN6EDDXVI33BANCNFSM6AAAAAA2QD4SF4
.
You are receiving this because you were mentioned.Message ID:
@.***>


A memory kernel that stores everything in memory

A memory kernel integrates a memory journal, storage, etc.

Closed by #155


Default spring.gsp.tldScanPattern by classpath

One of the things that is nice about Spring Boot is that it will automatically make reasonable defaults. It would be nice if spring.gsp.tldScanPattern could be defaulted to include Spring's TLD (and possibly other TLD on the classpath).

I am integrating OWASP CSRF Guard into a Grails 6.2.0 application. The issue I have is the csrf tags are not recognized in the .gsp files. I followed the instructions in the Grails Tag Libraries documentation and added the tldScanPattern in application.yml.
The .tld file for the csrf tags are inside META-INF/tags. IF I add the path tp tldScanPattern I get this error:- ServletContext resource [/META-INF/tags/] cannot be resolved to URL because it does not exist.
Could I get some guidance on this?
Regards


TSServer Web Allow Opening in Semantic Mode

Today a Web TSServer cannot open in Semantic mode:
This is where we take the args from the launch:
    function parseServerMode(): LanguageServiceMode | string | undefined {
        const mode = findArgument("--serverMode");
        if (!mode) return undefined;
        switch (mode.toLowerCase()) {
            case "partialsemantic":
                return LanguageServiceMode.PartialSemantic;
            case "syntactic":
                return LanguageServiceMode.Syntactic;
            default:
                return mode;
        }
    }

If we return mode via the default case we're still getting a string and not the enum value of LanguageServiceMode.Syntax.
This PR allows setting no server mode to default to syntax server similar to how the main TSServer does. Today, as I assume vscode is realistically the only user of this API, it is currently always passing:
args.push('--serverMode', 'partialSemantic');

And so it should be backwards compatible with those changes.

Does this mean we will try to construct the full program though?

This probably shouldn't happen until a virtual filesystem is supported, and can just happen as part of that PR.


Go module file cannot create

Go module file (go.mod) can't created at version 0.2.0-beta. Just create's .out, cmd/projectName directories and main.go file.

Fixed in commit e8f6b11.


Using Helm in Openshift Kubernetes distribution

I added Red Hat's Openshift as another kubernetes distribution where helm works

I'm already signed CLA


Idea: allow mapping for index name in URL

Hello there,
I'm following the progress on the urlSync rewrite (#2216) and I'm wondering if you would consider the following feature.
Do you want to request a feature or report a bug?
Request a feature
Feature: What is your use case for such a feature?
I'd like to be able to map the real index name to a string. For instance, I'd like to have &idx=experiences instead of &idx=Experience_production in my URL.
The rationale behind this is to make the URL a bit shorter, and cleaner (we don't display the current environment as part of the index name).
Feature: What is your proposed API entry? The new option to add? What is the behavior?
We could pass an object when we initialize InstantSearch:
"indicesMapping": {
  "experiences": "Experience_production",
  "agenda": "Event_production"
},
"index": "experiences"

You'd be able to synchronise a connectSortBy to have behaviour like that, but I think I do get the use case

You will be able to do that with the new routing system, more specifically the stateMappings. See https://github.com/algolia/instantsearch.js/pull/2829 for more informations.

In order to do that, you need to implement a stateMapping that will hold the knowledge of the translation of the index names. Something like:
const search = instantsearch({
  // credentials
  routing: {
    stateMapping: {
      stateToRoute:  function(uiState) {
        return { idx: uiState.sortBy && uiState.sortBy.replace('_production', '') }
      },
      routeToState: function(routeState) {
        return { sortBy: routeState.idx && routeState.idx + '_production' }
      }
    }
  }
});

The code might need some real testing but that's the general idea.


zstd: Restrict huf_decompress_amd64.S to Linux and macOS x86_64

Fixes #62810.

In-progress CI test of this PR for Android builds on all platforms: https://github.com/akien-mga/godot/actions/runs/2628685671


chore: learn

Lets test CI
Research for https://github.com/ubiquity-os/plugin-template/issues/24

Trying to model github-actions[bot] auth off of how it was done in https://github.com/actions/github-script but I can't figure it out.

Trying to model github-actions[bot] auth off of how it was done in https://github.com/actions/github-script but I can't figure it out.

Just needed
permissions:
  pull-requests: write

I accidentally forgot to add the renamed CI file to my pull!


Bump Git_jll to 2.44

Bumps the Git_jll dependency to 2.44, which was packaged with more complete Windows functionality. Specifically it bundles also git bash so the git commands implemented as shell scripts work without git bash being installed externally.
Fixes #50.
I consider this as a bug fix and accordingly bumped the patch version. I'm open for other opinions.

I guess this isn't strictly necessary as the new version is still compatible with the current requirement, but good to define a known-to-work baseline.

Yes, in most situations you would get the updated Git_jll anyway but I'll feel better about using the Git package from LocalRegistry if I can be sure that it's not held back to an older Git_jll for whatever reason.

A registration of the new version would be appreciated.


Add SwiftUI App Lifecycle

This PR adds the App protocol, as well as Scenes, modifiers, and changes to the renderer to make building apps entirely with Tokamak simpler:
struct MyApp: App {
  var body: some Scene {
    WindowGroup("Tokamak") {
      Text("Hello, world!")
    }
  }
}

MyApp.main()

I've also implemented @AppStorage and @SceneStorage with the ability for renderers to override the default containers:
@AppStorage("count") var count: Int = 0 // Persists/updates across tabs.
@SceneStorage("count") var sceneCount: Int = 0  // Persists across single-tab reloads.

AppStorage will automatically update all tabs when one changes the value. SceneStorage will automatically be loaded on page-load as well as when any View in the app updates it. TokamakDOM uses localStorage and sessionStorage.
This PR also contains the ScenePhase environment value:
@Environment(\.scenePhase) var phase: ScenePhase

.active: Tab is active in the window of the browser.
.background: Tab is open, but not active.

This automatically updates with the PageVisibility API.

Fails

:no_entry_sign:

Sources/TokamakCore/App/AppStorage.swift#L67 - Line should be 100 characters or less: currently 106 characters (line_length)

:no_entry_sign:

Sources/TokamakCore/App/AppStorage.swift#L75 - Line should be 100 characters or less: currently 105 characters (line_length)

:no_entry_sign:

Sources/TokamakCore/App/AppStorage.swift#L83 - Line should be 100 characters or less: currently 108 characters (line_length)

:no_entry_sign:

Sources/TokamakCore/App/AppStorage.swift#L91 - Line should be 100 characters or less: currently 108 characters (line_length)

:no_entry_sign:

Sources/TokamakCore/App/AppStorage.swift#L140 - Line should be 100 characters or less: currently 106 characters (line_length)

:no_entry_sign:

Sources/TokamakCore/App/AppStorage.swift#L154 - Line should be 100 characters or less: currently 109 characters (line_length)

:no_entry_sign:

Sources/TokamakCore/App/AppStorage.swift#L168 - Line should be 100 characters or less: currently 109 characters (line_length)

:no_entry_sign:

Sources/TokamakCore/App/Scenes/SceneStorage.swift#L65 - Line should be 100 characters or less: currently 108 characters (line_length)

:no_entry_sign:

Sources/TokamakCore/App/Scenes/_SceneModifier.swift#L41 - Line should be 100 characters or less: currently 102 characters (line_length)

:no_entry_sign:

Sources/TokamakCore/MountedViews/MountedHostView.swift#L75 - Function body should span 50 lines or less excluding comments and whitespace: currently spans 51 lines (function_body_length)

:no_entry_sign:

Sources/TokamakCore/StackReconciler.swift#L131 - Line should be 100 characters or less: currently 103 characters (line_length)

  Generated by :no_entry_sign: Danger Swift against b20ac386cba41f676fe4181615c4afd45b09880d

Fails

:no_entry_sign:

Sources/TokamakCore/App/Scenes/_SceneModifier.swift#L41 - Line should be 100 characters or less: currently 102 characters (line_length)

:no_entry_sign:

Sources/TokamakCore/MountedViews/MountedHostView.swift#L75 - Function body should span 50 lines or less excluding comments and whitespace: currently spans 51 lines (function_body_length)

  Generated by :no_entry_sign: Danger Swift against ae134edf884ec6672b4aff3621faccc99f98d02f

Fails

:no_entry_sign:

Sources/TokamakCore/MountedViews/MountedHostView.swift#L75 - Function body should span 50 lines or less excluding comments and whitespace: currently spans 51 lines (function_body_length)

:no_entry_sign:

Sources/TokamakCore/StackReconciler.swift#L131 - Line should be 100 characters or less: currently 103 characters (line_length)

  Generated by :no_entry_sign: Danger Swift against 3b6627566646e487e1571b321c603f36b27daa9c

Fails

:no_entry_sign:

Sources/TokamakCore/MountedViews/MountedHostView.swift#L75 - Function body should span 50 lines or less excluding comments and whitespace: currently spans 51 lines (function_body_length)

  Generated by :no_entry_sign: Danger Swift against 92e5c3ccd5d441ad2361b825f084494999c94ad7

Turns out this requires latest carton to work, which kind of pushes me towards releasing Tokamak 0.2.0 and carton 0.4.0 without this PR...

Is there anything in the lifecycle API that isn't covered by this PR? I'm just wondering if this should be added to the progress document

Custom scenes are not yet supported. We could support these in a future PR IMO:
struct TokamakDemoScene : Scene {
  var body: some Scene {
    WindowGroup { ... }
  }
}


Removes a new line from the project get short flag

fixes : #758
Signed-off-by: mik-dass<EMAIL_ADDRESS>It removes the new line from the short flags for project get

e2e tests need to be modified too

But is there a specific reason why we need this PR? --short flag is normally used within scripts and not users, for which we don't need a newline.

@ashetty1 I just think it's better to maintain a constant UI/UX throughout the app

@mik-dass I meant, --short is not 'user' interface technically. Anyway, let's see what other say.

@kadel @cdrage WDYT?

Short flags are there to make it easier to write scripts around odo.
It would be much better to remove new line than add it.

@kadel @ashetty1  Done. I have removed the short flag from the project get command and fixed the test, please have a look.


Kernel died with exit code<PHONE_NUMBER>.

Hi,
When I tried to launch interactive window in vscode, it failed with the error below. Could you please help to identify what's wrong with it?
thanks,
alex
Issue Type: Bug
Kernel died with exit code<PHONE_NUMBER>. C:\Users\Alex.wang.virtualenvs\vtree-_4DfoHDc\lib\site-packages\traitlets\traitlets.py:2196: FutureWarning: Supporting extra quotes around Unicode is deprecated in traitlets 5.0. Use 'hmac-sha256' instead of '"hmac-sha256"' – or use CUnicode.
warn(
C:\Users\Alex.wang.virtualenvs\vtree-_4DfoHDc\lib\site-packages\traitlets\traitlets.py:2151: FutureWarning: Supporting extra quotes around Bytes is deprecated in traitlets 5.0. Use '5995421f-97b9-4627-9c28-0b10e2db4c56' instead of 'b"5995421f-97b9-4627-9c28-0b10e2db4c56"'.
warn(
Bad address (C:\projects\libzmq\src\epoll.cpp:100)
Extension version: 2021.6.832593372
VS Code version: Code 1.56.2 (054a9295330880ed74ceaedda236253b4f39a335, 2021-05-12T17:13:13.157Z)
OS version: Windows_NT x64 10.0.19042

System Info

Item
Value

CPUs
Intel(R) Core(TM) i5-10210U CPU @ 1.60GHz (8 x 2112)

GPU Status
2d_canvas: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onoop_rasterization: enabledopengl: enabled_onrasterization: enabledskia_renderer: enabled_onvideo_decode: enabledvulkan: disabled_offwebgl: enabledwebgl2: enabled

Load (avg)
undefined

Memory (System)
7.84GB (0.52GB free)

Process Argv

Screen Reader
no

VM
0%

A/B Experiments
vsliv368:30146709
vsreu685:30147344
python383:30185418
pythonvspyt602:30300191
vspor879:30202332
vspor708:30202333
vspor363:30204092
pythonvspyt639:30300192
pythontb:30283811
vspre833:30267464
pythonptprofiler:30281270
vshan820:30294714
pythondataviewer:30285071
vscus158:30286553
vscgsv2:30301612
vscorehov:30302759
bridgeflightcf:30302070
vscod805:30301674

Hi @futurehome. Sorry to hear you're having issues. Could you check which version of traitlets you have in your virtual env?
Run pip list to find out and please let me know.

The version of traitlets is 5.0.5.
The code is just some simple test code.

Got it, could you please reproduce the issue and share the logs in the panel under Output -> Jupyter?
Please make sure your jupyter.logging.level setting is set to debug.

@futurehome Please could you try the following:
python -m pip install ipykernel --upgrade --force-reinstall
Ensure you do this in the Python environment  you are using (u might want to activate it or the like).

The command failed as below, but I can install other package successfully.

@futurehome Please could you try the following:
python -m pip install ipykernel --upgrade --force-reinstall
Ensure you do this in the Python environment you are using (u might want to activate it or the like).

The log file is attached.
jupyter.log

Got it, could you please reproduce the issue and share the logs in the panel under Output -> Jupyter?
Please make sure your jupyter.logging.level setting is set to debug.

I had the same issue in conda environment i tried reinstalling and updating but nothing worked

The command failed as below, but I can install other package successfully.

@futurehome Please could you try the following:
python -m pip install ipykernel --upgrade --force-reinstall
Ensure you do this in the Python environment you are using (u might want to activate it or the like).

Hi,
I had exactly the same issue with you and have made some further attempts, which reveals a possible internal conflict of packages in ipykernel.
The permission issue in your picture can be possibly resolved by using python -m pip install ipykernel --upgrade --force-reinstall --user instead (adding the user to the end). NB: I was prompted to add the --user at a VS Code version of 1.58.2. So maybe you can consider updating your VS Code first.
When executing the prompt, I got the error message that says some packages are too new. However, I found that upgrading the ipykernel automatically installs the "too new" jedi==0.18.0 and parso==0.8.2, even when I have just lowered their version to 0.17.2 and 0.7.0, which then creates the dependency conflict. At this stage, I have no idea how to proceed and hope someone else can help with this problem. The error massage of dependency conflict is pasted below.
pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
spyder 4.2.5 requires jedi==0.17.2, but you have jedi 0.18.0 which is incompatible.
spyder 4.2.5 requires parso==0.7.0, but you have parso 0.8.2 which is incompatible.
python-language-server 0.36.2 requires jedi<0.18.0,>=0.17.2, but you have jedi 0.18.0 which is incompatible.
I would be happy to provide further information and hope the issue can be resolved soon.

This issue still exists in 1.59.0 and the latest version of Jupyter extension.

I solved this issue by reinstall Pyzmq==19.0.2.

I solved this issue by reinstall Pyzmq==19.0.2.

I resolved my issue using your method as well, though in my case I was still prompted that the dependency conflict of parso and jedi exist. Hope this entire issue can be better handled in later releases.

I solved this issue by reinstall Pyzmq==19.0.2.

how to do that? I have the same problem as you posted.

I'm using a conda environment and I solved this issue by downgrading python to version 3.8.

I solved this issue by reinstall Pyzmq==19.0.2.

I did the same thing and My problem has been eventually solved! Thanks a lot!

Fixed as part of https://github.com/microsoft/vscode-jupyter/issues/8354

Testing

Run a cell using raw kernels
Get the Pid of the process os.getpid() & kill that process from outside VS Code
Confirm you get a message when the kernel has died.

Verified. Looks good.


[HUDI-6464] Codreview changes for Spark SQL Merge Into for pkless tables'

Codreview changes for Spark SQL Merge Into for pkless tables (see #9083)
Change Logs
Codreview changes for Spark SQL Merge Into for pkless tables (See #9083)
Impact
None
Risk level (write none, low medium or high below)
None
Documentation Update
None
Contributor's checklist

[X] Read through contributor's guide
[X] Change Logs and Impact were stated clearly
[X] Adequate tests were added if applicable
[X] CI passed

@yihua Can you please review

@hudi-bot run azure

There is a severe function regression, can we fix it as soon as possible https://issues.apache.org/jira/browse/HUDI-6472, @amrishlal .


UI representation for ClusterRoles

Some K8s components are supported to have a custom UI component, and those can be found here. The scope of this issue is to support ClusterRoles. The new ClusterRole component should be similar to other components we already have, so feel free to check the existing ones out.
The visual representation should look something like this:

You can fetch the data about a cluster role by calling the backend on
/api/resources?group=rbac.authorization.k8s.io&version=v1&kind=ClusterRole&name=&namespace=
You can test this using the k6-operator default template.
Refer to this PR on adding new UI components https://github.com/cyclops-ui/cyclops/pull/330
Issue similar to https://github.com/cyclops-ui/cyclops/issues/499

Hi @petar-cvit, I’m encountering an issue where the API is returning null for my request. I’ve used the correct information from the resources listed at http://localhost:3000/api/modules/k6-operator/resources and formed the request URL as follows:
http://localhost:3000/api/resources?group=rbac.authorization.k8s.io&version=v1&kind=ClusterRole&name=k6-operator-manager-role&namespace=
Despite this, the response is still null. Could you help me troubleshoot this issue?

Hey @sarthakladhwe, my bad. I mixed up which resources were supported on the backend. ClusterRoles are yet to be supported so this issue will have to wait until then

No worries! Just let me know when it's supported, I'd be eager to tackle it. There’s a workaround by parsing YAML into a JS object, but I believe our resources APIs are better suited for that.

Closed by https://github.com/cyclops-ui/cyclops/pull/668


[BUG] UnsupportedAccessTokenType when using the Azure.Monitor.Ingestion SDK

Library name and version
Azure.Monitor.Ingestion, 1.0.0
Describe the bug
I am encountering an error while uploading custom log events to a Log Ingestion Endpoint.
The error message I am receiving is as follows:
{
  "error": {
    "code": "UnsupportedAccessTokenType",
    "message": "S2S17001: SAL was able to validate the protocol, but validation failed as none of the inbound policies were satisfied. Validation failures: '{redacted}': UnsupportedAccessTokenType."
  }
}

The code I have (shortened):
var streamName = "some-stream-name";
var logs = new [] { new CustomLogEventWithSomeProperties { … }};
var logsIngestionClient = new LogsIngestionClient(_azureMonitorLogIngestionOptions.DataCollectionEndpointUrl, new DefaultAzureCredential());
var response = await _logsIngestionClient.UploadAsync(_azureMonitorLogIngestionOptions.DataCollectionRuleIdentifier, streamName, logs, cancellationToken: cancellationToken);

Expected behavior
The logs are uploaded successfully without an issue.
Actual behavior
I always receive the error mentioned above.
I also checked actual http request and both the token itself and the Authorization header look correct:

Reproduction Steps
See the code above.
Environment
.NET SDK:
Version:   7.0.101
Commit:    bb24aafa11
Runtime Environment:
OS Name:     Mac OS X
OS Version:  13.4
OS Platform: Darwin
RID:         osx.13-arm64
Base Path:   /usr/local/share/dotnet/sdk/7.0.101/
Host:
Version:      7.0.1
Architecture: arm64
Commit:       97203d38ba
IDE and version: Rider 2023.1

I am also facing the same issue while using the REST api as described this in this example - https://learn.microsoft.com/en-us/rest/api/monitor/metrics-custom/create?tabs=HTTP#post-azure-metrics-for-cows-sold-with-related-metadata-as-dimensions

@michaelhahn-doka Can you please try reproducing this problem with logging enabled? We'll need those logs to determine the source of the problem.

Adding service team to look into this.

@michaelhahn-doka Thanks for your patience. There was a small code change in the service itself that caused this problem. The service team has implemented a code fix. That fix will be deployed to all Azure regions by tomorrow.
Marking this issue as resolved, but please reopen if the problem appears again.


[Bug]: NuGet package includes nodejs 20.11.0 which is included in CVE-2024-27983

Version
1.43.0
Steps to reproduce
microsoft.playwright.1.43.0 (and some earlier versions) includes a Nodejs executable version 20.11.0.
This file is flagged by scanners (E.g., JFrog) with a High vulnerability due to CVE-2024-27983.
This stops the package from being downloaded within these platforms and in environments where packages are scanned prior to their use.
Expected behavior
It is expected that included Nodejs executables are not flagged as having a security vulnerability.
Actual behavior
Vulnerable included Nodejs executables are flagged as a high-security vulnerability.
Additional context
No response
Environment
- Operating System: Windows, Linux
- CPU: [arm64]
- .NET Version (TFM): [net8.0]

I'll close it, since this gets fixed in 1.44.0 which we'll release shortly.


Unable to log into existing EVS account on another device

From the documentations here there does not seem to be a way to log into an existing EVS account on another device. If I am mistaken please let me know the correct way, thanks!

It is absolutely possible, but the documentation should probably be clearer on that point. Thanks for pointing that out, I'll look into it.
If you are in interactive mode, which is the default, you will be asked for credentials unless you already have valid tokens cached in the in the configuration file. For example, just trying to sign something on a previously unused device will ask you for credentials during that process.
If you need to explicitly sign in, e.g. if you have automated the signing as part of your build scripts and are running in non-interactive mode, you can do that as well. This method can also be used if you need to switch accounts for whatever reason:
% python3 -m castlabs_evs.account reauth
Discarding authorization token(s)
Refreshing authorization token(s)
>> Account Name []: example
>> Password []: XXXXXXXX

Ahh I see thanks for clarifying this 😄


defaults for yaml and legend.R

anything you can do about the package check failures? Can you run "check" on your local build? @lindsaycarr

I'm guessing something with the change to the MaumeeUV data. I originally put those in for fancy real-world examples.

I don't think I actually changed anything in that file...not knowingly anyways.

I had too many pipes in my rect() example, so now it passed the check on my computer. Unfortunately, my commits for adding a rectangle function today are getting pulled together with my commits from the other day for legend defaults. And that is due to using just the one branch?

yes. We can do branches some day :game_die:

I'll just make sure I don't have unrelated commits for now - still not passing the checks though :disappointed:

Good to go

I'm just taking that data out for now, we're not using it anyway.

:100:


Close window issue with initialWorkingDirectory

Hey,
Great plugin. I've been using it for quite a while with no issues and I'm sure it's saved me hours of time.
The other day I was looking through the options and I found initialWorkingDirectory—which is perfect for me, as all of my development work is in in the same base directory. I set it to initialWorkingDirectory: "~/Development", and everything seemed to be working fine until I caught a bug.
Today I was simply trying to close all my Hyper terminals with cmd+w, and that's when I realized I couldn't close the window anymore. All the tabs go away, but I'm left with a little useless
ghost window.

After a little troubleshooting (disabling every other plugin) I realized it was caused entirely by the initialWorkingDirectory option. I've attached a screenshot.
I'm on macOS and using oh-my-zsh.

Thanks so much for the report @bhardy - can definitely reproduce this! Digging into it now 😄

Hey @bhardy I figured out what was going on - it was creating a null session and Hyper never ends up destroying it. I submitted a PR to Hyper to fix this, so it might be a bit before it gets deployed to production. More details on that here: https://github.com/zeit/hyper/pull/2191

@hharnisc, right on. Thanks again for the great plugin.

It seems that your pull-request already shipped with version 1.4.4 of Hyper.
https://github.com/zeit/hyper/commits/1.4.4
Thanks a lot!


Lighting logger integration

This PR adds an Adapter (Logger) to enable logging from within a Lightning Trainer. This is necessary because Lightning provides its own logger component, which any custom loggers have to comply with. However, should a user want to log using an itwinai logger e.g. the Prov4MLLogger, they need an adapter to convert the lightning logger calls to calls to the itwinai logger.

@annaelisalappe it seems that you have a doppelganger in the commits history
Also, could you update this page with an example on the lightning logger please? https://itwinai.readthedocs.io/latest/how-it-works/loggers/explain_loggers.html


⚠ dev.minetest.net has degraded performance

In 3894757, dev.minetest.net (https://dev.minetest.net/Main_Page) experienced degraded performance:

HTTP code: 200
Response time: 2488 ms

Resolved: dev.minetest.net performance has improved in 06e17d1 after 28 minutes.


Wrong results of AvgPoolGrad and AvgPool3dGrad in some specific shapes

Please make sure that this is a bug. As per our
GitHub Policy,
we only address code/doc bugs, performance issues, feature requests and
build/installation issues on GitHub. tag:bug_template
System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow):
No
OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
Linux Ubuntu 18.04
TensorFlow installed from (source or binary):
source
TensorFlow version (use command below):
2.4.1 and 1.15 both tried
Python version:
3.7.5

You can collect some of this information using our environment capture
script
You can also obtain the TensorFlow version with:

TF 1.0: python -c "import tensorflow as tf; print(tf.GIT_VERSION, tf.VERSION)"
TF 2.0: python -c "import tensorflow as tf; print(tf.version.GIT_VERSION, tf.version.VERSION)"

Describe the current behavior
Hello, I'm using MaxPoolGrad and find that in same cases the results seemed to be wrong compared with hand-calculated results.   One of the cases is as follows.
**grad_shape = (1, 1, 5, 1)
input_shape = (1, 1, 5, 1)
kernel_size = [1, 1, 7, 1]
stride_size = [1, 1, 1, 1]
padding = 'SAME'**

For the convenience of calculation， I set the grad with all one value.
Then the result is
tf.Tensor(
[[[[0.8 ]
   [1.05]
   [1.05]
   [1.05]
   [1.05]]]], shape=(1, 1, 5, 1), dtype=float32)

While the hand-calculated result is
[[[[0.85 ]
   [1.1]
   [1.1]
   [1.1]
   [0.85]]]]
tips:
0.85 = 1/4 + 1*3/5
1.1 = 1*2/4 +1*3/5

The differences appear in following cases:
-kernel_h > input_h &  kernel_h // 2 < input_h - 1
-kernel_w > input_w &  kernel_w // 2 < input_w - 1
Describe the expected behavior
Following cases can have right calculation results.
-kernel_h > input_h &  kernel_h // 2 < input_h - 1
-kernel_w > input_w &  kernel_w // 2 < input_w - 1
Standalone code to reproduce the issue
import tensorflow as tf
from tensorflow.python.ops import gen_nn_ops

def test_tf_avg_pool_grad(input_shape, grad_shape, ksize, strides, padding, data_format):
    x = tf.Variable(tf.ones(shape=grad_shape), dtype=tf.float32)
    avg_pool_grad = gen_nn_ops.avg_pool_grad(orig_input_shape=input_shape,
                                             grad=x, ksize=ksize,
                                             strides=strides,
                                             padding=padding,
                                             data_format=data_format)

    return avg_pool_grad

if __name__ == '__main__':
    grad_shape = (1, 1, 5, 1)
    input_shape = (1, 1, 5, 1)
    kernel_size = [1, 1, 7, 1]
    stride_size = [1, 1, 1, 1]
    padding = 'SAME'
    exp_result = test_tf_avg_pool_grad(input_shape, grad_shape,
                                       kernel_size, stride_size, padding,
                                       'NHWC')
    print("======================= the expect result of log:", exp_result)

Other info / logs
hand-caculated process

Was able to reproduce the issue in Tf version 2.4 and Nightly. Please find the gist here.

Thanks for reporting! Contribution welcome!

I am working on that.

Hi @kkimdev,
Could you please help me who I can ask about some parameters of this function and how I can do that?
XlaOp AvgPoolGrad(XlaOp out_backprop, absl::Span gradients_size,
absl::Span kernel_size,
absl::Span stride,
absl::Span<const std::pair<int64, int64>> spatial_padding,
const TensorFormat& data_format,
const bool counts_include_padding) {

@smit-hinsu maybe?

Thanks Sanjoy.
@pointhex Happy to answer any questions you have for AvgPoolGrad helper function.

Hi @smit-hinsu,
I'm trying to write a unit test for AvgPoolGrad. But I can do the right data format. In file pooling_test.cc there is a function MakeNCHWFormat. I need the same but for NHWC. I don't fully understand how spatial_dimensions works in this case.
Could you please clarify that for me? Or maybe there are some useful links.

Look at XlaTensorFormat helper in the following file that converts from the tensorflow format to the XLA format.
third_party/tensorflow/compiler/tf2xla/kernels/pooling_ops.cc
For 4D tensor in NCHW format, spatial_dimensions are 2 and 3 as the last two dimensions are spatial dimensions. It would be 1 and 2 for NHWC format.

Was able to reproduce the issue in Tf version 2.6 . Please find the gist here.

@hmzzl,
I tried to execute the mentioned above code on the tensorflow v2.14 and observed that the results are almost nearer to the handmade calculations. Kindly find the gist of it here.
======================= the expect result of log: tf.Tensor(
[[[[0.84999996]
   [1.0999999 ]
   [1.0999999 ]
   [1.0999999 ]
   [0.85      ]]]], shape=(1, 1, 5, 1), dtype=float32)


Example of returning prepared tx from mint client

Current dependencies on/for this PR:

main

PR #322

PR #334   👈

This stack of pull requests is managed by Graphite.


Stay logged in at multiple devices

If I log in from my phone I'm logged out from my laptop, and vice versa. It should be possible to be logged in from multiple devices at the same time.
tl;dr: Add support for multiple sessions.

Not an issue with hubbIT.
Will be solved with account.
Duplicate of https://github.com/cthit/auth/issues/1


Errors occur in the init command when member account names are duplicated?

An error occurred in the init command when member accounts with the same name was included in the organization.
The status of the organization when the error occurred is as follows.
The member accounts have same name.
$ aws organizations list-accounts --profile organizations
{
    "Accounts": [
        {
            "Status": "ACTIVE",
            "Name": "Master",
            "Email"<EMAIL_ADDRESS>            "JoinedMethod": "INVITED",
            "JoinedTimestamp":<PHONE_NUMBER>.57,
            "Id": "XXXXXXXXXXXX",
            "Arn": "arn:aws:organizations::XXXXXXXXXXXX:account/o-xxxxxxxxxx/XXXXXXXXXXXX"
        },
        {
            "Status": "ACTIVE",
            "Name": "Nobuhiro Nakayama",
            "Email"<EMAIL_ADDRESS>            "JoinedMethod": "CREATED",
            "JoinedTimestamp":<PHONE_NUMBER>.151,
            "Id": "YYYYYYYYYYYY",
            "Arn": "arn:aws:organizations::XXXXXXXXXXXX:account/o-xxxxxxxxxx/YYYYYYYYYYYY"
        },
        {
            "Status": "ACTIVE",
            "Name": "Nobuhiro Nakayama",
            "Email"<EMAIL_ADDRESS>            "JoinedMethod": "CREATED",
            "JoinedTimestamp":<PHONE_NUMBER>.563,
            "Id": "ZZZZZZZZZZZZ",
            "Arn": "arn:aws:organizations::XXXXXXXXXXXX:account/o-xxxxxxxxxx/ZZZZZZZZZZZZ"
        }
    ]
}

The error message is as follows.
$ org-formation init organization.yml --region us-east-1 --profile organizations --print-stack
ERROR: unexpected error occurred...
duplicated mapping key at line 22, column -193:
      NobuhiroNakayamaAccount:
      ^
YAMLException: duplicated mapping key at line 22, column -193:
      NobuhiroNakayamaAccount:
      ^
    at generateError (/usr/local/lib/node_modules/aws-organization-formation/node_modules/js-yaml/lib/js-yaml/loader.js:167:10)
    at throwError (/usr/local/lib/node_modules/aws-organization-formation/node_modules/js-yaml/lib/js-yaml/loader.js:173:9)
    at storeMappingPair (/usr/local/lib/node_modules/aws-organization-formation/node_modules/js-yaml/lib/js-yaml/loader.js:335:7)
    at readBlockMapping (/usr/local/lib/node_modules/aws-organization-formation/node_modules/js-yaml/lib/js-yaml/loader.js:1098:9)
    at composeNode (/usr/local/lib/node_modules/aws-organization-formation/node_modules/js-yaml/lib/js-yaml/loader.js:1359:12)
    at readBlockMapping (/usr/local/lib/node_modules/aws-organization-formation/node_modules/js-yaml/lib/js-yaml/loader.js:1089:11)
    at composeNode (/usr/local/lib/node_modules/aws-organization-formation/node_modules/js-yaml/lib/js-yaml/loader.js:1359:12)
    at readDocument (/usr/local/lib/node_modules/aws-organization-formation/node_modules/js-yaml/lib/js-yaml/loader.js:1519:3)
    at loadDocuments (/usr/local/lib/node_modules/aws-organization-formation/node_modules/js-yaml/lib/js-yaml/loader.js:1575:5)
    at load (/usr/local/lib/node_modules/aws-organization-formation/node_modules/js-yaml/lib/js-yaml/loader.js:1596:19)

I was able to avoid the error by eliminating duplicate account names.
(I canceled one of member accounts)
Is this a specification or constraint? Is it a bug?

thanks! that would be a bug, will soon be fixed

fixed this in the commit above. will let you know when released.
generating the template will not fail, it will print a warning though:
WARN: Multiple accounts found with AccountName YourNameHere. This will not be a problem, but perhaps confusing?
does that make sense?

I think it is a good error message.
Account names within an organization are not required to be unique.
https://docs.aws.amazon.com/organizations/latest/APIReference/API_CreateAccount.html
However, if there are many accounts with the same name, it is difficult to identify the account on the management console.

closed in version 0.9.3


We don't require DCO or git --signoff

not sure where this came from. cut-n-paste from somewhere else?

@dims happy to mark this as fixing https://github.com/kubernetes/website/issues/20426?

Page preview:
https://deploy-preview-20429--kubernetes-io-master-staging.netlify.app/docs/contribute/new-content/overview/
Thanks @dims
/approve


Provide tagged versions on Docker hub

Thanks for the great work done so far!
I was wondering if it would be possible to provide tagged versions (e.g. v1.4, v1.3 etc.) of the Docker images on Docker hub. This would make it possible to use a specific version of goaccess.

Thanks for the suggestion. I can certainly do that. Do you know if it's just a matter of doing docker tag or is there anything specific for Docker hub?

I've never done this myself but according to the docs, docker build or docker tag does the job.


Implement a comment feature

Description
Hello there,
I've been using luckperms for three years now and I haven't encountered any problems. however, when it comes to a larger network of servers, where luckperms runs in bungee, managing permissions becomes quite complicated. so I came up with a suggestion: a comment function. thus, in the web editor we will have a new column, called comment. users will be able to write a specific message next to the desired permission, which will facilitate the management of hundreds of permissions in more complex game setups.
Proposed Behaviour
there is not much to explain. it's simply a new column in the editor that adds the possibility of text comments. users will be able to see the message with a single click :)
Extra Details
No response

Duplicate of #3628


Don't use application/x-www-form-urlencoded POST requests for http polling

CSRF is a concern here. We should just post raw data to the body.

See #125
How does not using application/x-www-form-urlencoded prevent CSRF? We need an anti-forgery token no matter how we encode the data if we want to prevent CSRF.

Wait, never mind, this is for the poll request. Just got it ;). Never mind!

@anurse sends and poll. This is a long standing issue https://github.com/SignalR/SignalR/issues/1886.

@anurse we can close this right?

No - https://github.com/aspnet/SignalR/blob/a00ec445ef040395faed0b564f098258b8239e60/client-ts/Microsoft.AspNetCore.SignalR.Client.TS/HttpClient.ts#L21 - I could just remove it but I wanted to understand first how this can be a CSRF and I keep forgetting to ask you.

Here's the original issue - https://github.com/SignalR/SignalR/issues/1413
https://github.com/SignalR/SignalR/commit/f41abf4a17c91e3f18b5fc8cbdff9c0d3297645a

Fixed in e691e1c


feat: adds ape_accounts.generate_account for programattic account creation

What I did
Adds a generate_account() function so accounts can be created using Ape as a lib.
fixes: #1760
Checklist

[ ] All changes are completed
[ ] New test cases have been added
[ ] Documentation has been updated

Oh, we may want to update this guide https://github.com/ApeWorX/ape/blob/main/docs/userguides/accounts.md#live-network-accounts
otherwise someone is going to open an issue saying there is no docs for this feature.

Latest test failures appear to be from main

I'm going to add import functionality to this PR as well for #1779


Plugins in windows

Is there a way to install plugins in the windows version? i dont know much about this, sorry.

The nightly Windows build from July 7th 2021 ahoviewer-20210707-94be5a-nightly-win64-standalone.zip found here supports plugins.
Plugins can be installed in 2 locations on Windows;

Inside a plugins directory in the root of the ahovewier directory (where the exe is)
Inside %LOCALAPPDATA%\ahoviewer\plugins (you'll have to create this directory yourself)

Thank you, but how can i install them? just copy and paste them into the plugins folder? i alredy did that with the sankaku one and i couldn't make it work :(
Also, Do you plan to implement searches with more than one booru at the same time? i know you can search in different tabs but it would be useful to search in multiple boorus at the same time like in booru slideshow for example.
Thanks :)

Copy the .plugin and the .py file into a new directory inside the plugins directory, for example %LOCALAPPDATA%\ahoviewer\plugins\sankaku.
Then to add sakaku as a booru inside ahoviewer preferences window, use https://capi-v2.sankakucomplex.com as the URL, and it should come up as a valid booru.

Also, Do you plan to implement searches with more than one booru at the same time? i know you can search in different tabs but it would be useful to search in multiple boorus at the same time like in booru slideshow for example.

This isn't something that I have thought of doing, but could be possible.  I'm more likely to rewrite this project in the future than add any major updates to the current code base as of right now though.


Need to update SDK version where dartdoc is running

Generating docs for packages when they require an SDK version >2.0.0-dev.69.3
For example: https://pub.dartlang.org/documentation/angular_forms/latest/log.txt
cc @kevmoo
Related: https://github.com/dart-lang/pana/issues/384

@isoos @sortie @mit-mit – this is pretty critical. All of the angular packages have broken analysis!

See also
https://pub.dartlang.org/packages/aqueduct/#-analysis-tab-
CC @timsneath

Istvan is on it. I suspect this is less likely to happen going forward with 2.0 now in stable? If not, we need to change our processes so that we can be more proactive about changes like this.

There are two separate issues here:
1: Packages that depend on dev.69.5
Pub is on dev.69.3. I'm not sure why these packages were pegged on 69.5, but these are the only ones that do that, and thus the only ones failing:
angular	>=2.0.0-dev.69.5 <3.0.0
angular_forms	>=2.0.0-dev.69.5 <3.0.0
angular_test	>=2.0.0-dev.69.5 <3.0.0
angular_compiler	>=2.0.0-dev.69.5 <3.0.0
angular_ast	>=2.0.0-dev.69.5 <3.0.0
tonic	>=2.0.0-dev.69.5 <3.0.0
This is a temporal issue, will be resolved by the issue below.
2: Packages that depend on 2.0 stable or later
There are 43 of these currently, but of course this number will grow rapidly.
I think the solution is two staged:

Change pub to 2.0 stable (issue #1505). Yes, this will trigger failures in packages that don't work in Dart 2, but we are generally looking pretty good in the top packages
Consider if we want to still have analysis for Dart 1, and if so run in a dual SDK setup

A crazy idea – sniff the pubspec before running pub get. If the pubspec requires an SDK after the current one, use _PUB_SDK_ENVIRONMENT – or whatever it is – to pretend to be a compatible SDK and run anyway?

This has been resolved:
https://pub.dartlang.org/packages/aqueduct#-analysis-tab-
https://pub.dartlang.org/packages/angular#-analysis-tab-
https://pub.dartlang.org/packages/tonic#-analysis-tab-


No profile pics and names

Checklist

[X] I am able to reproduce the bug with the latest version.
[X] I made sure that there are no existing issues - open or closed - which I could contribute my information to.
[X] I have taken the time to fill in all the required details. I understand that the bug report will be dismissed otherwise.
[X] This issue contains only one bug.

Affected version
2.2.0
Steps to reproduce the bug
When i open Quacker there are only posts, but without profile names and profile pics

Expected behavior
No response
Actual behavior
No response
Screenshots/Screen recordings
No response
Logs
No response
Affected Android/Custom ROM version
Android 11 / MIUI 12.5.6
Affected device model
Xiaomi Redmi Note 9 (merlinnfc)
Additional information
No response

Is twitter banned in your country?

Is twitter banned in your country?

No, it isn't. When i look at specific account i see profile name and pics

Hi, I had the same problem and found out there is Activate non-confirmation bias mode enabled in General settings. After deactivating, profile pictures and usernames are visible :)
I think I did not enable this mode by myself. Is it possible that it can be triggered automatically?

Hi, I had the same problem and found out there is Activate non-confirmation bias mode enabled in General settings. After deactivating, profile pictures and usernames are visible :)
I think I did not enable this mode by myself. Is it possible that it can be triggered automatically?

Damn!
That was it, thanks mate!
Thank you very much!
Now Quacker is superior over Fritter!


Unified not found behavior for Deployments with CRD and InstallPlan

Changed noExistingDeploymentObj to Compliant instead of UnknownCompliancy. This change was made to reduce confusion and to unify behavior with the CRD and InstallPlan, which both report Compliance when there is no existing object instead of UnknownCompliancy.
Ref: https://issues.redhat.com/browse/ACM-12040

/retest


CLOUD-74282 Remove un-necessary services from datalake cluster

Removed kafka, solr, atlas, hbase from enterprise ephemeral cluster blueprint
Removed kafka, atlas, hbase and spark from shared services cluster blueprint
Fixed remote ranger admin password

I think you should also apply these changes to the https://github.com/sequenceiq/cloudbreak/blob/master/core/src/main/resources/defaults/blueprints/hdp26-shared-services.bp blueprint


blank white screen, PHP 7.0

Title says it all.
Fresh install, did the DB setup, when I go to any page, they are all white screens.
Using PHP 7, running on the same website as my xenForo forum in a subdirectory called a3lpddb.

This was build on an older version of PHP (PHP 5 I believe), and might/probably will have compatibility issues. It will not be updated to meet current web standards.
However, I can go ahead and attempt to figure out the issue.
Did you change the DB host/user/pass/db in db.php?
As well I'm assuming you imported the provided 'database.sql'  into a database?
Are you running the site on SSL?

Tested with PHP 7 w/apache service and works fine!

i get a white screen is there a way to fix this or?

@Warzone3812 Read what Cole put.

This was build on an older version of PHP (PHP 5 I believe), and might/probably will have compatibility issues. It will not be updated to meet current web standards.
However, I can go ahead and attempt to figure out the issue.
Did you change the DB host/user/pass/db in db.php?
As well I'm assuming you imported the provided 'database.sql' into a database?
Are you running the site on SSL?

ok sorry the late response i got it to work, but i cant seem to get my self admin, (cant figure out how,) or police, im phpmyadmin and i see how things are organized and under users, but and under dept i see a few things and cant seem to find out what t o pull for the admin

When in the database (using phpmyadmin), make sure you follow this portion of the guide posted below.
 This will put you into the Staff department, and set your rank to Admin. Then click save."

ok thanks

Title says it all.
Fresh install, did the DB setup, when I go to any page, they are all white screens.
Using PHP 7, running on the same website as my xenForo forum in a subdirectory called a3lpddb.

how did you fix the white screen? Wanting to use this DB

you have to connect the database to the website
there should be a config with the folders
connect the ip and the password it should work after that
On Thu, Dec 5, 2019 at 9:41 PM EthanVega<EMAIL_ADDRESS>wrote:

Title says it all.
Fresh install, did the DB setup, when I go to any page, they are all white
screens.
Using PHP 7, running on the same website as my xenForo forum in a
subdirectory called a3lpddb.
how did you fix the white screen? Wanting to use this DB
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/ColeB97/A3-Police-Database/issues/2?email_source=notifications&email_token=AJABYNJZJGVGBKJV3H2536LQXHCUXA5CNFSM4EAHCC7KYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEGC5P2Q#issuecomment-562419690,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AJABYNNHAFECIOKAVCVQA6TQXHCUXANCNFSM4EAHCC7A
.

File:
A3-Police-Database/php_includes/db.php
Contents:
define('HOST', "SERVER IP");
define('USER', "DATABASE USERNAME");
define('PASS', "DATABASE PASSWORD");
define('DB', "DATABASE NAME - default is: police");


命令"Marksman: Show Output"导致错误 (command 'marksman.showOutputChannel' not found)

版本: 1.72.0
提交: 64bbfbf67ada9953918d72e1df2f4d8e537d340e
日期: 2022-10-04T23:19:55.212Z
Electron: 19.0.17
Chromium: 102.0.5005.167
Node.js: 16.14.2
V8: <IP_ADDRESS>-electron.0
OS: Darwin arm64 22.1.0
沙盒化: No

Is there something else I can do to debug this error?
Thank you very much.

@suliveevil thanks for reporting this. How do you trigger this error?

Open README.md
Command+Shift+P
Click Marksman: Show Output


TS-4707 : Parent Consistent Hash Selection - add fname and maxdirs

This enhancement adds two options, "fname" and "maxdirs",
which can be used to exclude the file-name and some of the
directories in the path. The remaining portions of the path
are then used as part of the hash computation for selecting
among multiple parent caches.

@jrushford  Please review. [approve ci]

FreeBSD build successful! See https://ci.trafficserver.apache.org/job/Github-FreeBSD/499/ for details.

Linux build successful! See https://ci.trafficserver.apache.org/job/Github-Linux/396/ for details.

I think I'm ok with this for now, but I really wish we'd done something similar to TSHttpTxnCacheLookupUrlGet() / TSHttpTxnCacheLookupUrlSet(), but for the parent selection URL to use. Like
tsapi TSReturnCode TSHttpTxnParentSelectionUrlGet(TSHttpTxn txnp, TSMBuffer bufp, TSMLoc obj);
tsapi TSReturnCode TSHttpTxnParentSelectionUrlSet(TSHttpTxn txnp, TSMBuffer bufp, TSMLoc obj);

And then we could either have extended the functionality in the cachekey plugin (or, make a new plugin). There's generally a problem when a plugin changes the cache key as well, and the parent selection does not follow the same lead, the stop-gap solution for that was the ignore query params option. See
https://issues.apache.org/jira/browse/TS-4025

for some more discussions. My "objection" here is that we're making some very specific use case changes / features, whereas new APIs, and support for it in the existing cachekey plugin (which is very feature rich) would solve not just these two cases, but a lot more.

@zwoop I implemented the two API calls that you recommended above (along with the two corresponding ts_lua API calls). However, I did not see a graceful way to get the URL set via the API calls to the ParentConsistentHash.cc hash generation function since it is only passing the request_data and not the entire HTTP transaction. As a work-around, I wrote the URL into an<EMAIL_ADDRESS>MIME field to accomplish the data exchange. The plus to this is that you can set the MIME field without using the API (and it does not need to be a valid URL if set with this method). The hash generation will just hash the contents of this MIME field if it is defined (and ignore the other options maxdirs, fname, and qstring). I retained the maxdirs and fname enhancements in the earlier commit as I have not yet sold my users on this new approach.

@jrushford @zwoop Hi has anyone had a chance to review this? Thanks.

I havent’ had a chance to look at it but, I’ll do that today.
Thanks
John J. Rushford
<EMAIL_ADDRESS>From: pbchou<EMAIL_ADDRESS>Reply-To: apache/trafficserver<EMAIL_ADDRESS>Date: Wednesday, August 24, 2016 at 1:37 PM
To: apache/trafficserver<EMAIL_ADDRESS>Cc: John Rushford<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [apache/trafficserver] TS-4707 : Parent Consistent Hash Selection - add fname and maxdirs (#834)
@jrushfordhttps://github.com/jrushford @zwoophttps://github.com/zwoop Hi has anyone had a chance to review this? Thanks.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/apache/trafficserver/pull/834#issuecomment-242183139, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AEVybthqPZ7roGI5MPBrmjnWU-aPnr16ks5qjJ1xgaJpZM4JaEs-.

@zwoop @pbchou - This looks okay to me but, what do you think of modifying the parent selection API to pass the Http transaction state then there would be no need for the mime header.  Currently the parent selection functions look like this:
s->parent_params->findParent(&s->request_data, &s->parent_result);
s->parent_params->nextParent(&s->request_data, &s->parent_result);
s->parent_params->apiParentExists(&s->request_data)
s->parent_params->parentExists(&s->request_data)

new API calls:

s->parent_params->findParent(s);
s->parent_params->nextParent(s);
s->parent_params->apiParentExists(s)
s->parent_params->parentExists(s)

@jrushford -- I did consider something similar before going with the MIME header approach. I also considered extending the HttpRequestHeader with additional data elements. It seems that the findParent, etc. above occur in some places such as Socks.cc where Http Transactions are not normally in scope. Besides affecting the modularity to declare in those areas, I think that the header files and/or make files would need some work as well to get the includes to work.

@zwoop @jrushford -- I pushed another commit which removes the use of the MIME header. It adds pointers to the HttpTransact::State's cache_info.lookup_url and cache_info.parent_selection_url variables into the HttpRequestHeader data structure. It looks like somebody used a similar approach with the api_info variable in HttpRequestHeader previously. I went ahead and included adding look_url to help with TS-4025 mentioned above.

@pbchou - I'm reviewing but, is it possible to squash the 4 commits to a single commit?

@jrushford  -- Thanks for taking a look, but can we hold off on squashing commits until the branch is finalized (or alternatively just squash as part of the merge with "git merge --squash")? I would prefer to keep the separate commits and development history intact until we have the final thumbs up.

@jrushford -- I pushed a new commit with your recommended changes. I didn't squash it yet so you can see just the diff from what you reviewed earlier. I also updated the API and Lua API documents. Let me know if you are ready to merge, and I'll go ahead and squash it. I haven't used interactive git rebase before (I am worried about breaking the GitHub PR linkage to the branch). I don't see any other way to squash in place since I thought one usually squashes during the merge or cherry-pick.

@zwoop and @jpeach, I'm +1 on this, would appreciate it if you could take a look.

[approve ci]

Linux build successful! See https://ci.trafficserver.apache.org/job/Github-Linux/644/ for details.

@jpeach @zwoop @jrushford -- James, please see the changes that you requested.

@PSUdaemon @jpeach @zwoop @jrushford -- Phil, please see the changes that you recommended.

@PSUdaemon @jpeach @zwoop @jrushford -- Phil, please see the changes that you recommended.

[approve ci]

Linux build successful! See https://ci.trafficserver.apache.org/job/Github-Linux/667/ for details.

FreeBSD build successful! See https://ci.trafficserver.apache.org/job/Github-FreeBSD/771/ for details.

@pbchou,
This looks OK to me now. You have one comment above from @jpeach to address and then I think @jrushford can merge this.
Thanks!

IMO, the proposal of fname and maxdirs is a bit of a hack, solving a subset of all possible use cases. Allowing for a "parent selection URL" that can be the same, or different, than the pristine / cachekey URL would be generic.

@pbchou - Could you add parent selection and sdk api regression tests.  See ParentSelection.cc and InkAPITest.cc.  You may run thest tests using traffic_server -R3 PARENTSELECTION and traffic_server -R3 SDK_API.  If you omit the argument, all tests are run.

@pbchou - we have to do an api review on the two new api calls and since they are different features from the max dirs and fname additions.  They really ought to be in separate pr's.  Is it possible for you to break them up into separate prs and add in the tests?  I think we're close here, I can probably merge in the max dirs and fname.  Then we would review the two API adds.

@jrushford -- The API enhancements have been removed (moved into TS-4853).

@pbchou, thanks i look at this and get an API review started.

@jrushford -- Added regression test cases for "-R3 -r PARENTSELECTION".

@jrushford -- I see they branched 7.0.x already. Would this PR get merged into both master and 7.0.x or did we miss the boat? Also, please see the regression test cases that I added at your request when you get a chance. Thanks.

@pbchou - Yeah we missed 7.0, everyone including myself were working on patches and bug fixes for 7.0 from a recent bug scrub.  As for these PR's they could go in for 7.1 and later.  I requested an API review on the dev mailing list for the PR with the new API functions.  I'm waiting for people to have the chance to review and discuss as part  of the review.  I'll keep you posted.


0

Microsoft PowerToys version
0
Running as admin

[X] Yes

Area(s) with issue?
General
Steps to reproduce
0
✔ Expected Behavior
No response
❌ Actual Behavior
Version: <IP_ADDRESS>
OS Version: Microsoft Windows NT 10.0.22000.0
IntPtr Length: 8
x64: True
Date: 2022/1/23 12:54:09
Exception:
System.Collections.Generic.KeyNotFoundException: The given key 'Path' was not present in the dictionary.
at System.Collections.Generic.Dictionary2.get_Item(TKey key)    at PowerLauncher.Helper.EnvironmentHelper.GetMergedMachineAndUserVariables(Dictionary2 environment)
at PowerLauncher.Helper.EnvironmentHelper.<>c.b__3_0()
at Wox.Infrastructure.Stopwatch.Normal(String message, Action action)
at PowerLauncher.Helper.EnvironmentHelper.UpdateEnvironment()
at PowerLauncher.MainWindow.ProcessWindowMessages(IntPtr hwnd, Int32 msg, IntPtr wparam, IntPtr lparam, Boolean& handled)
at System.Windows.Interop.HwndSource.PublicHooksFilterMessage(IntPtr hwnd, Int32 msg, IntPtr wParam, IntPtr lParam, Boolean& handled)
at MS.Win32.HwndWrapper.WndProc(IntPtr hwnd, Int32 msg, IntPtr wParam, IntPtr lParam, Boolean& handled)
at MS.Win32.HwndSubclass.DispatcherCallbackOperation(Object o)
at System.Windows.Threading.ExceptionWrapper.InternalRealCall(Delegate callback, Object args, Int32 numArgs)
at System.Windows.Threading.ExceptionWrapper.TryCatchWhen(Object source, Delegate callback, Object args, Int32 numArgs, Delegate catchHandler)
Other Software
No response

Duplicate of #15497

Thanks for reporting this. This issue is a duplicate.
I'm linking this issue to #15497 to centralize the discussion thread for tracking.
Thanks for your help to make PowerToys a better piece of software!

/dup #15497


[service-catalog] dashboard redirect to wrong page of console and user cant see his addressspaces

In the Service Catalog, the Dashboard link now redirects to wrong page, and user can't see his newly created address space.
This was working at release-0.31.

This worked until #4067, where the oauth-proxy skip_provider_button was set true.
The reason this worked when skip_provider_button false is that oauth_proxy's provider form (sign_in.html) captures the fragment from the request URI (the rd field).  This is then passed to the server side on form submission, preserved, and used at the end of the Oauth workflow.
When skip_provider_button true, no form is used.  oauth-proxy stores the original request uri but this is without fragment.  Fragments are exclusively a client side concern, so this is by design.  When the authentication is complete oauth proxy redirects to this uri, thus meaning the context is lost.
I wonder if the defect actually sit with OpenShift? Shouldn't OpenShift's login forms be preserving the fragment identifier? I am not sure. I can't find any resource guiding on best practice.
To fix this bug:

flip skip_provider_button back to false.
switch the UI use a different router.  I think this would necessitate a switch to 'real' HTTP server on the server side to map all the requests to a single resource (oauth-proxy built in HTTP server isn't capable of this).

@k-wall Yeah, maybe we can revert this change for now (for 0.32), and re-introduce it once we create the 0.x branch?


Add PagBank to the adopters list

We use k8gb in a multicloud environment spanning multiple regions and data centers to enhance resilience and optimize traffic distribution across diverse infrastructures.

@altieresfreitas wow, thank you so much!

happy to hear @altieresfreitas 🍀.  Thanks for contribution!


Run recon scan as part of an operation

Hi Guys,
I just stumbled upon this, you guys have done some serious work here. Thanks for sharing it 🤗.
My question though is whether there is anything in the roadmap to be able to run the initial scan as part of an operation. As far as I understood the nmap scan is done directly from the CALDERA server which limits the visibility over the target network, considering your CALDERA server is not in the same subnet as the vulnerable machines you want to identify.
Running it as part of an operation would likely increase the attack surface, given you have an agent running inside the target subnet.

Thanks for the kind words.
As to your question, it was considered using the agents as remote scanners and passing the scan results back to the server to compile the results.  That functionality was a little out of scope based off what we were planning so it was not implemented at the time, but it is an achievable goal that we had as a future possibility for the project.
As for what you can do currently, if the target hosts have nmap installed (or any other scanning tool that produces an output report) you can create an ability to execute a scan and exfil the report back to the server and manually import it into pathfinder.  The next step up from that would be changing the pathfinder plugin to make the endpoint for uploading reports to be un-authenticated so an agent can push a report to it directly (could be done through the ability commands), removing the manual step of importing.
Long term it would be best to have pathfinder be agent-aware, and have the capability to stage discovery commands for the agents to determine which are able to run the scanners. We would display a list of agents to run scans from and allow selecting n-number of them.  When receiving the results back we would use those results to map out a network with more detail and possibly be able to resolve more complex network rules in place and how some hosts might bridge between multiple subnets and be used for lateral movement.


Support more SASL mechanism

For now, ldap2pg is limited to DIGEST-MD5, we should add more mechanism like GSSAPI, etc.
Please ask here which mech you need !

Let's close until someone need it.


MAVLink File vs. Send Controller GPS in xml files

Hi,
First, huge thanks for making this library available. I found among the documentation under /commandsandsensors a [common.xml] (https://github.com/amymcgovern/pyparrot/blob/master/pyparrot/commandsandsensors/common.xml#L621) document that contains commands to initiate a mavlink flight plan from a file. How is this accessible from the current library? Alternatively, I also noticed what looked like an ability to send GPS coordinate commands to the drone in ardrone3.xml - is that possible at all? How are these XML files used?
Thanks again,
Carlos

You could add commands to do that, yes.  The xml files are parsed and used to send commands.  It would be pretty easy to add such a command.

the xml files themselves come from parrot's SDK

Is adding support for this something on the roadmap? Or could you point me to some documentation that would help me implement those functions in a PR?

Just look at any of the commands inside bebop.  They all use the parser.  It is intended to make it easy to send the commands.  for example, fly_direct takes arguments.  flip handles enums.  Etc.


Save player pvp status + cleaned code

this pr is kind of a mess, submit one with just the relevant changes

saving player pvp states is a bit out of the scope of this plugin in my opinion. Instead I added the ability to choose the default pvp state in commit aeac35e .


[BUG] about.html not found #198

i have fixed the bug of issue#198 now about

us section is working and i have done minimal changes in button

please add gssoc-extd label this  issue.

sir please also add label of level


How to get the API key for YikYak

After poking around the the Android APK I realized that it required the package signature which is then converted to and used at what I assume refers to the YikYak API key for your application. However my question is how did you obtain and generate this key?

Sorry, not willing to discuss this here. I'll email you.


Improve performance of ShortNameComparator.

This is an updated version of #135 .

Yes, this optimization is designed for objects with a large number of children (i.e. 100,000 or more). Let me know if you would like me to generate an object for you.

Nah, I believe you.  It's not that big of a change really.

Yes, this optimization is designed for objects with a large number of children (i.e. 100,000 or more). Let me know if you would like me to generate an object for you.

I meant the algorithm is basically the same, but yes, I can see how it's a less heavy handed implementation.


resolvers: add appQuality and appCommit

Currently remote extensions use a hack to read the product.json, but
this can't be done on web. Instead expose proper API to get the
appQuality and appCommit.

Opening to any review in hopes this can be in the next Insiders. It's only proposed changes anyway, but let me know if there's concerns here.
Also cc @alexdima


colorize json

#3920

I am not sure about colors if they are proper for it.

@mhils can you review this PR?

I like the overall approach! Maybe we can be a bit extra fancy and process the output of json.JSONEncoder().iterencode() instead of relying on pretty_json.

@mhils Yeah, It can be helpful but with  iterencode() it does not follow indentation. I think we have to write custom indentation or is there anything that I am missing?

What do you mean by "it does not follow indentation"? You can do json.JSONEncoder(indent=4).iterencode() for example.

What do you mean by "it does not follow indentation"? You can do json.JSONEncoder(indent=4).iterencode() for example.

I have tried that early but didn't realize that it returns spaces and '\n' when I tried to print it directly.
But now it seems easy to parse, I will update it.

Will this PR add json color for both cli and web interface ?

@lefuturiste Upto now this pr only adds JSON colors to console but JSON data is parsed for web interface also as it uses the same content view as cli so I think it can be added to the web interface with changing stylesheets of the web interface.

This will only update the CLI for now. The Web UI changes would need to be applied in web/, not in the compiled assets. Long term, that shouldn't be necessary at all anyways.

Thanks again @sarthak212! 🍰

Learned a lot about JSON.


Error when publishing with exact amount in wallet

The Issue
There was a recent app side patch to address a deposit error when you don't have enough LBC, but it doesn't take into account the scenario if the bid is exactly equal to the wallet balance. This is most likely because there is a tx fee associated with the publish (no way to calculate this right now as it depends on what UTXOs the tx uses - this is something we'd need added to the daemon logic where the balance calculation should really reside).

Steps to reproduce

Have 1 LBC in wallet
Publish with 1 LBC bid
See error

Expected behaviour
Insufficient balance error
Actual behaviour
Ugly error
System Configuration

LBRY Daemon version: 0.18.0
LBRY App version: 0..19.1
LBRY Installation ID:
Operating system: Windows

Anything Else

Screenshots

So the solution is to get a daemon fix, correct? I am going to mark this as protocol dependent. Otherwise, we can just arbitrarily set a limit below your balance that is the maximum you can send. i.e. max send limit is your balance - .1 LBC (or whatever the upper limit of likely fees are)

The UX around this has improved, no longer an issue in the redesign. Final adjustments will be made when the daemon can provide fee estimates.