[BUG] roPresence remote API problem error

Describe the bug
API error causes roPresence to crash/exit.
To Reproduce

Run "npm start" in terminal.

Log
 *********************************************************************************************
 *** roPresence v2.0.0 Launched: Tue Dec 31 2019 20:03:24 GMT-0800 (Pacific Standard Time) ***
 *********************************************************************************************

 * Non-terminal slave process launched.
RPC: Attempting to login through IPC.
roPresence Express kill server online.
RPC: Logged in as Smaltin<PHONE_NUMBER>6340096).
Socket Client: Starting.
roPresence API Error: roPresence ran into an error and had to stop. This error is mainly due to a remote API problem.
Please restart the presence.
roPresence: Stopping. Exiting cmd in 10 seconds.
Socket Client: Connected to socket, authenticating.
Socket Client: Authenticated to socket, ready.

Desktop:

OS: Windows 10

Fixed. I will try to find a solution to fix this issue for a good time.


Views location is not getting updated when switching profiles

In my default profile with gitlens installed, move 3 gitlens views to a new view container (in secondary side bar)
Create an empty profile
Switch back to default profile
🐛 gitlens view are back in SCM instead of in their new view container

CC @alexr00

Works great, thank you!


3D sound is not working properly

Sound is generated at the local player's location, and not at the source.
Water gun sound is only heard from the local player's own gun and not other players' guns.

Fixed in #484


ZEPPELIN-28 propagate empty interpreter vars to Spark conf

Is needed for CouchDB support, see https://issues.apache.org/jira/browse/ZEPPELIN-28

Ready to merge

Looks good to me

LGTM


Icon/image prop not showing up IOS

Bug report

Summary
Using React-native-maps version 0.28.0, on IOS mapview using PROVIDER_GOOGLE custom icon/image prop on MapView.Marker does not render any icon/image passed. Both icon/image however work on android no problem.
Environment info
  react-native: 0.64.2
  react: 17.0.1
  react-native-maps: 0.28.0
  ios: 14.5 (using Google Maps)
 android: 11

react-native info output:
System:
OS: macOS 11.4
CPU: (6) x64 Intel(R) Core(TM) i5-8500B CPU @ 3.00GHz
Memory: 182.07 MB / 16.00 GB
Shell: 5.8 - /bin/zsh
Binaries:
Node: 12.21.0 - ~/.nvm/versions/node/v12.21.0/bin/node
Yarn: 1.22.10 - ~/.nvm/versions/node/v12.21.0/bin/yarn
npm: 6.14.11 - ~/.nvm/versions/node/v12.21.0/bin/npm
Watchman: 4.9.0 - /usr/local/bin/watchman
Managers:
CocoaPods: 1.10.1 - /usr/local/bin/pod
SDKs:
iOS SDK:
Platforms: iOS 14.5, DriverKit 20.4, macOS 11.3, tvOS 14.5, watchOS 7.4
Android SDK:
API Levels: 23, 28, 29, 30
Build Tools: 28.0.3, 29.0.2, 29.0.3, 30.0.3
System Images: android-28 | Google Play Intel x86 Atom, android-29 | Google APIs Intel x86 Atom, android-29 | Google Play Intel x86 Atom, android-30 | Google APIs Intel x86 Atom, android-30 | Google Play Intel x86 Atom
Android NDK: Not Found
IDEs:
Android Studio: 4.1 AI-201.87<IP_ADDRESS>99119
Xcode: 12.5.1/12E507 - /usr/bin/xcodebuild
Languages:
Java: 11.0.10 - /usr/bin/javac
npmPackages:
@react-native-community/cli: Not Found
react: 17.0.1 => 17.0.1
react-native: 0.64.2 => 0.64.2
react-native-macos: Not Found
npmGlobalPackages:
react-native: Not Found
Steps to reproduce

Set up React native maps running on ios using google maps
try to pass a require(path/to/icon) in the icon prop on marker
no marker is displayed on map

Describe what you expected to happen:
marker to show up
Describe what you actually happens:
no marker
Reproducible sample code
<Marker
          key={521}
          identifier="flag"
          icon={require('../../assets/icons/flag_small.png')}
          coordinate={region}
          tracksViewChanges={false}
        />

Changed  to <MapView.Marker /> Solved issue


Ships are unable to move

This issue occurs when only Valkyrien Skies and addons are installed and no other mods

[X] I have tested this issue and it occurs when no other mods are installed

Minecraft Version
1.20
Eureka version
1.5.1
VS2 version
2.3.0
Mod Loader
Fabric
Issue description
I have asemblet a Ship and at first everything worked just as expectet, but all of a sudden, i was unable to move my ship at all. But when i tried to move smaller ships, i was able to fly.
Issue reproduction
I dont know how this Issue is reproduced
Logs
[12:38:44] [Server thread/ERROR]: java.lang.Exception: Collision box is too big! AABB[-2.8604410650000006E7, 80.0, -3343.80366746895] -> [27.325287599116564,<PHONE_NUMBER>9274712, 1.2290053650000006E7] returning empty list! this might break things

this log info comes whenever a boat is moved. no mater if the boat is able or unable to move


Preserving aspect ratio

I have multiple issues, but all center around preserving the aspect ratio when I convert an asciicast file to an .svg.
I have been experimenting with the flags but I'm not sure what solves this problem.
I use gnome-terminal on Ubuntu 16.04. I would like to get output where the width : height ratio is 16 : 9. I've found that the closest cols/rows setting to this is 94 cols and 28 rows given the default font and font-size in gnome-terminal, so accordingly I add --width=94 and --height=28 to the command.
The full command I'm using is:
svg-term --in=htop --out=htop.svg --term=terminal --profile=profile4svgterm.dconf --no-optimize --width=94 --height=28
Unfortunately, the .svg output is rendered with a different aspect ratio.
Here's gnome-terminal running asciinema play htop:

And then the .svg output as displayed by chromium-browser:

It's probably hard to perceive at first glance, but the .svg output slightly taller and therefore has a different aspect ratio. Also, the characters on the right hand side are slightly cut off, but that probably also happens because of the different ratio.
As I understand, the terminal profile I specify is ignored by svg-term, or I am not specifying it correctly.
As of Ubuntu 16.04 the terminal profile is part of dconf, ie. it's not a stand-alone file somewhere in the home directory of the user, but part of a database and can be exported. Here's the file (profile4svgterm.dconf) I get after exporting from dconf.
[/]
foreground-color='rgb(0,255,0)'
visible-name='profile4svgterm'
default-size-columns=94
default-size-rows=28
use-system-font=false
use-theme-colors=false
font='Monospace 12'
use-theme-transparency=false
background-color='rgb(0,0,0)'

I am not sure svg-term understands this file and would like to know what format works the best.
Another, unrelated issue I have noticed that sometimes the .svg output is a file with 0 bytes and therefore the command has to be repeated to get a non-empty output.
Here's a gist with the input and output files.

UPDATE: After doing some troubleshooting, I've found that If I specify a non existing file for --profile, svg-term does not complain about the invalid path/file.

Sorry for taking so long to respond to this.
I suspect the issues you see might at least partially be caused by svg-term (via. term-schemes) not parsing your --profile correctly.
The expected behavior would be for svg-term-cli to fail loudly (being unable to parse dconf files as the xml expected for --term=terminal), which is not what happens for you if I understand correctly? (Something with the terminal format detection appears to be off...)
svg-term-cli expects you to provide a --terminal flag that indicates the profile format to parse:

hyper: javascript
iterm2: plist xml
konsole: ini
remmina: ini
terminal: plist xml
termite: ini
tilda: ini
xfce: ini
xresources: ?
xterm: ?

Any of those should work


stopProcessGroup throws UnexpectedValueException

Supervisord version 3.0.0
When calling stopProcessGroup it returns an empty response which results in UnexpectedValueException being thrown altho processes got stopped.
I'm not sure whether this is an issue of supervisord itself. If so, close this issue if not happy to help solving it.

I am closing this issue for now. If the issue still exists, please open it at https://github.com/supervisorphp/supervisor


Fix a typo in README

Fix the typo.

Thank you! I should see if I can get @Qard's remark plugin in here to ensure that the examples are runnable / valid. You know, when I have some time.

You mean remark-lint-code-eslint? It just does linting, not running. I suppose one could make a plugin for remark-lint-code that just eval'd stuff and passed errors along as a linting failure, even though it's not really linting. Actually, I might just do that myself. :smile_cat:

Landed as c92ddd37272018b09612e8feed12d84fd8e52349, will be released in a new patch version shortly. Thank you!


[ci] Don't diff when running clang-format

This takes about 15-20 extra seconds but has the benefit of allowing users to replicate and fix clang format issues locally with ease.
The second commit in this PR contains all the formatting fix-ups necessary.
cc @areusch

Thanks for sending out this PR! @driazati Is this solve the similar problem with https://github.com/apache/tvm/pull/10895 but on the cpp side?

Right this should fix the issue you had earlier regarding the difference in output between CI / local


chore: enable protogetter linter

Description

Enable protogetter linter, this one has auto-fix configuration enabled

References

https://github.com/ghostiam/protogetter

Review Checklist

[x] I have clicked on "allow edits by maintainers".
[ ] I have added documentation for new/changed functionality in this PR or in a PR to openfga.dev [Provide a link to any relevant PRs in the references section above]
[ ] The correct base branch is being used, if not main
[ ] I have added tests to validate that the change in functionality is working as expected

@tranngoclam thanks for doing this! There's a few other places that need updates too: parser.MustTransformDSLToProto(....).TypeDefinitions

@tranngoclam thanks for doing this! There's a few other places that need updates too: parser.MustTransformDSLToProto(....).TypeDefinitions

@miparnisari I have fixed, please review again. Thanks!


Cow: Watch ibran.com

Cow requests the watch of the watch_keyword ibran\.com. See the MS search here and the Stack Exchange search in text, in URLs, and in code.

ibran\.com has been seen in 1 true positive, 0 false positives, and 0 NAAs.

Approved by Makyen in Charcoal HQ


Hovering over a property within the UI displays all available tooltips of the type

After updating Swashbuckle.Core from 5.2.2 to 5.3.1 we get the following behavior.

The good thing: This is a known and already fixed issue in swagger-ui (https://github.com/swagger-api/swagger-ui/issues/1836).
The bad thing: The fix was merged 10 days after the last release.

can confirm that.

Looks like it's resolved in swagger-ui but not yet available as a standard release. For SB, I'm inclined to treat it as a known issue as opposed to rolling back the embedded swagger-ui version. Then, as soon as the next swagger-ui is released I'll pull it in.

As a workaround in the meantime you could inject the following JavaScript into the UI, which rearranges the DOM elements into their proper order:
$(".model-signature span.propWrap > div:first-child").each(function () {
    var $propWrapDiv = $(this);
    var $propWrapSpan = $propWrapDiv.parent();

    // Reverse the nesting of
 to be

    // and move any other content that was in the  after the
.
    $propWrapSpan.contents().insertAfter($propWrapSpan);
    $propWrapDiv.contents().appendTo($propWrapSpan);
    $propWrapSpan.appendTo($propWrapDiv);
});

I believe this is resolved with v5.4.0 of SB


Promise API

Any plans to promisify the neovim client API?
Would you rather see it done in this package, node-client, or a forked package?
Related issues:
https://github.com/neovim/node-client/issues/11
https://github.com/neovim/node-client/pull/7

@rhysd has a fork that adds a promise API.

See https://github.com/rhysd/promised-neovim-client

Yeah I'm just trying to gauge interest on how to handle it - ideally I would like to avoid maintaining a separate fork, but if there are no plans to add promises, then that's what I'll do. Also if there are plans, I can try to add that in.

Doesn't https://github.com/rhysd/promised-neovim-client fit your needs? Or why would you need to maintain another fork?
There are not plans to add promise API to this repo. If it's a really important feature, given that https://github.com/rhysd/promised-neovim-client is somewhat battle-tested and there seems to be rising interest, perhaps we should discuss merging https://github.com/rhysd/promised-neovim-client back in. @rhysd @tarruda @nhynes what do you think?

Wouldn't I need a fork of node-host that uses promised-neovim-client instead of neovim-client?

I stand by my comment when @rhysd first suggested a promise-based API for the client: I don't have anything against, but it should be optional because callback APIs is what node.js standard library uses and some node programmers may not like promises.
This is not a problem for promise API consumers(eg: co) since it is very easy to wrap any callback API into promises (libraries like bluebird support this out-of-box). Take mz for example, it wraps the entire node.js standard library into promises and is no more than a couple hundred lines of code.
When I first suggested a separate package for promises, I was hoping @rhysd would build promised-neovim-client on top of the existing callback-based client, but now I see that it was simply forked, which is a more cumbersome path since any client changes will have to be replicated in both packages.

@tarruda @justinmk @billyvg
I see.  Then I think I can create a pull request again!  Making callback optional.

I didn't like to use a wrapper such as bluebird because it makes callstack deeper and debugging harder.  And I could not predict its overhead.  Actually RPC is a bottle neck of my app according to DevTools.

@tarruda @justinmk @billyvg
I noticed that existence of callback is used to determine to request or notify the API.
https://github.com/neovim/node-client/blob/master/index.js#L54
If we decided to return Promise value when callback not specified,  we always need to use request because API function can't know the returned Promise value is actually used or not.  What do you think?

If we decided to return Promise value when callback not specified, we always need to use request because API function can't know the returned Promise value is actually used or not. What do you think?

If a caller is using the promise-wrapped API, assume only requests will be sent, and you will always have to pass a callback in this case(since the callback is provided by your code, which is wrapping the callback API into promises)

@tarruda
So, you mean that there should be 2 APIs for each remote API such as nvim.command(cmd: string, cb?: Function): void and nvim.command2(cmd: string): Promise<void>? Although we need to consider the name of wrapped APIs.

So, do you mean that there should be 2 APIs for each remote API such as nvim.command(cmd: string, cb?: Function): void and nvim.command2(cmd: string): Promise?

Yes

Although we need to consider the name of wrapped APIs.

The name can be the same, all we need is to return an object with APIs wrapped. Here's how I imagine the README example using co would look like:

var cp = require('child_process');
var attach = require('neovim-client/promisified');
var co = require('co');

var nvim_proc = cp.spawn('nvim', ['-u', 'NONE', '-N', '--embed'], {});
co(function*() {
  var nvim = yield attach(nvim_proc.stdin, nvim_proc.stdout);

  nvim.on('request', (method, args, resp) => co(function*() {
    // handle msgpack-rpc request
  }).then((result) => resp.send(result)).catch((err) => resp.send(err.message, true)));

  nvim.on('notification', (method, args) => co(function*() {
    // handle msgpack-rpc notification
  }));

  var res = yield nvim.command('vsp');
  var windows = yield nvim.getWindows();
  console.log(windows.length);  // 2
  console.log(windows[0] instanceof nvim.Window); // true
  console.log(windows[1] instanceof nvim.Window); // true
  yield nvim.setCurrentWindow(windows[1]);
  var win = yield nvim.getCurrentWindow();
  console.log(win.equals(windows[1]))  // true
  yield nvim.quit();
  console.log("Nvim exited!");
}).catch((err) => console.log(err));

The implementation of the promisified version of attach should be quite simple:

Call attach(the non-promisified version) and return a promise for it
On the attach promise resolution, iterate through each class/method, wrap into a promise-aware version and return the promisified API object. The iteration logic can be copied/pasted from the typescript interface generator.


Inputting into a TextField advances the swiper

My last screen is an TextField prompt, and as soon as something is entered, the swiper goes back to the beginning slide. Loop is not on.
Any ideas why swiper is hooked into the keyboard events? I don't see any relevant props.

basically #82


storage scrubber: GC ancestor shard layers

Problem
After a shard split, the pageserver leaves the ancestor shard's content in place.  It may be referenced by child shards, but eventually child shards will de-reference most ancestor layers as they write their own data and do GC.  We would like to eventually clean up those ancestor layers to reclaim space.
Summary of changes

Extend the physical GC command with --mode=full, which includes cleaning up unreferenced ancestor shard layers
Add test test_scrubber_physical_gc_ancestors
Remove colored log output: in testing this is irritating ANSI code spam in logs, and in interactive use doesn't add much.
Refactor storage controller API client code out of storcon_client into a storage_controller/client crate
During physical GC of ancestors, call into the storage controller to check that the latest shards seen in S3 reflect the latest state of the tenant, and there is no shard split in progress.

Checklist before requesting a review

[ ] I have performed a self-review of my code.
[ ] If it is a core feature, I have added thorough tests.
[ ] Do we need to implement analytics? if so did you add the relevant metrics to the dashboard?
[ ] If this PR requires public announcement, mark it with /release-notes label and add several sentences in this section.

Checklist before merging

[ ] Do not forget to reformat commit message to not include the above checklist

What if the remote storage lists some but not all shards, e.g. because we're in the middle of Tenant::split_prepare ?

I need to think about this more.  The hardest case is if we list things to do GC, then a new split happens while we are GC'ing, which references layers we will delete.  This is only an issue if doing multiple splits.
One possible soft approach is to always upload parent index_part during split, and then apply the min_age to parent index mtime

. The hardest case is if we list things to do GC, then a new split happens while we are GC'ing, which references layers we will delete. This is only an issue if doing multiple splits.

Thought more about this.   When we GC an ancestor layer, it means that the indices for children no longer refer to it.  So any further splits cannot refer to the ancestral layer.
Importantly, the split process shuts down the remote timeline client for the parent shard before it uploads child shards.  That means that once we upload the child shards, the parents may be considered "frozen" and do not risk derefencing any ancestor layers (as long as the pageserver is still running).  If the pageserver dies halfway through a split, the storage controller will retry the split, which will eventually still write child shard indices which do not reference any ancestral layers that their parent doesn't reference.

About AncestorRefs: why is it not a more phyiscal refcount map, like on the absolute_key ? Sure, a bit less memory efficient but much harder to screw up.

Memory efficiency is relatively important here, because we build the AncestorRefs for all timelines in an entire region.

Similarly, I don't think we should go through the trouble of only tracking the cross-ancestor references.

Same as above: because we're building this map globally, it's important that we limit the scope of what we store in memory.
Could we rework this to avoid building the monolithic ancestor refs map?  Yes, but at the cost of having to first build global list of tenant shards, then go back and do the per-tenant work (with a smaller AncestorRefs scoped to one tenant).  It's a tradeoff: for this PR, I'm preferring to take the memory cost of listing all ancestor refs, vs. the memory cost of storing a total list of all tenants (100ks).
I wrote this avoiding the assumption that listings are reliably returned in order, S3 kinda-sorta promises this, but I have limited trust in third party implementations which might offer a more readdir-like lack of ordering.

I would prefer we call it parent shard, so at least there is a minimal distinction from the word ancestor which we already use for Timeline.

The use of "ancestor" is intentional, because a shard can reference layers that are from it's parent's parents.  It's annoying that we have an "ancestor shard" and "ancestor timeline" concept, but I think it's the right word.  We could call them "forebears" or some other synonym but I think that would be worse :-)

Could we rework this to avoid building the monolithic ancestor refs map? Yes, but at the cost of having to first build global list of tenant shards, then go back and do the per-tenant work (with a smaller AncestorRefs scoped to one tenant)

If we're going to integrate scrubber with storcon anyway then we might as well avoid all the "discover tenants/shards through ListObjectsv2" and instead simply ask storcon for a list of tenants to scrub. And that list would include a consistent list of which shards exist.


dates and times in duration arithmetic

The test failure on Oracle doesn't appear to have anything to do with the changes in this PR. I'm mystified as to why it suddenly started failing but even so....


Add/fix fields in CREATE MIGRATION

message field is now reflected in schema::Migration
Added generated_by field to the migration
DDL-generated migrations are now marked with generated_by := MigrationGeneratedBy.DDLStatement.

Also I've noted that you can't do SET message :=  in START MIGRATION:
edgedb> start migration to { module default { type X; }};
OK: START MIGRATION
edgedb[tx]> populate migration;
OK: POPULATE MIGRATION
edgedb[tx]> set message := 'from started';
error: EdgeQLSyntaxError: Unexpected 'message'
  ┌─ query:1:5
  │
1 │ set message := 'from started';
  │     ^^^^^^^ error

edgedb[tx:failed]> rollback;

This is a bug, right? But I'm not sure if it's fixable, as it conflicts with set {module|global|alias} syntax a bit.

This is a bug, right? But I'm not sure if it's fixable, as it conflicts with set {module|global|alias} syntax a bit.

It's probably fixable, in this specific case of set message; probably not for arbitrary things?

This is all fairly reasonable but I think that there is a simpler way that leverages our generic mechanisms for handling SET. Try to use that and follow up with me if it doesn't work?

It works. Thanks! Feels a bit too magical for someone not familiar enough with the codebase, though.

Oh, by the way, I've just noticed that I've added uniqueness check into the quite generic check. Please double check that it's fine (looks like it's only used in two places, but I'm not sure). Maybe some SET field statements should be overridable?

Oh, by the way, I've just noticed that I've added uniqueness check into the quite generic check. Please double check that it's fine (looks like it's only used in two places, but I'm not sure). Maybe some SET field statements should be overridable?

Yeah, that seems right.


TODO: Add credit offer creation page

User should be able to create a new credit offer - requires a new page to do so.

User is now able to create and edit credit offers!


Youtube download don't work anymore on Windows

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like that [x])
Use Preview tab to see how your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2017.01.10. If it's not read this FAQ entry and update. Issues with outdated version will be rejected.

[x ] I've verified and I assure that I'm running youtube-dl 2017.01.10

Before submitting an issue make sure you have:

[ x] At least skimmed through README and most notably FAQ and BUGS sections
[ x] Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

[x ] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

E:\Pobrane>youtube-dl.exe https://www.youtube.com/watch?v=L-rLiYl-b1E -v
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: ['https://www.youtube.com/watch?v=L-rLiYl-b1E', '-v']
[debug] Encodings: locale cp1250, fs mbcs, out cp852, pref cp1250
[debug] youtube-dl version 2017.01.10
[debug] Python version 3.4.4 - Windows-10-10.0.14393
[debug] exe versions: ffmpeg N-80256-g0a9e781, ffprobe N-80256-g0a9e781
[debug] Proxy map: {}
[youtube] L-rLiYl-b1E: Downloading webpage
ERROR: Unable to download webpage: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:600)> (caused by URLError(SSLError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:600)'),))
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpu7wtweqp\build\youtube_dl\extractor\common.py", line 406, in _request_webpage
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpu7wtweqp\build\youtube_dl\YoutubeDL.py", line 2001, in urlopen
  File "C:\Python\Python34\lib\urllib\request.py", line 464, in open
  File "C:\Python\Python34\lib\urllib\request.py", line 482, in _open
  File "C:\Python\Python34\lib\urllib\request.py", line 442, in _call_chain
  File "C:\Users\dst\AppData\Roaming\Build archive\youtube-dl\rg3\tmpu7wtweqp\build\youtube_dl\utils.py", line 1041, in https_open
  File "C:\Python\Python34\lib\urllib\request.py", line 1185, in do_open

Description of your issue, suggested solution and other information
similar issue here: https://github.com/rg3/youtube-dl/issues/11545
It seem that windows build need updated python to work.

https://github.com/rg3/youtube-dl/issues/11573#issuecomment-269896421


More fully document Akri's build process

Is your feature request related to a problem? Please describe.
There are many, independent but necessary changes required when extending Akri.
The Development doc does a good job but it is insufficient.
The build process is quite involved.
Is your feature request related to a way you would like Akri extended? Please describe.
More fully document the steps needed to extend Akri's build process with new components.
Use these documented steps as informal unit tests when changes are made to the build process.
Consider improvements to the build process reviewing the documented steps.
E.g. the Makefiles are very repetitive and would benefit from refactoring.
Describe the solution you'd like
I took a stab at documenting extending the build process for new components since I've just done this for the Webhook:
https://hackmd.io/@akri/S16Xoixyd
Feedback very welcome.
Describe alternatives you've considered
None.
Additional context
E.g. see https://github.com/deislabs/akri/pull/206

This issue brings up a good point: Akri's development documentation could be more organized and comprehensive.
Currently Akri's main development document is: https://docs.akri.sh/development/development
We also have one focused on using our makefiles: https://docs.akri.sh/development/building
And then the additional documentation @DazWilkin provided above:  https://hackmd.io/@akri/S16Xoixyd
This documentation should be brought together and reorganized and put into Akri's documentation repository


Can't install on centos

Can't install on centos. I tried with conda and venv.
Python 3.10.10
CentOS Linux release 7.9.2009 (Core)
NAME="CentOS Linux"
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://www.centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"

CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"

CentOS Linux release 7.9.2009 (Core)
CentOS Linux release 7.9.2009 (Core)

Collecting llama-cpp-python
  Using cached llama_cpp_python-0.1.63.tar.gz (1.5 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting diskcache>=5.6.1
  Using cached diskcache-5.6.1-py3-none-any.whl (45 kB)
Requirement already satisfied: numpy>=1.20.0 in /projects/academic/thapar/fpena/miniconda3/lib/python3.10/site-packages (from llama-cpp-python) (1.24.3)
Requirement already satisfied: typing-extensions>=4.5.0 in /projects/academic/thapar/fpena/miniconda3/lib/python3.10/site-packages (from llama-cpp-python) (4.6.3)
Building wheels for collected packages: llama-cpp-python
  Building wheel for llama-cpp-python (pyproject.toml) ... error
  error: subprocess-exited-with-error

  × Building wheel for llama-cpp-python (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [9 lines of output]
      Traceback (most recent call last):
        File "/tmp/pip-build-env-cqd_uytp/overlay/lib/python3.10/site-packages/skbuild/setuptools_wrap.py", line 645, in setup
          cmkr = cmaker.CMaker(cmake_executable)
        File "/tmp/pip-build-env-cqd_uytp/overlay/lib/python3.10/site-packages/skbuild/cmaker.py", line 148, in __init__
          self.cmake_version = get_cmake_version(self.cmake_executable)
        File "/tmp/pip-build-env-cqd_uytp/overlay/lib/python3.10/site-packages/skbuild/cmaker.py", line 105, in get_cmake_version
          raise SKBuildError(msg) from err

      Problem with the CMake installation, aborting build. CMake executable is /tmp/pip-build-env-cqd_uytp/overlay/lib/python3.10/site-packages/cmake/data/bin/cmake
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for llama-cpp-python
Failed to build llama-cpp-python
ERROR: Could not build wheels for llama-cpp-python, which is required to install pyproject.toml-based projects

I even tried this method:
pip install llama-cpp-python --force-reinstall --upgrade --no-cache-dir
Any help is appreciated.
Thanks

In can install lower version.
CMAKE_ARGS="-DLLAMA_OPENBLAS=on" FORCE_CMAKE=1 pip install llama-cpp-python==0.1.48 Collecting llama-cpp-python==0.1.48   Using cached llama_cpp_python-0.1.48-cp310-cp310-linux_x86_64.whl Requirement already satisfied: typing-extensions>=4.5.0 in /projects/academic/thapar/fpena/miniconda3/lib/python3.10/site-packages (from llama-cpp-python==0.1.48) (4.6.3) Installing collected packages: llama-cpp-python Successfully installed llama-cpp-python-0.1.48

@fpena06 can you post the failed build log with the --verbose flag?

@abetlen this is pip install -r requirements --verbose
Building wheels for collected packages: llama-cpp-python
  Running command Building wheel for llama-cpp-python (pyproject.toml)
  Traceback (most recent call last):
    File "/tmp/pip-build-env-45n19u0t/overlay/lib/python3.10/site-packages/skbuild/setuptools_wrap.py", line 645, in setup
      cmkr = cmaker.CMaker(cmake_executable)
    File "/tmp/pip-build-env-45n19u0t/overlay/lib/python3.10/site-packages/skbuild/cmaker.py", line 148, in __init__
      self.cmake_version = get_cmake_version(self.cmake_executable)
    File "/tmp/pip-build-env-45n19u0t/overlay/lib/python3.10/site-packages/skbuild/cmaker.py", line 105, in get_cmake_version
      raise SKBuildError(msg) from err

  Problem with the CMake installation, aborting build. CMake executable is /tmp/pip-build-env-45n19u0t/overlay/lib/python3.10/site-packages/cmake/data/bin/cmake
  error: subprocess-exited-with-error

  × Building wheel for llama-cpp-python (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> See above for output.

  note: This error originates from a subprocess, and is likely not a problem with pip.
  full command: /projects/academic/thapar/fpena/miniconda3/envs/textgen/bin/python /projects/academic/thapar/fpena/miniconda3/envs/textgen/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py build_wheel /tmp/tmpd09vvcgp
  cwd: /tmp/pip-install-h2w8p32k/llama-cpp-python_5bdbf0a6f27c4e3cbfac658b135348d7
  Building wheel for llama-cpp-python (pyproject.toml) ... error
  ERROR: Failed building wheel for llama-cpp-python
Failed to build llama-cpp-python
ERROR: Could not build wheels for llama-cpp-python, which is required to install pyproject.toml-based projects

@fpena06 thank you, can you try with the reinstall flags as well, this output doesn't really give anything to work off of.

@abetlen this is with pip install --verbose --upgrade --force-reinstall -r requirements.txt version 0.1.48 installs fine.
Building wheels for collected packages: llama-cpp-python, peft
  Running command Building wheel for llama-cpp-python (pyproject.toml)
  Traceback (most recent call last):
    File "/tmp/pip-build-env-kekb8b9k/overlay/lib/python3.10/site-packages/skbuild/setuptools_wrap.py", line 645, in setup
      cmkr = cmaker.CMaker(cmake_executable)
    File "/tmp/pip-build-env-kekb8b9k/overlay/lib/python3.10/site-packages/skbuild/cmaker.py", line 148, in __init__
      self.cmake_version = get_cmake_version(self.cmake_executable)
    File "/tmp/pip-build-env-kekb8b9k/overlay/lib/python3.10/site-packages/skbuild/cmaker.py", line 105, in get_cmake_version
      raise SKBuildError(msg) from err

  Problem with the CMake installation, aborting build. CMake executable is /tmp/pip-build-env-kekb8b9k/overlay/lib/python3.10/site-packages/cmake/data/bin/cmake
  error: subprocess-exited-with-error

  × Building wheel for llama-cpp-python (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> See above for output.

  note: This error originates from a subprocess, and is likely not a problem with pip.
  full command: /projects/academic/thapar/fpena/llm/text-generation-webui/venv/bin/python /projects/academic/thapar/fpena/llm/text-generation-webui/venv/lib/python3.10/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py build_wheel /tmp/tmpduxacufk
  cwd: /tmp/pip-install-94m2uix0/llama-cpp-python_6991439dbd094502a5590dc56f099623
  Building wheel for llama-cpp-python (pyproject.toml) ... error
  ERROR: Failed building wheel for llama-cpp-python
  Running command git rev-parse HEAD
  e45529b149c7f91ec1d4d82a5a152ef56c56cb94
  Running command git show-ref e45529b149c7f91ec1d4d82a5a152ef56c56cb94
  Running command Building wheel for peft (pyproject.toml)
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib
  creating build/lib/peft
  copying src/peft/__init__.py -> build/lib/peft
  copying src/peft/mapping.py -> build/lib/peft
  copying src/peft/import_utils.py -> build/lib/peft
  copying src/peft/peft_model.py -> build/lib/peft
  creating build/lib/peft/tuners
  copying src/peft/tuners/lora.py -> build/lib/peft/tuners
  copying src/peft/tuners/__init__.py -> build/lib/peft/tuners
  copying src/peft/tuners/p_tuning.py -> build/lib/peft/tuners
  copying src/peft/tuners/prefix_tuning.py -> build/lib/peft/tuners
  copying src/peft/tuners/adaption_prompt.py -> build/lib/peft/tuners
  copying src/peft/tuners/prompt_tuning.py -> build/lib/peft/tuners
  copying src/peft/tuners/adalora.py -> build/lib/peft/tuners
  creating build/lib/peft/utils
  copying src/peft/utils/other.py -> build/lib/peft/utils
  copying src/peft/utils/__init__.py -> build/lib/peft/utils
  copying src/peft/utils/save_and_load.py -> build/lib/peft/utils
  copying src/peft/utils/config.py -> build/lib/peft/utils
  installing to build/bdist.linux-x86_64/wheel
  running install
  running install_lib
  creating build/bdist.linux-x86_64
  creating build/bdist.linux-x86_64/wheel
  creating build/bdist.linux-x86_64/wheel/peft
  copying build/lib/peft/__init__.py -> build/bdist.linux-x86_64/wheel/peft
  copying build/lib/peft/mapping.py -> build/bdist.linux-x86_64/wheel/peft
  creating build/bdist.linux-x86_64/wheel/peft/tuners
  copying build/lib/peft/tuners/lora.py -> build/bdist.linux-x86_64/wheel/peft/tuners
  copying build/lib/peft/tuners/__init__.py -> build/bdist.linux-x86_64/wheel/peft/tuners
  copying build/lib/peft/tuners/p_tuning.py -> build/bdist.linux-x86_64/wheel/peft/tuners
  copying build/lib/peft/tuners/prefix_tuning.py -> build/bdist.linux-x86_64/wheel/peft/tuners
  copying build/lib/peft/tuners/adaption_prompt.py -> build/bdist.linux-x86_64/wheel/peft/tuners
  copying build/lib/peft/tuners/prompt_tuning.py -> build/bdist.linux-x86_64/wheel/peft/tuners
  copying build/lib/peft/tuners/adalora.py -> build/bdist.linux-x86_64/wheel/peft/tuners
  copying build/lib/peft/import_utils.py -> build/bdist.linux-x86_64/wheel/peft
  copying build/lib/peft/peft_model.py -> build/bdist.linux-x86_64/wheel/peft
  creating build/bdist.linux-x86_64/wheel/peft/utils
  copying build/lib/peft/utils/other.py -> build/bdist.linux-x86_64/wheel/peft/utils
  copying build/lib/peft/utils/__init__.py -> build/bdist.linux-x86_64/wheel/peft/utils
  copying build/lib/peft/utils/save_and_load.py -> build/bdist.linux-x86_64/wheel/peft/utils
  copying build/lib/peft/utils/config.py -> build/bdist.linux-x86_64/wheel/peft/utils
  running install_egg_info
  running egg_info
  writing src/peft.egg-info/PKG-INFO
  writing dependency_links to src/peft.egg-info/dependency_links.txt
  writing requirements to src/peft.egg-info/requires.txt
  writing top-level names to src/peft.egg-info/top_level.txt
  reading manifest file 'src/peft.egg-info/SOURCES.txt'
  adding license file 'LICENSE'
  writing manifest file 'src/peft.egg-info/SOURCES.txt'
  Copying src/peft.egg-info to build/bdist.linux-x86_64/wheel/peft-0.4.0.dev0-py3.10.egg-info
  running install_scripts
  creating build/bdist.linux-x86_64/wheel/peft-0.4.0.dev0.dist-info/WHEEL
  creating '/tmp/pip-wheel-18viugi3/.tmp-jx4maczr/peft-0.4.0.dev0-py3-none-any.whl' and adding 'build/bdist.linux-x86_64/wheel' to it
  adding 'peft/__init__.py'
  adding 'peft/import_utils.py'
  adding 'peft/mapping.py'
  adding 'peft/peft_model.py'
  adding 'peft/tuners/__init__.py'
  adding 'peft/tuners/adalora.py'
  adding 'peft/tuners/adaption_prompt.py'
  adding 'peft/tuners/lora.py'
  adding 'peft/tuners/p_tuning.py'
  adding 'peft/tuners/prefix_tuning.py'
  adding 'peft/tuners/prompt_tuning.py'
  adding 'peft/utils/__init__.py'
  adding 'peft/utils/config.py'
  adding 'peft/utils/other.py'
  adding 'peft/utils/save_and_load.py'
  adding 'peft-0.4.0.dev0.dist-info/LICENSE'
  adding 'peft-0.4.0.dev0.dist-info/METADATA'
  adding 'peft-0.4.0.dev0.dist-info/WHEEL'
  adding 'peft-0.4.0.dev0.dist-info/top_level.txt'
  adding 'peft-0.4.0.dev0.dist-info/RECORD'
  removing build/bdist.linux-x86_64/wheel
  Building wheel for peft (pyproject.toml) ... done
  Created wheel for peft: filename=peft-0.4.0.dev0-py3-none-any.whl size=58226 sha256=e17c84f7a56b7e5f5d7eb488efccbd50f2cd690eeb73fd06bdeb7af1a96a5de6
  Stored in directory: /projects/academic/thapar/fpena/.cache/pip/wheels/75/5f/15/f22ec8074767da800560c87bf2e22117ba2bcacf96f442e920
Successfully built peft
Failed to build llama-cpp-python
ERROR: Could not build wheels for llama-cpp-python, which is required to install pyproject.toml-based projects

I think it's caused because of https://github.com/ggerganov/llama.cpp/issues/1788, maybe installing and building the latest version of that where static_assert are changed to _Static_assert will fix this

I think it's caused because of ggerganov/llama.cpp#1788, maybe installing and building the latest version of that where static_asserts are changed to _Static_assert will fix this

thanks, I was able to reproduce this issue with llama.cpp, which led to another issue which this fixed. But how can I make this changes in llama-cpp-python? I can't find k_quants.h or ggml.c, which I had to modify in llama.cpp.
Thanks

@fpena06 if you're building from source from the github repo, just follow the instructionns in the README and the llama.cpp project should be cloned to the vendor/llama.cpp subdirectory.

@fpena06 if you're building from source from the github repo, just follow the instructionns in the README and the llama.cpp project should be cloned to the vendor/llama.cpp subdirectory.

@abetlen worked like a charm after making the changes to llama.cpp and moving to vender folder and installing =)
(textgen) [fpena@vortex2:~/projects/llm/llama-cpp-python]$ pip install -e .
Obtaining file:///projects/academic/thapar/fpena/llm/llama-cpp-python
  Installing build dependencies ... done
  Checking if build backend supports build_editable ... done
  Getting requirements to build editable ... done
  Preparing editable metadata (pyproject.toml) ... done
Requirement already satisfied: typing-extensions>=4.5.0 in /projects/academic/thapar/fpena/miniconda3/envs/textgen/lib/python3.10/site-packages (from llama-cpp-python==0.1.63) (4.6.3)
Requirement already satisfied: numpy>=1.20.0 in /projects/academic/thapar/fpena/miniconda3/envs/textgen/lib/python3.10/site-packages (from llama-cpp-python==0.1.63) (1.25.0)
Collecting diskcache>=5.6.1 (from llama-cpp-python==0.1.63)
  Using cached diskcache-5.6.1-py3-none-any.whl (45 kB)
Building wheels for collected packages: llama-cpp-python
  Building editable for llama-cpp-python (pyproject.toml) ... done
  Created wheel for llama-cpp-python: filename=llama_cpp_python-0.1.63-0.editable-py3-none-any.whl size=6297 sha256=8ce15a09b191ca46ccc9bb3ffe69f1a529cfde499a9039fa40b10090d6773b94
  Stored in directory: /tmp/pip-ephem-wheel-cache-ljbx53x5/wheels/e6/34/99/4838c156399d94c4764cf9f545ed38c46c029c3b0edea83b1c
Successfully built llama-cpp-python
Installing collected packages: diskcache, llama-cpp-python
  Attempting uninstall: llama-cpp-python
    Found existing installation: llama-cpp-python 0.1.48
    Uninstalling llama-cpp-python-0.1.48:
      Successfully uninstalled llama-cpp-python-0.1.48
Successfully installed diskcache-5.6.1 llama-cpp-python-0.1.63


Add scatterplot to page

Add a button that, when clicked, shows the a scatterplot of the relationship between the height of the drone and the RSSI.
"Show Graph" seems really generic of a name for the button, is there a clearer name we can use?
Also, the x axis isn't backward like the graphs that Andy showed, is that ok?
Collapsed:

Expanded:

"Show Graph" seems really generic of a name for the button, is there a clearer name we can use?

Height/RSSI Graph?
Scatterplot?
ANALYSIS!

Also, the x axis isn't backward like the graphs that Andy showed, is that ok?

You can still get the same outcome, so it's prob fine. If not, we can get feedback and it's an easy fix.


ipc: rpmsg_multi_instance: Some fixes and init cleanup

A less controversial cleanup of the rpmsg_multi_instance driver and some fixes.

tagging @maje-emb


refactor: rename generate_optional_schema method to generate_partial_schema

solved https://github.com/hbakri/django-ninja-crud/issues/112

sorry! for whatever reason I wasn't thinking about that. give me a minute and I'll fix it.


Backport v1.12: CI: Add IPsec key rotation test

Manual backport of

https://github.com/cilium/cilium/pull/26730
https://github.com/cilium/cilium/pull/27203
https://github.com/cilium/cilium/pull/27883

for pr in 26730 27203 27883; do contrib/backporting/set-labels.py $pr done 1.12; done

Signed-off-by: Zhichuan Liang<EMAIL_ADDRESS>

/ci-ipsec-e2e

/ci-ipsec-e2e

/ci-ipsec-e2e

/ci-ipsec-e2e

/ci-ipsec-e2e

/ci-ipsec-e2e

/ci-ipsec-e2e

/ci-ipsec-e2e

/ci-ipsec-e2e

/test-backport-1.12

/test-1.16-4.9

/test-1.20-4.9

I got pinged as @cilium/tophat for .github/actions/conn-disrupt-test/action.yaml and .github/ariane-config.yaml.
Shouldn't these be assigned to @cilium/ci-structure or @cilium/github-sec instead, even on release branches?
I'll approve to get this out of the review queue.


Torrent support

This implement TorrServer in Aniyomi
Changes:

Added torrent streaming support
Added torrent support in local source
Added support for downloading torrents

Streaming demo:
https://github.com/aniyomiorg/aniyomi/assets/80992641/e9a00a77-ada5-4f6d-a7dd-1ed4446cb63c
Download demo:
https://github.com/aniyomiorg/aniyomi/assets/80992641/4fae6de8-3aaa-4059-863f-777c43dc9efe

How much does this increase app size?

Why not upload the compiled libraries to something like Jitpack or Sonatype?
👍

btw idk why the build is failing aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa i made the exact same pr in my repo and the same gh action work fine , i also clone the repo in my machine and works fine

btw idk why the build is failing aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa i made the exact same pr in my repo and the same gh action work fine , i also clone the repo in my machine and works fine

Your aniyomi repo is probably outdated then, since it doesn't include my merge from mihon where I moved :core to :core:common
To fix this, do import tachiyomi.core.common.i18n.stringResource instead of import tachiyomi.core.i18n.stringResource etc etc

Any updates on this PR? I rebased it onto master, fixed all the conflicts and built it for my phone. Everything seems to be working fine except that the torrserver settings aren't shown in the app's settings.
Here's my branch with the fixed conflicts: https://github.com/Grafcube/aniyomi/tree/torrent


Mach-O x86_64 relocations are dysfunctional

Filed on behalf of @chris-pcguy
Version and Platform (required):

Binary Ninja Version: 3.6.4751-dev
OS: macOS
OS Version: 14.2.1
CPU Architecture: M1

Bug Description:
Opening a mach-o with data sections containing addresses of external symbols are simply null, instead of containing the address of the symbol as imported and shown in the .extern section of the mach-o view.
Steps To Reproduce:
Please provide all steps required to reproduce the behavior:

Open a mach-o executable, i.e. a macOS kext.
Look at a place in the data section that references external symbols, i.e the virtual function table of an IOService derivative.
Observe how the referenced symbols are just null bytes, as seen in the raw file itself.

Expected Behavior:
The addresses be populated, instead of being null.
Screenshots:

Additional Information:
This may be due to lack of handling of the __LINKEDIT segment, but I am uncertain.

Some more information: Did not encounter such issue with ARM64e kexts yet, but only x86_64 ones.

After further investigation, it appears no relocations actually work for x86_64 mach-o binaries. Example:

Relocation type X86_64_RELOC_BRANCH.
Navigating to 0x7139 brings me to a CALL instruction's value,

The address "1051db4b9" of the relocation as calculated and set in https://github.com/Vector35/view-macho/blob/main/machoview.cpp#L1052 is incorrect.

This is the code in question that handles that  relocation type https://github.com/Vector35/arch-x86/blob/5948b33cf7aa16733997d81ff76cdf6ec5eabdf4/arch_x86.cpp#L4167

To be more precise, the problem here is that it calculates that the relocation is at 0x 1051db4b9, but in the view it's at 0x7139, so nothing happens.

@plafosse
diff --git a/machoview.cpp b/machoview.cpp
index 7eaacc8..ec5892b 100644
--- a/machoview.cpp
+++ b/machoview.cpp
@@ -270,6 +270,7 @@ MachoView::MachoView(const string& typeName, BinaryView* data, bool parseOnly):
 MachOHeader MachoView::HeaderForAddress(BinaryView* data, uint64_t address, bool isMainHeader, std::string identifierPrefix)
 {
        MachOHeader header;
+       memset(&header, 0, sizeof(MachOHeader));
        header.isMainHeader = isMainHeader;

        header.identifierPrefix = identifierPrefix;

This seems to resolve the problems with the relocations of the instructions, but data references seem to remain broken.

and the problem with the data sections is here: https://github.com/Vector35/arch-x86/blob/5948b33cf7aa16733997d81ff76cdf6ec5eabdf4/arch_x86.cpp#L4189-L4200
Those places are ones with r_external: 1 and r_type: 0

diff --git a/arch_x86.cpp b/arch_x86.cpp
index e19fbef..191a7f4 100644
--- a/arch_x86.cpp
+++ b/arch_x86.cpp
@@ -4187,15 +4187,15 @@ public:
                        dest32[0] = dest32[0] + target - (uint32_t)pcRelAddr;
                        break;
                case X86_64_RELOC_UNSIGNED:
-                       if (!info.external)
-                       {
+                       // if (!info.external)
+                       // {
                                switch (info.size)
                                {
                                        case 4: *dest32 += target - (uint32_t)pcRelAddr; break;
                                        case 8: *dest64 += info.target - pcRelAddr; break;
                                        default: break;
                                }
-                       }
+                       // }
                        // TODO rebasing
                        break;
                case X86_64_RELOC_SUBTRACTOR:

lol...

And actually, this latter issue is also on ARM64; ARM64_RELOC_UNSIGNED is not handled.

Will be fixed by Vector35/view-macho#7 and Vector35/arch-x86#37

(By the way, unrelated but, nice product. Though it has its issues here and there, like this one. Couldn't wait and looked into this myself. I don't actually own Binja, can't afford it right now, sorry. Was actually using Ghidra before, it's gotten so unstable lately. Binary Ninja works very well. I'm also writing a C++ class analysis plug-in, to auto create VTables and such. Might also PR a fix for the arm64 variant of this relocation issue at some point, if you guys don't get to it. :-))

Fixed in 4.1.4941-dev


Errors when running demo.py and video_demo.py

I get the following error when I run demo.py even though I built mxnet from source
AttributeError: module 'mxnet.contrib.symbol' has no attribute 'Yolo2Output'
I also get this when I run video_demo.py
resnet50_yolov2_resnet50_416-symbol.json": No such file or directory
I have only downloaded darknet and resnet50 as indicated in the readme
Any ideas ?

https://github.com/zhreshold/mxnet-yolo/issues/34


oauth2 envoyfilter not working in istio with Keycloak

Bug Description
Hi there,
I am using the stack "Istio - oauth2-proxy - Keycloak" for authentication in my apps and as I have seen the oauth2 filter I wanted to get rid of oauth2-proxy.
I followed this post in order to make it work with the only difference I am using Keycloak instead of GoogleOauth.
I applied the following .yaml
apiVersion: networking.istio.io/v1alpha3
kind: EnvoyFilter
metadata:
  name: oauth2-ingress
  namespace: istio-system
spec:
  workloadSelector:
    labels:
      istio: ingressgateway
  configPatches:
  - applyTo: HTTP_FILTER
    match:
      context: GATEWAY
      listener:
        filterChain:
          filter:
            name: "envoy.filters.network.http_connection_manager"
            subFilter:
              name: "envoy.filters.http.jwt_authn"
    patch:
      operation: INSERT_BEFORE
      value:
       name: envoy.filters.http.oauth2
       typed_config:
         "@type": type.googleapis.com/envoy.extensions.filters.http.oauth2.v3alpha.OAuth2
         config:
          token_endpoint:
            cluster: oauth
            uri: https://keycloak.local/auth/realms/test/protocol/openid-connect/token
            timeout: 3s
          authorization_endpoint: https://keycloak.local/auth/realms/test/protocol/openid-connect/auth
          redirect_uri: "%REQ(x-forwarded-proto)%://%REQ(:authority)%/callback"
          redirect_path_matcher:
            path:
              exact: /callback
          signout_path:
            path:
              exact: /signout
          credentials:
            client_id: test
            token_secret:
              name: token
              sds_config:
                path: "/etc/istio/config/oauth2/token-secret.yaml"
            hmac_secret:
              name: hmac
              sds_config:
                path: "/etc/istio/config/oauth2/hmac-secret.yaml"
          pass_through_matcher:
            - name: authorization
              prefix_match: Bearer
          auth_scopes:
            - profile
            - openid
            - email
          forward_bearer_token: true
---
apiVersion: v1
kind: ConfigMap
metadata:
  name: istio-oauth2
  namespace: istio-system
data:
  token-secret.yaml: |-
    resources:
      - "@type": "type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret"
        name: token
        generic_secret:
          secret:
            inline_string: "NDgxODZjZDQtMTZmYy00NTc5LTkyNDgtZTVmNTcyZGIzYTEwCg=="
  hmac-secret.yaml: |-
    resources:
      - "@type": "type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret"
        name: hmac
        generic_secret:
          secret:
            inline_bytes: XYJ7ibKwXwmRrO/yL/37ZV+T3Q/WB+xfhmVlio+wmc0=
            # generated using `head -c 32 /dev/urandom | base64`
---
apiVersion: security.istio.io/v1beta1
kind: RequestAuthentication
metadata:
  name: jwt-authentication
  namespace: istio-system
spec:
  selector:
    matchLabels:
      app: istio-ingressgateway
  jwtRules:
    - issuer: "https://keycloak.local/auth/realms/test"
      jwksUri: "https://keycloak.local/auth/realms/test/protocol/openid-connect/certs"
      forwardOriginalToken: true
      audiences:
        - test
---
apiVersion: security.istio.io/v1beta1
kind: AuthorizationPolicy
metadata:
  name: known-user
  namespace: istio-system
spec:
  selector:
    matchLabels:
      app: istio-ingressgateway
  rules:
  - when:
    - key: request.headers[Authorization]
      notValues:
      - 'Bearer*'
  - when:
    - key: request.auth.audiences
      values:
        - 'test'
    - key: request.auth.presenter
      values:
        - test
---

And when I try to access any app I am properly redirected to Keycloak, then I input username and password but when I am redirected back to the app I get the following message: "OAuth flow failed".
What is wrong in my config? What I am missing?
Version
istioctl version --remote
client version: 1.10.0
control plane version: 1.10.0
data plane version: 1.10.0 (112 proxies)

kubectl version --short
Client Version: v1.22.1
Server Version: v1.22.1

helm version --short
v3.4.1+gc4e7485

Hello @ricosega,
the "OAuth flow failed" error message can mean all kinds of problems.
To debug set the log level of istio-proxy to debug:
kubectl exec <pod> -c istio-proxy -- curl -X POST http://localhost:15000/logging?level=debug
The isiot-proxy logs realy helped me to figure out the issue in my case.
I followed the same tutorial post for my setup and i had to solve two issues:

My keycloak setup did not have the scopes "profile" and  "openid". I simply removed them from the envoy filter for testing purpose.
I had to make sure the Client-Secret was plain text and not base64 encoded:

token-secret.yaml: |-
    resources:
      - "@type": "type.googleapis.com/envoy.extensions.transport_sockets.tls.v3.Secret"
        name: token
        generic_secret:
          secret:
            inline_string: "**XXXXXXXXXXXXXXXXXXXXXXXXX**"

Maybe this clould be the solution for you, otherwise you can post the output of the istio-proxy logs on debug level for further investigations.


Torch ROCm - RuntimeError: Unsupported memory format for group normalization: ChannelsLast3d

ROCm - RuntimeError: Unsupported memory format for group normalization: ChannelsLast3d
pytorch version: 2.6.0.dev20241113+rocm6.2
got prompt
!!! Exception during processing !!! Unsupported memory format for group normalization: ChannelsLast3d
Traceback (most recent call last):
  File "/home/qwer/ComfyUI/execution.py", line 323, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
  File "/home/qwer/ComfyUI/execution.py", line 198, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
  File "/home/qwer/ComfyUI/execution.py", line 169, in _map_node_over_list
    process_inputs(input_dict, i)
  File "/home/qwer/ComfyUI/execution.py", line 158, in process_inputs
    results.append(getattr(obj, func)(**inputs))
  File "/home/qwer/ComfyUI/custom_nodes/Ruyi-Models/comfyui/comfyui_nodes.py", line 385, in process
    sample = pipeline(
  File "/home/qwer/ComfyUI/venv/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context
    return func(*args, **kwargs)
  File "/home/qwer/ComfyUI/custom_nodes/Ruyi-Models/ruyi/pipeline/pipeline_ruyi_inpaint.py", line 845, in __call__
    mask_latents, masked_video_latents = self.prepare_mask_latents(
  File "/home/qwer/ComfyUI/custom_nodes/Ruyi-Models/ruyi/pipeline/pipeline_ruyi_inpaint.py", line 375, in prepare_mask_latents
    mask_bs = self.vae.encode(mask_bs)[0]
  File "/home/qwer/ComfyUI/venv/lib/python3.10/site-packages/diffusers/utils/accelerate_utils.py", line 46, in wrapper
    return method(self, *args, **kwargs)
  File "/home/qwer/ComfyUI/custom_nodes/Ruyi-Models/ruyi/models/autoencoder_magvit.py", line 280, in encode
    x = self.tiled_encode(x, return_dict=return_dict)
  File "/home/qwer/ComfyUI/custom_nodes/Ruyi-Models/ruyi/models/autoencoder_magvit.py", line 384, in tiled_encode
    tile = self.encoder(tile)
  File "/home/qwer/ComfyUI/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1740, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/home/qwer/ComfyUI/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1751, in _call_impl
    return forward_call(*args, **kwargs)
  File "/home/qwer/ComfyUI/custom_nodes/Ruyi-Models/ruyi/vae/ldm/models/omnigen_enc_dec.py", line 272, in forward
    next_frames = self.single_forward(x[:, :, i: i + self.mini_batch_encoder, :, :], None, None)
  File "/home/qwer/ComfyUI/custom_nodes/Ruyi-Models/ruyi/vae/ldm/models/omnigen_enc_dec.py", line 215, in single_forward
    x = self.mid_block(x)
  File "/home/qwer/ComfyUI/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1740, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/home/qwer/ComfyUI/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1751, in _call_impl
    return forward_call(*args, **kwargs)
  File "/home/qwer/ComfyUI/custom_nodes/Ruyi-Models/ruyi/vae/ldm/modules/vaemodules/mid_blocks.py", line 194, in forward
    hidden_states = resnet(hidden_states)
  File "/home/qwer/ComfyUI/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1740, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/home/qwer/ComfyUI/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1751, in _call_impl
    return forward_call(*args, **kwargs)
  File "/home/qwer/ComfyUI/custom_nodes/Ruyi-Models/ruyi/vae/ldm/modules/vaemodules/common.py", line 236, in forward
    x = self.norm1(x)
  File "/home/qwer/ComfyUI/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1740, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
  File "/home/qwer/ComfyUI/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1751, in _call_impl
    return forward_call(*args, **kwargs)
  File "/home/qwer/ComfyUI/venv/lib/python3.10/site-packages/accelerate/hooks.py", line 170, in new_forward
    output = module._old_forward(*args, **kwargs)
  File "/home/qwer/ComfyUI/venv/lib/python3.10/site-packages/torch/nn/modules/normalization.py", line 313, in forward
    return F.group_norm(input, self.num_groups, self.weight, self.bias, self.eps)
  File "/home/qwer/ComfyUI/venv/lib/python3.10/site-packages/torch/nn/functional.py", line 2965, in group_norm
    return torch.group_norm(
RuntimeError: Unsupported memory format for group normalization: ChannelsLast3d

Prompt executed in 36.15 seconds

I haven't encountered a similar situation, but I suspect it may be related to the PyTorch preview version. I was able to use version 2.5.1 without any issues, so installing that version might be helpful.
This issue describes a similar problem, and I hope you find it useful.

I haven't encountered a similar situation, but I suspect it may be related to the PyTorch preview version. I was able to use version 2.5.1 without any issues, so installing that version might be helpful.
This issue describes a similar problem, and I hope you find it useful.

Thx.


Improve coverage of mkt/extensions to 100%

r+, although r- on using your time off on code quality.

But playing with coverage was fun ! :)


Unused methods in IActivation interface

Issue Description
The following methods in IActivations are unused.
void setParametersViewArray(INDArray viewArray, boolean initialize);

INDArray getParametersViewArray();

void setGradientViewArray(INDArray viewArray);

INDArray getGradientViewArray();

Would it be ok to remove them as a part of the ongoing cleanup?

Long ago the plan was to allow activation functions with learnable parameters. That never happened, and it's not on the DL4J roadmap either. SameDiff would use a different mechanism also.
In short: yes, feel free to remove that.


Time events dedupe

Fixes #
Addresses BUG #44.  Implemented a de-duplication test in createTimeValue() function.
Changes Proposed:
Function now:

checks if an event for the supplied time value already exists in the model.  If so, the function returns the existing event.
If not, a new event is created, added to the model and returned.

Testing done by manual inspection of the generated TTL files for situations where activities share event beginning and/or ending boundaries.

Thanks @ClimbingAl for the PR! I've also manually checked your improvement and it all seems to be working fine.
Its worth noting for anyone else that the current feature set in the editor doesn't provide the user a choice if they are actually wanting to create the same point in time or not. Is an activity just happening to be at the same point in time, or purposely following the previous activity? This is something that could be improved in the future by exposing a decision to the user to aid producing consistent data models. That being said, removing duplications is seen as better default.


Added error checking and additional params to createImage

Added parameters for foreground and background colors, as well as a flag for transparent background, to QRCode->createImage(). Also added basic error checking on values for parameters.
New syntax (backwards-compatible with old) is $qr->createImage(2, 4, 0x0000FF, 0x000000, true); where 0x0000FF is the foreground color (blue), 0x000000 is the background color (black; not relevant in this case because of next param), and true is to use transparent background.

Thank u !


Use CompletePackageInterface in test of package

In the resolution of bower dependecies, you merge rootPackages and the others packages (line 110) and test if package is an instance of CompletePackage.
But in the case where the root package uses an alias :
    "branch-alias": {       "dev-master": "2.0.x-dev"     },
The type of package is RootAliasPackage which not extend CompletePackage like RootPackage.
So i think is better to check on an interface CompletePackageInterface to take all case

Thanks :)


fix: fix scrollbar color

PR Checklist

[ ] Addresses an existing open issue: fixes #000
[ ] That issue was marked as status: accepting prs
[ ] Steps in CONTRIBUTING.md were taken

Overview
Before

After

@all-contributors please add @azat-io for code.

🤖 Beep boop! This comment was added automatically by all-contributors-auto-action.
Not all contributions can be detected from Git & GitHub alone. Please comment any missing contribution types this bot missed.
...and of course, thank you for contributing! 💙


Add code coverage

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@358949e). Click here to learn what that means.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master      #46   +/-   ##
=========================================
  Coverage          ?   68.27%
=========================================
  Files             ?       15
  Lines             ?      706
  Branches          ?       23
=========================================
  Hits              ?      482
  Misses            ?      224
  Partials          ?        0

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 358949e...ff147cd. Read the comment docs.


Site is down

Hello
Seems like the site is down, please fix it if you guys have the time.
Thanks

yeah…still down

Back up! Someone should make a mirror of it, however.

Right now seems like the site is not available - browser is endlessly spinning trying to load the page.

Hah the downloaded pdfs filled the disk to 100% and everything died. Fixed.

Hah the downloaded pdfs filled the disk to 100% and everything died. Fixed.

How much disk space does it take up?

down again

still down .. too much downtime recently
can someone please host it on a reliable server

Skim is an alternative to arxiv-sanity with lot of features.

Site is down again.

@karpathy is working on rewriting arxiv-sanity: https://www.reddit.com/r/MachineLearning/comments/obne9p/d_is_arxivsanity_down_what_people_use_these_days/h3q422o/


Docs landing page

Looking at highlighting some different facets of the docs. These need some design work. CC @scopegate

@plaindocs the first take on a new landing page is now in place — I've still gotta put a bunch of content in and check on the way I've implemented the layout and controller, but it's a start 👍🏻

Awesomeness!

This is looking great!

I reckon we should probably just chop down the install list, as well as removing the second intro line "Install agents on:" Maybe

Ubuntu
macOS
Windows
AWS
Google Cloud
More…
SSH keys for private repositories

And I think we might need to highlight the tag line differently/

Ready for a review now, I think! Other than a general review for code quality and any design suggestions, I'd really appreciate some input on:

Ensuring that I haven't broken the Algolia search biz on the homepage
A check that what I've done to the Rails controllers makes sense
Sanity check on content (ping @plaindocs)

Ready for a review now, I think! Other than a general review for code quality and any design suggestions, I'd really appreciate some input on:

Ensuring that I haven't broken the Algolia search biz on the homepage
A check that what I've done to the Rails controllers makes sense
Sanity check on content (ping @plaindocs)

This looks awesome! :tada: :star:

[ ] I've rebooted the preview, not :100: sure if that will let us check the Algolia search box due to the URL.
[ ] I'll give the content a final edit tomorrow.
[ ] Do we want a generic "more..." link for each section?
[ ] I'm wondering if that "Popular articles" is too much as it is?

This looks awesome! :tada: :star:

[ ] I've rebooted the preview, not :100: sure if that will let us check the Algolia search box due to the URL.
[ ] I'll give the content a final edit tomorrow.
[ ] Do we want a generic "more..." link for each section?
[ ] I'm wondering if that "Popular articles" is too much as it is?

Looks like the images are at images/docs/icons/ but referenced at   /docs/assets/icons/

Looks like the images are at images/docs/icons/ but referenced at   /docs/assets/icons/

[x] Looks like the images are at images/docs/icons/ but referenced at /docs/assets/icons/

OK, after quite some futzing looks like I managed to fix this in bec3440

👍

Awesome work @scopegate @plaindocs !!!


Add new local_perf option for aggregation after each local training iteration

Add new local_perf option for aggregation after each local training iteration

I rebased with iss4-mini-batches and I probably shouldn't have... So I created a new branch, cherry-picked the 2 significant commits from it, and will create a new PR. Closing this one.


ci(travis): add node 12 to test matrix

In my opinion, I think this isn’t necessary. While theoretically there’s nothing wrong with testing everywhere, it does actually introduce false positives, slower builds, and I’ve never seen it catch a problem 🤷♂


The StarmapParallelization doesn't seem to work

Hi!
I made this example:
import numpy as np
from multiprocessing.pool import ThreadPool
from pymoo.core.problem import StarmapParallelization
from pymoo.optimize import minimize
from pymoo.algorithms.soo.nonconvex.ga import GA
from pymoo.core.problem import ElementwiseProblem

N = 100

class MyProblem(ElementwiseProblem):

    def __init__(self, **kwargs):
        super().__init__(n_var=N, n_obj=1, n_ieq_constr=0, xl=-5, xu=5, **kwargs)

    def _evaluate(self, x, out, *args, **kwargs):
        mat = np.random.random((N, N))
        b = mat @ x

        a = np.pow(b, 2).sum()

        out["F"] = a
        # sleep(1.0)

# the number of threads to be used
n_threads = 20

# initialize the pool
pool = ThreadPool(n_threads)

runner = StarmapParallelization(pool.starmap)

# define the problem by passing the starmap interface of the thread pool
problem = MyProblem(elementwise_runner=runner)

algorithm = GA(
    pop_size=10000,
)

res = minimize(
    problem=problem,
    algorithm=algorithm,
    seed=1,
    n_gen=1000,
    verbose=True
)
print('Threads:', res.exec_time)

pool.close()

When I run it, this is the processing profile:

It is clearly not running in parallel. Observe that only one processor thread is not idle.
Any idea on what to do to run a GA in parallel?

I had a look at it and don't believe that it is an parallelization issue in the problem definition.
Check out the following code where I am implementing a custom parallelization of the objective function directly in the problem.
import numpy as np
from multiprocessing.pool import ThreadPool
from pymoo.core.problem import StarmapParallelization, Problem
from pymoo.optimize import minimize
from pymoo.algorithms.soo.nonconvex.ga import GA
from pymoo.core.problem import ElementwiseProblem

pool = ThreadPool(8)

N_VAR = 100
POP_SIZE = 5000
N_GEN = 2

def f(x):
    n = len(x)
    mat = np.random.random((n, n))
    b = mat @ x
    return np.power(b, 2).sum()

class MyProblem(ElementwiseProblem):

    def __init__(self, **kwargs):
        super().__init__(n_var=N_VAR, n_obj=1, n_ieq_constr=0, xl=-5, xu=5, **kwargs)

    def _evaluate(self, x, out, *args, **kwargs):
        out["F"] = f(x)

class MyStarmapProblem(Problem):

    def __init__(self, **kwargs):
        super().__init__(n_var=N_VAR, n_obj=1, n_ieq_constr=0, xl=-5, xu=5, **kwargs)

    def _evaluate(self, X, out, *args, **kwargs):
        out["F"] = pool.starmap(f, [[x] for x in X])

########## REGULAR ##########

problem = MyProblem()

algorithm = GA(pop_size=POP_SIZE)

res = minimize(
    problem=problem,
    algorithm=algorithm,
    termination=('n_gen', N_GEN),
    seed=1,
    verbose=True
)
print('Regular:', res.exec_time)

########## THREADS ##########

runner = StarmapParallelization(pool.starmap)

# define the problem by passing the starmap interface of the thread pool
problem = MyProblem(elementwise_runner=runner)

algorithm = GA(pop_size=POP_SIZE)

res = minimize(
    problem=problem,
    algorithm=algorithm,
    termination=('n_gen', N_GEN),
    seed=1,
    verbose=True
)
print('Threads:', res.exec_time)

########## CUSTOM ##########

# define the problem by passing the starmap interface of the thread pool
problem = MyStarmapProblem()

algorithm = GA(pop_size=POP_SIZE)

res = minimize(
    problem=problem,
    algorithm=algorithm,
    termination=('n_gen', N_GEN),
    seed=1,
    verbose=True
)
print('CUSTOM:', res.exec_time)

########## FIN_VARALIZE ##########

pool.close()

The algorithm itself however, does not parallelize on threads which will still be the overhead in your case. Because The objective function runs still quite fast.
To prove this we can use a small population with a longer wait time.
from multiprocessing.pool import ThreadPool
from time import sleep

from pymoo.algorithms.soo.nonconvex.ga import GA
from pymoo.core.problem import ElementwiseProblem
from pymoo.core.problem import StarmapParallelization
from pymoo.optimize import minimize

pool = ThreadPool(8)

N_VAR = 100
POP_SIZE = 8
N_GEN = 2

class MyProblem(ElementwiseProblem):

    def __init__(self, **kwargs):
        super().__init__(n_var=N_VAR, n_obj=1, n_ieq_constr=0, xl=-5, xu=5, **kwargs)

    def _evaluate(self, x, out, *args, **kwargs):
        sleep(1)
        out["F"] = 1

########## REGULAR ##########

problem = MyProblem()

algorithm = GA(pop_size=POP_SIZE)

res = minimize(
    problem=problem,
    algorithm=algorithm,
    termination=('n_gen', N_GEN),
    seed=1,
    verbose=True
)
print('Regular:', res.exec_time)

########## THREADS ##########

runner = StarmapParallelization(pool.starmap)

# define the problem by passing the starmap interface of the thread pool
problem = MyProblem(elementwise_runner=runner)

algorithm = GA(pop_size=POP_SIZE)

res = minimize(
    problem=problem,
    algorithm=algorithm,
    termination=('n_gen', N_GEN),
    seed=1,
    verbose=True
)
print('Threads:', res.exec_time)

########## FIN_VARALIZE ##########

pool.close()

and this will clearly show that the problem is parallelized.
=================================================
n_gen  |  n_eval  |     f_avg     |     f_min
=================================================
     1 |        8 |  1.0000000000 |  1.0000000000
     2 |       16 |  1.0000000000 |  1.0000000000
Regular: 16.23266291618347
=================================================
n_gen  |  n_eval  |     f_avg     |     f_min
=================================================
     1 |        8 |  1.0000000000 |  1.0000000000
     2 |       16 |  1.0000000000 |  1.0000000000
Threads: 2.02089524269104

I switched from ThreadPool to Pool and it seems to be working fine for my problem:
from multiprocessing import Pool
n_processes = 24
pool = Pool(processes=n_processes)
runner = StarmapParallelization(pool.starmap)

# Initialize the problem
problem = MyOptimizationProblem(elementwise_runner=runner)

Hi, thanks for the examples. The key piece of information that made it for me is:

_evaluate in an ElementwiseProblem evaluates a single individual of a population.
_evaluate in a Problem evaluates the entire population, and there is where one should parallelize.

That should be beyond clear in the documentation and examples. I'd kindly ask you to provide copy/paste working examples for the benefit of your project.

I was hoping that this page explains actually exactly this: https://pymoo.org/problems/definition.html
(with the key word vectorized)
Anything you would add there to make it more clear?


UMD dist

Currently there is no UMD dist for users without NPM. I find it very useful as not everyone is able to use NPM module. Thoughts?

yeah sure :+1:

@methyl I was lookin at this and I think I can release a UMD browserified version. The current dist right now doesn't have any dependencies (since it relies on NPM for dep resolving). Thoughts?

Sounds great to me :+1:
W dniu wt., 1.12.2015 o 23:36 Long Ho<EMAIL_ADDRESS>napisał(a):

@methyl https://github.com/methyl I was lookin at this and I think I
can release a UMD browserified version. The current dist right now
doesn't have any dependencies (since it relies on NPM for dep resolving).
Thoughts?
—
Reply to this email directly or view it on GitHub
https://github.com/yahoo/react-dnd-touch-backend/issues/10#issuecomment-161118844
.

close via e9820c273e1e81aab79f7acbca1e58ae2001f6e3


VLAZ: Watch coupomated.com

VLAZ requests the watch of the watch_keyword coupomated\.com. See the MS search here and the Stack Exchange search in text, in URLs, and in code.

coupomated\.com has been seen in 1 true positive, 0 false positives, and 0 NAAs.

Approved by cigien in Charcoal HQ


fix: kiali deps

Makes Kiali require Prometheus

closing as there is (or should be) no dep on prometheus. We will fix the gotmpl that is now spaghetti


Failures on Bump actions/checkout from 3.5.3 to 3.6.0...migrate unnecessary_nullable_for_final_variable_declarations nnbd experiment tests

There are new test failures on Bump actions/checkout from 3.5.3 to 3.6.0...migrate unnecessary_nullable_for_final_variable_declarations nnbd experiment tests.
The tests
pkg/linter/test/experiments_test RuntimeError (expected Pass)
pkg/linter/test/rule_test RuntimeError (expected Pass)

are failing on configurations
unittest-asserts-release-mac
unittest-asserts-release-mac-arm64

@pq

Sorry about the noise here. I just removed experiments_test (https://dart-review.googlesource.com/c/sdk/+/323447) and I'm hoping that should resolve the issue.  I'll keep an eye on the build.

Looks green now. Sorry for the hassle!


Mqtt client looses connection to server after some time (days/weeks)

It looks like topic subscription stop working after some time.

Fix: ping interval for MQTT client was set to 1s from 60s


Submitting the PR link  issue

after clicking it redirects to some other page

Thats not an issue I'll update the link soon, for requesting PR you have to to profile section
I am closing this issue.


Entries nodal output list ignored Bug report

I couldn't find it as an open issue so I'm posting it here.
Bug description
In the BeamDyn primary input file, the first entry in the nodal output list is ignored. That is, the channel at the first entry of the list does not appear in the BeamDyn echo file and the results are not written to the output file (text file). This applies only to the first entry. The second and onward entries are echoed and written to the output files.
To Reproduce
For BeamDyn, in the list
3    BldNd_BlOutNd     - Blades to output
"TDxr"
"TDyr"
"TDzr"
the channel TDxr is not echoed and written, the others are. If the list consists out of one entry, nothing is written.
Temporary fix
Replace the ignored entries with a dummy sensor. for BeamDyn for example the list:
3    BldNd_BlOutNd     - Blades to output
"Dummy"
"TDxr"
"TDyr"
"TDzr"
writes all three channels.
OpenFAST Version
OpenFAST-v2.5.0
Compile Info:

Compiler: Intel(R) Fortran Intel(R) 64 Compiler Classic for applications running on Intel(R)
64, Version 2021.1 Build 20201112_000000
Architecture: 64 bit
Precision: single
Date: Jan 14 2021
Time: 12:12:37
Execution Info:
Date: 03/11/2021
Time: 09:29:17+0100

In ElastoDyn, the second entry in the nodal output list is ignored. Furthermore, the channel TDx is not written at all to the output file.
To Reproduce
For example, in the list
3   BldNd_BladesOut  - Blades to output
"TDx"
"TDy"
"TDz"
The channel TDy is not echoed and written. Furthermore, the channel TDx is echoed, but not written.
In the list
3   BldNd_BladesOut  - Blades to output
"TDx"
"Dummy"
"TDy"
"TDz"
All three channels are echoed, but again, the channel TDx not written.

In AeroDyn, all entries are echoed and written.

I've tested this in the latest dev branch and it seems to work well. @andrew-platt was this addressed in a recent pull request?

@JelmerPolman, I think you have an incorrect format for these nodal outputs. The lines you say are ignored are supposed to be comment lines.
For BeamDyn, you can see examples here:

https://openfast.readthedocs.io/en/dev/source/user/beamdyn/appendix.html
https://github.com/OpenFAST/openfast/blob/main/docs/source/user/beamdyn/examples/NodalOutputs.txt

END of input file (the word "END" must appear in the first 3 columns of the last OutList line)
====== BeamDyn Outputs for all blade stations (same ending as above for B1N1.... ==========
   "All"          BldNd_BlOutNd       - Future feature will allow selecting a portion of the nodes to output.  Not implemented yet. (-)
                  OutList             - The next line(s) contains a list of output parameters.  See OutListParameters.xlsx for a listing of available output channels, (-)
TDxr
TDyr
TDzr

BeamDyn doesn't have a "blades to output" line since there is one file per blade.
For ElastoDyn, there is one additional line for the nodal outputs (the number of blades for output). Here is the documentation on the format:

https://github.com/OpenFAST/openfast/blob/main/docs/source/user/elastodyn/exampleInput/NodalOutpus.txt

END of input file (the word "END" must appear in the first 3 columns of this last OutList line)
---------------------- ELASTODYN NODE OUTPUTS --------------------------------------------
          3   BldNd_BladesOut  - Blades to output
         99   BldNd_BlOutNd   - Blade nodes on each blade (currently unused)
              OutList     - The next line(s) contains a list of output parameters.  See OutListParameters.xlsx, ElastoDyn_Nodes tab for a listing of available output channels, (-)
"ALx"    -  local flapwise acceleration (absolute) of node
"ALy"    - local flapwise acceleration (absolute) of node
"ALz"    - local flapwise acceleration (absolute) of node

Thank you for the replies.
I was always looking for examples after a version release, but could never find them. Thank you for the reference. it all works as expected now.


User Settings in windows 10

in windows path to user settings looks as: (File > Preferences > User Settings), maybe it makes sense to add it to readme.

@radziksh added, thanks!


Update adding-auth-to-our-serverless-app.md

Was throwing error: Error: It looks like you may be passing in Cognito props to the Auth construct. The Auth construct was renamed to Cognito in version 1.10.0. Updating code example to align with new version.

Yup good catch!


Upgrade command not functioning

steam@tekthis-alpha:~$ arkmanager upgrade
arkmanager v: Checking for updates...
/usr/local/bin/arkmanager: line 375: A new version was found! Do you want to upgrade ARK Server Tools to v${$arkstLatestVersion}?: bad substitution

Did you update your config file aswell?
It looks like you're missing the version line in there.

That's a big ten-four, it was the lack of version in the CFG.  Maybe a catch to clarify if it's not in the .cfg?

We always encourage people to update their configuration when upgrading arkmanager, but we could add a function for that.


Update specs2-core, specs2-scalacheck to 4.12.8

Updates

org.specs2:specs2-core
org.specs2:specs2-scalacheck

from 4.8.3 to 4.12.8.
I'll automatically update this PR to resolve conflicts as long as you don't change it yourself.
If you'd like to skip this version, you can just close this PR. If you have any feedback, just mention me in the comments below.
Configure Scala Steward for your repository with a .scala-steward.conf file.
Have a fantastic day writing Scala!

Ignore future updates
Add this to your .scala-steward.conf file to ignore future updates of this dependency:
updates.ignore = [ { groupId = "org.specs2" } ]

labels: test-library-update, semver-minor

Superseded by #294.


Leader election for the operator

Hi, Is anyone already working on leader election in the operator, otherwise could look at it? This is basically feature request.

Which kind of leader election do you mean?
clickhouse-operator is single binary which watch kubernetes api changes to reconcile cursom resources like kind: ClickHouseInstallation

I mean leader election on the Operator pods. So that I could run two instances of the operator pods so that one of them is the leader?

I mean leader election on the Operator pods. So that I could run two instances of the operator pods so that one of them is the leader?

don't do it
by default Deployments contains replicas: 1
you can install
you can't install in common case different versions of clickhouse-operator if you will not have installed CRDs compatible with both operator version
if you have hundreds of clickhouse clusters in side one kubernetes cluster,
you can install two or more deployments of clickhouse-operator (better to different namespaces) but need to configure clickhouse-operator to watch separate namespaces, look to etc-clickhouse-operator-files configmap, watch section in /etc/clickhouse-operator/config.yml
default logic if watch not defined:

if clickhouse-operator runs inside kube-system namespace, then will watch and reconcile all chi,chit,chop,chk custom resources in all namespaces
if clickhouse-operator runs inside any other namespace, then will watch and reconcile all chi,chit,chop,chk custom resources only inside one namespace

if you install replicas: 2 it will race condition with each other

I think it's a best practice for operators to have implement leaderElection?
Also race condition won't occur during operator upgrades? Unless you have configured recreate in deployment strategy.

@Kavinraja-G you trying to add high availability in the case where high availability is not necessary
when a worker node will down, then deployment controller will try to reschedule pod to any available worker node
during upgrade clickhouse-operator, very short period when race condition is possible, but it will go away when the old version pod will destroy
when you have two replicas constantly
then both replicas attempt to watch the same custom resources and attempt to apply the same operations
clickhouse-operator is a stateless application, so you don't need multiple replicas


Autocorrection suggests incorrect datapoints

Autocorrection shows incorrect VSS datapoints at times.
This happens when the VSS Path has incorrect components between correct components.
E.g. Vehicle.abc.Trunk. shows options which are applicable for Vehicle.Body.Trunk....
This also happens when named components are missing.
E.g. Vehicle.Trunk. shows options for Vehicle.Body.Trunk..

Use of JSONPath to figure out correct VSS datapoints can be explored for implementing auto correction.


what is the Integration Criteria for a new blockchain?

Sorry all, I have read https://developer.trustwallet.com/wallet-core/newblockchain.
Our blockchain only rank 861 on CoinMarketCap, far below top 30. I think this criteria is too strict for a new blockchain.
I also notice that a proposal should be approved at https://governance.trustwallet.com . But I only see four blockchains have given proposals and 1M TWT is too expensive for us.
Can you allow us to pull request to trustwallet-core ? We really need this wallet library for wallet developers. Thanks.

just fork and use your own wallet core version, we don't have a plan to add TOP chain

Hi hewigovens, thanks for your reply. If We submit a proposal and get approved, is it possible that we can merge into trustcore library ?


Activity Page - v1.0

/activity

/activity/events

/activity/transactions

/activity/operations


Whats the difference with handlebars?

Basically JsRender functionality is a superset of Handlebars functionality. It is more flexible and powerful in its support/treatment of expressions in templates.  (And at the same time it is secure against using templates to create side effects or to inappropriately access globals).
From a point of view of performance, it is similar to Handlebars for rendering templates, and faster for compiling templates.
The Mustache-inspired template syntax is similar, thought JsRender syntax is slightly more flexible and complete.
I cannot currently provide a more detailed comparison and study of detailed differences or equivalences, but hope to do so at some point, after publishing the official  JsRender and JsViews V1.0 (which is currently my priority).

Closing this issue...


bug: fix broken go install workflow

What
Cleanup unwanted replace directive that was present for k8s.io/kubelet that as never really used in the project.
Fixes: #1468
Why
This was breaking go install due to the replace directive.
Implications
NA

For me, not having this broke vendoring... I'll get that sorted. Thanks for the PR!

@iwilltry42  Would it be possible to get a new tag created with these changes so that I can get unblocked on my other PR ?


Help Updating the Axios libdef for flow v0.37.x

I am really confused about the new error message that is coming up after flow was updated to 0.37.x . I would be happy to help contribute a fix, but I am really not certain how to correct the new messages that are showing up.
109:   declare interface AxiosExport extends Axios {               ^ property `Axios`. Property not found in
. Object
109:   declare interface AxiosExport extends Axios {               ^ property `CancelToken`. Property not found in
. Object
109:   declare interface AxiosExport extends Axios {               ^ property `Cancel`. Property not found in
. Object
109:   declare interface AxiosExport extends Axios {               ^ property `all`. Property not found in
. Object
109:   declare interface AxiosExport extends Axios {               ^ property `create`. Property not found in
. Object
109:   declare interface AxiosExport extends Axios {               ^ property `isCancel`. Property not found in
. Object
109:   declare interface AxiosExport extends Axios {               ^ property `spread`. Property not found in
. Object

Example showing the error messages

I know that this fixes tryflow
But it sure doesn't look right.

@marudor Still seems like the best solution considering! I tried a few hacky things like that to solve it before, but I couldn't get it did not work. I will open a PR for that and leave a comment about why changing it from interface to class worked somehow.
I am not sure if there was a regression in flow 0.37.x or not.

fixed with d28912a0365e24da7e7a99d7b6a787c1e551a2f1


Datastore discrepancy in total number of activities

There seems to be a significant volume of IATI activities missing from the Datastore.
A user (@matmaxgeds) contacted the IATI helpdesk to point out the discrepancy.
The Dashboard has 988,603 activities as of today but the Query Builder has 839,055
Screengrabs below, let me know if you need additional info.
Thanks,
Audrey

I can imagine that this is explained by DSv2 outputting IATI v2 only and Schema valid only, but it would be great to confirm as I think the DSv2 number used to be higher?

we reverted to another datapoint yesterday as Live instance is still repopulating. Also, be aware Datastore only accepts Version 2.x data and runs a check with the validator prior to accepting data. So never use the Dashboard to compare as those numbers will never match as long as Version 1.X is still accepted in a data system.


Increment version to 73, v2.1.0

Google Play release notes:
Now you can view and edit your learner profile. Share a little about yourself with other learners!
Dev release notes:

User Profiles: View and edit your profile
App will automatically log out if a 401 is received fetching course list
Removed permissions: WiFi Status, Location, Device & app history
Removed support for social sharing and social groups
Added to feedback emails: device model, app version, O.S. version
More descriptive screen reporting to NewRelic
Bug fixes

Config version:

https://github.com/edx/edx-mobile-config/commit/dd6ae3b6a3ba37f934c66a4b610c32dd1c495257

Would we want to include "Removed social sharing" in the dev notes?

@bguertin Looks like share courses is enabeld

Updated with fix from https://github.com/edx/edx-app-android/pull/585

Closed in favor of
https://github.com/edx/edx-app-android/pull/605


cms: Do not try to check binary format on stdin and -rctform fix

Two issues in the cms application are fixed by this PR.
Fixes #16195

Do we have the same problem with smime?

Do we have the same problem with smime?

No, there is no such warn_binary() check there.

This pull request is ready to merge

Merged to master. Thank you for the reviews.

@t8m Hi Tomas, we continue to notice the same error
'cat input.cms | openssl cms -decrypt -in /dev/stdin -inkey TransportPrivate.pem -recip TransportCert.pem | openssl pkcs12 -nodes -password pass:'
Error reading SMIME Content Info
805BEF99767F0000:error:068000D1:asn1 encoding routines:SMIME_read_ASN1_ex:no content type:crypto/asn1/asn_mime.c:415:


Package request: robotframework-browserlibrary

Project description
Browser automation using playwright instead of selenium (robotframework-seleniumlibrary).
Metadata

homepage URL: https://robotframework-browser.org/
source URL: https://github.com/MarketSquare/robotframework-browser
license: apache-2
platforms: unix, linux, darwin

Add a :+1: reaction to issues you find important.

I tried packaging this myself, but didn't get it working: https://gist.github.com/ptman/da9c1fcb5d3406bda0211bbc48c336b5

I tried packaging this myself, but didn't get it working: https://gist.github.com/ptman/da9c1fcb5d3406bda0211bbc48c336b5

wrapt is too old on 23.11, you could try against nixpkgs unstable instead. But another issue you'll get is that the project depends on hardcoded versions of protobuf and grpcio: https://github.com/MarketSquare/robotframework-browser/blob/6415dc79623228495f7120a17960b9994e1f6c63/Browser/requirements.txt#L1
You'd have to pass those exact versions, or patch this out, or see with upstream if they could remove that from setup.py and hardcode it only in their build instead. (Could be there's another reason for the hardcoding though.)
To really manage things through nix, you'd have to also handle whatever is happening in their rfbrowser init script (pulling browsers I believe), and replace it with nix dependencies instead. That will probably be tricky to do.

I did try on unstable, with different packages being the problem. I think playwright itself is already packaged, so the browsers shouldn't be the problem. I asked for help on matrix, but the python discussion room was unable to help. I feel like I've exhausted the options available to me. I have written some nix and packages, but python seems to be too much of a jungle to overcome.
Maybe there's some cleanish way to just sidestep this and use a venv with light integration to nix?


AssetCollection derive broken?

Using bevy_asset_loader v0.8 with bevy v0.6, I've gotten an error with the following code which used to work and looks identical to the examples:
use bevy_asset_loader::AssetCollection;

#[derive(AssetCollection)]
pub struct TileAssets {
   /// Our tile collection
   #[asset(texture_atlas(tile_size_x = 32., tile_size_y = 32., columns = 1, rows = 1))]
   #[asset(path = "tiles/atlas.png")]
   pub atlas: Handle<TextureAtlas>
}

with compile error
error[E0425]: cannot find value `atlases` in this scope
 --> examples/tile_replace_stress.rs:4:10
  |
4 | #[derive(AssetCollection)]
  |          ^^^^^^^^^^^^^^^ not found in this scope
  |
  = note: this error originates in the derive macro `AssetCollection` (in Nightly builds, run with -Z macro-backtrace for more info)

With RUSTFLAGS="-Z macro-backtrace" it just unhelpfully points at asset_collection_derive().
Was there a name change recently?

Sounds like you might be missing the render feature?

Aha! That seems to be it. Thanks.

FYI I just pushed a change to get improved error messages in this case:
error: This attribute requires the 'render' feature
 --> $DIR/missing_feature.rs:8:13
  |
8 |     #[asset(texture_atlas(tile_size_x = 100., tile_size_y = 100., columns = 1, rows = 1))]
  |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

error: This attribute requires the 'render' feature
  --> $DIR/missing_feature.rs:10:13
   |
10 |     #[asset(standard_material)]
   |             ^^^^^^^^^^^^^^^^^


add error code 404 handling on the location controller

Hmm,  @MikeNeilson change 990c189649f6ba3e2ce4e21f24730ea1145ddad7  removed NotFoundException handling from ApiServlet.  Was that intentional?

I copied the catch from the TimeSeriesController and assumed that was the right way to handle it

Not saying its wrong to catch and handle it in the controller.  Its just wrong that you HAVE to.  For NotFound it should have been optional

I'm certainly in favor of a global handling in ApiServlet

Hmm, @MikeNeilson change 990c189 removed NotFoundException handling from ApiServlet. Was that intentional?

No, that probably happened in one of my botched rebases (always forgetting to continue the rebase before I start working again.)


Change password

what did i do?
TLDR; the most.
Updated strings.
Added mutation for changing password.
Added green check icon.
Deriving GraphQL endpoint from web endpoint so we don't have to manually change it for staging.
Changed staging toolbar to grey so we can see green toolbar icons.
Also fixed it in XML previews.
Created Activity extensions for showing Snackbars.
Created reusable Snackbar extensions for success and error messages.
The Snackbar extensions return themselves so you can chain them (if you wanted to inflate a success/error Snackbar manually).
Change password:
Showing warning when new password is less than 6 characters.
Showing warning when confirm password is not equal to new confirm.
Disabling save button until all validations pass.
Added 2 new LoginReasons: CHANGE_PASSWORD and RESET_PASSWORD because we want to prefill the email if it's supplied from the intent but need to check if we're showing the reset dialog or change password Snackbar.
Moved the text changed listeners to before we subscribe to the prefillEmail output.
When password is successfully changed, taking user to LoginActivity.
LoginActivity shows success Snackbar letting the user know their changes were saved.
Made LoginActivity's root a CoordinatorLayout so the Snackbar is shown over the keyboard.
Tests on tests on tests.

see

what's left?
Final copy.

 Change Password


Feature request - Save container settings for reuse

Great suggestion by @johncokos
It would be cool if you could magically save container settings (like mounts, ports, etc) for reuse. It's a common use case for people to delete and redownload their containers. They seem to be getting frustrated at having to set all that back up again each time.

Although not perfect, I have some of that working in the 'Linking Container' branch.
This is done by saving the startopts settings to the localStore. Is this what you had in mind?


Shift-Select multiple checkboxes

Issue Type (delete the irrelevant ones)

[x] Enhancement Request
[x] Question

Specs
What version are you using?
v2.14.1
What browser?
any
Expected Behavior
What did you expect to happen?
While using the checkbox table, I am trying to find a way to check and by pressing shift-select to select multiple checkboxes. Is there a way to achieve that?

@apanag I don't think I understand the use case here... you can select multiple checkboxes by clicking on the rows? Is that not what you want to do?

@xaksis Please take a look at this codepen. By using a combination by shift-click you can select multiple checkboxes at once, without the need to click one by one.

Interesting! Let me look into it.