Recent updates and AngularJS 2

Hey everyone, I was just wondering if others had this problem. I have an angularJS 2 implementation of easyrtc and with recent updates everything breaks and for me it's impossible to get the code up and running. I can't even rewrite a simple demo with the most recent changes (or maybe second to most recent). I'm not able to provide specific examples at the moment because I deleted all of the work and just restored back to the old version, but I was wondering if anyone has worked with the most recent updates  and angular 2?
Sorry I added it here, I know it's wrong since it doesn't specifically say it supports angularjs, but since the forums are very very inactive, I thought my best shot was here.
Thanks for any help anyone has to offer, if not feel free to close this issue :)

Actually, the forums have been quite active lately. But there was a period where we were burning the midnight oil on another project and too busy to answer.
First I would suggest trying the beta branch since it always has the most recent fixes.
I believe we have a repository with an angular2 example in it. I'll try it out on the weekend.

That's great to hear, I haven't looked at them in a couple months and remember the dead period, I'm glad it's active again! And amazing, I haven't seen a repo with angular2 but I will look for it if it's out there!

See https://easyrtc.com/blog/2016-11-23-easyrtc-typescript-support/

Ahhh great! Yes they are in the Beta branch, thank you so much! This is exactly what is needed!


fix(user session): state handling

@livio-a I'm not sure if I thought of all cases for login

let's close this, as it still relies on pre v1


Display Tracking Code on the Completed Page for Orders with Shipping Labels

What is the motivation for adding/enhancing this feature?
Customers and users lack visibility into the tracking information of orders, causing confusion and inconvenience, especially after shipping labels have been generated.
To enhance user experience and provide transparency, we should display the tracking code on the Completed page for orders that have shipping labels generated.
What are the acceptance criteria?

[ ] ...

Can you complete this feature request by yourself?

[ ] YES
[ ] NO

Additional information

Will add the design here.


praat: 6.0.37 -> 6.0.38

Semi-automatic update generated by https://github.com/ryantm/nixpkgs-update tools.
This update was made based on information from https://repology.org/metapackage/praat/versions.
These checks were done:

built on NixOS
ran /nix/store/ip7a4lqz98n8dx635131vi3pijyv3kci-praat-6.0.38/bin/praat --help got 0 exit code
ran /nix/store/ip7a4lqz98n8dx635131vi3pijyv3kci-praat-6.0.38/bin/praat --version and found version 6.0.38
found 6.0.38 with grep in /nix/store/ip7a4lqz98n8dx635131vi3pijyv3kci-praat-6.0.38
directory tree listing: https://gist.github.com/3cbb0648e4b084a658f6dd5b7c8ed3a4

No attempt on x86_64-darwin (full log)
The following builds were skipped because they don't evaluate on x86_64-darwin: praat
Partial log (click to expand)

a) For `nixos-rebuild` you can set
  { nixpkgs.config.allowBroken = true; }
in configuration.nix to override this.

b) For `nix-env`, `nix-build`, `nix-shell` or any other Nix command you can add
  { allowBroken = true; }
to ~/.config/nixpkgs/config.nix.

Success on x86_64-linux (full log)
Attempted: praat
Partial log (click to expand)
installing
glibPreFixupPhase
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/ip7a4lqz98n8dx635131vi3pijyv3kci-praat-6.0.38
shrinking /nix/store/ip7a4lqz98n8dx635131vi3pijyv3kci-praat-6.0.38/bin/praat
strip is /nix/store/fzcs0fn6bb04m82frhlb78nc03ny3w55-binutils-2.28.1/bin/strip
stripping (with command strip and flags -S) in /nix/store/ip7a4lqz98n8dx635131vi3pijyv3kci-praat-6.0.38/bin
patching script interpreter paths in /nix/store/ip7a4lqz98n8dx635131vi3pijyv3kci-praat-6.0.38
checking for references to /build in /nix/store/ip7a4lqz98n8dx635131vi3pijyv3kci-praat-6.0.38...
/nix/store/ip7a4lqz98n8dx635131vi3pijyv3kci-praat-6.0.38

Success on aarch64-linux (full log)
Attempted: praat
Partial log (click to expand)
installing
glibPreFixupPhase
post-installation fixup
shrinking RPATHs of ELF executables and libraries in /nix/store/c60kbfjw35finx07d460zkziivvjiwzy-praat-6.0.38
shrinking /nix/store/c60kbfjw35finx07d460zkziivvjiwzy-praat-6.0.38/bin/praat
strip is /nix/store/3zq400fri5dv7d30lpxlqm2v9y1iis6j-binutils-2.28.1/bin/strip
stripping (with command strip and flags -S) in /nix/store/c60kbfjw35finx07d460zkziivvjiwzy-praat-6.0.38/bin
patching script interpreter paths in /nix/store/c60kbfjw35finx07d460zkziivvjiwzy-praat-6.0.38
checking for references to /build in /nix/store/c60kbfjw35finx07d460zkziivvjiwzy-praat-6.0.38...
/nix/store/c60kbfjw35finx07d460zkziivvjiwzy-praat-6.0.38


execution view - instruction tooltip content is off

The contents of the instruction set - instruction tooltip should be the full instruction action. While the instruction label is just the instruction name. There just wasn't enough real estate to show everything.
Examples
Goto - goto(3)
Meter - meter(5)
Metadata - metadata(value=0xff00ff00ff0f, mask=ff:ff:ff:ff:00:00:00)

The tooltips are not quite write. They should look like the following ....
Label         Tooltip
Goto           goto(3)
Meter          meter(5)
Metadata     metadata(value=0x0f0af0sdsdf, mask=0xasd)
Right now the tooltips are showing a value summary.

Ok .... on reviewing this again the instruction tooltips are working, its the action list/set tooltips are not right.

fixed in master, please verify

This looks fixed.
We may want to consider whether to unify the tool tip display string format between actions and instructions.
What are your thoughts?


nginx patch breaks content-type header

I added support for HTTP3 in the Discourse project here: https://github.com/discourse/discourse_docker/compare/http3
After deploying it to production and testing using google-chrome-unstable --enable-quic --quic-version=h3-23 --origin-to-force-quic-on=example.com, the requests for my HTML routes are missing the content-type header. Is this a know bug?
Testing with curl for HTTP2 has content-type:
curl -I https://forum.muito.ninja/latest
HTTP/2 200
...
content-type: text/html; charset=utf-8
....

Testing with quiche client doesn't have the content-type:
RUST_LOG=info target/debug/examples/http3-client https://forum.muito.ninja/latest

$ curl --http3 -vso/dev/null 'https://forum.muito.ninja/images/wizard/bubbles.png'

Trying <IP_ADDRESS>:443...
Sent QUIC client Initial, ALPN: h3-23
h3 [:method: GET]
h3 [:path: /images/wizard/bubbles.png]
h3 [:scheme: https]
h3 [:authority: forum.muito.ninja]
h3 [user-agent: curl/7.67.0-DEV]
h3 [accept: /]
Using HTTP/3 Stream ID: 0 (easy handle 0x7fde6700c000)

GET /images/wizard/bubbles.png HTTP/3
Host: forum.muito.ninja
user-agent: curl/7.67.0-DEV
accept: /

< HTTP/3 200
< server: nginx
< date: Fri, 25 Oct 2019 22:48:01 GMT
< content-type: image/png
< content-length: 29108
< last-modified: Fri, 25 Oct 2019 15:55:32 GMT
< accept-ranges: bytes
<
{ [1032 bytes data]

Connection #0 to host forum.muito.ninja left intact

@junhochoi How did you get curl to support http3?

@xmapst https://github.com/curl/curl/blob/master/docs/HTTP3.md

Thank you

Hey @junhochoi I just compiled curl with quiche HTTP3 enabled and if I do two requests:
curl --http3 -vso/dev/null 'https://forum.muito.ninja/latest'

curl  -vso/dev/null 'https://forum.muito.ninja/latest'

The version with --http3 flag doesn't receive a Content-Type header back, while the one without it receives it.

@xfalcox so here is a summary:
https://forum.muito.ninja/latest with http3 - WITHOUT content-type header
https://forum.muito.ninja/latest with http2 - WITH content-type header
But content-type header is always with static objects:
https://forum.muito.ninja/images/wizard/bubbles.png with http3 - WITH content-type
https://forum.muito.ninja/images/wizard/bubbles.png with http2 - WITH content-type
Since for static objects nginx + quiche doesn't remove content-type header, so I wonder if this is something happening with Ruby on Rails engine.
Also AFAIK our patch doesn't modify/remove content-type header.

I wonder if this is something happening with Ruby on Rails engine.

How could that be since the Rails app is behind the nginx reverse proxy, and only speaks HTTP1.1 with the proxy, which then speaks HTTP1 2 or 3 with the external world.

@xfalcox could you please share debug logs from NGINX when doing the HTTP/2 and HTTP/3 requests? You need to rebuild NGINX with the --with-debug configure option, and enable debug logs on the server (i.e. error_logs ... debug in the top level of the configuration).

Just an update, I can' reproduce this in Firefox. Only in Google Chrome.

I can reproduce this by adding accept-encoding header. cURL accepts no encoding method by default since the compressed binary cannot be displayed friendly in terminal. However, web browsers usually use gzip or brotli to reduce speed up the transmission.
For the plain response body, the content-type headers is sent normally:
$ curl 'https://example.com/foo.js' --http3 -I
HTTP/3 200
server: nginx
date: Thu, 13 Feb 2020 17:23:25 GMT
content-type: application/javascript; charset=utf-8
vary: Accept-Encoding
last-modified: Mon, 10 Feb 2020 05:26:12 GMT
accept-ranges: bytes
x-content-type-options: nosniff

If cURL supports encodings such as gzip or brotli, the content-type is missing:
$ curl 'https://example.com/foo.js' --http3 -I -H 'accept-encoding: gzip, br'
HTTP/3 200
server: nginx
date: Thu, 13 Feb 2020 17:23:06 GMT
vary: Accept-Encoding
last-modified: Mon, 10 Feb 2020 05:26:12 GMT
x-content-type-options: nosniff
content-encoding: br

These encoding methods are widely used in text files including css, js and html. Without content-type the browser cannot parse the webpage correctly.

Thanks for the reproduction @hguandl !
Indeed my first encounter with this bug was due to CSS not loading.


grpc_tools_node_protoc_plugin generates invalid js

What version of gRPC and what language are you using?
libprotoc 3.3.0
(npm) grpc-tools 1.4.1

What operating system (Linux, Windows, …) and version?
MacOS 10.12.5
What runtime / compiler are you using (e.g. python version or version of gcc)
$ node -v
v8.1.3

What did you do?
If possible, provide a recipe for reproducing the error. Try being specific and include code snippets if helpful.
protoc -I/usr/local/include -I/Users/romeo/code/go -I`dirname /Users/romeo/code/go/src/github.com/TheThingsNetwork/node-app-sdk` -I/Users/romeo/code/go/src/github.com/grpc-ecosystem/grpc-gateway/third_party/googleapis -I/Users/romeo/code/go/src --grpc_out=proto --plugin=protoc-gen-grpc=/Users/romeo/code/go/src/github.com/TheThingsNetwork/node-app-sdk/node_modules/.bin/grpc_tools_node_protoc_plugin --js_out=import_style=commonjs,binary:proto /Users/romeo/code/go/src/github.com/TheThingsNetwork/ttn/api/discovery/discovery.proto

What did you expect to see?
Nodejs files with correct syntax in proto/src/github.com/TheThingsNetwork/ttn/api/discovery.
What did you see instead?
The file proto/src/github.com/TheThingsNetwork/ttn/api/discovery/discovery_grpc_pb.js contains the line:
var src_github.com_TheThingsNetwork_ttn_api_discovery_discovery_pb = require('../../../../../../src/github.com/TheThingsNetwork/ttn/api/discovery/discovery_pb.js');

Which is invalid JavaScript syntax (note the . in the variable name).
Anything else we should know about your project / environment?
The reason I'm using this nested folder structure is because I'm using proto files from a go project and I need to respect the import paths.

I think that if you have a proto file with a dependency on another file with that kind of filename, you'll see the same issue in the regular _pb.js file. In fact, I think that the referenced discovery_pb.js should have that issue. If you could confirm that and report the issue in the protobuf repository, that would be helpful. I'd prefer to follow how they solve this if relevant.


exclude "others" from relative abundance and plot

Hi @sbslee

How can i remove "others" from the relative abundance bar-plot and plot the rest of them?
I understand that bar plot will not be 100%.
If you see the attached image, the order of colors in bars (e.g. orange at the bottom) and legends (orange on top) are almost in opposite directions. How can I keep both of them in the same order?

Thanks

Hi @khemlalnirmalkar
To not show the Others in the taxa abundance bar plot - use the flag show_others=False (it is True by default). Use the same flag in the plot for the legend if you are building the figure as 2 plots (bar plot and legend).
To reverse the order of the legend - the code below worked for me as @sbslee details in this closed issue:
https://github.com/sbslee/dokdo/issues/26#issuecomment-909760867
This assumes you display the stacked bar chart with no legend and the legend only in the second plot
handles, labels = ax2.get_legend_handles_labels()
ax2.legend(handles[::-1], labels[::-1])

I had the same questions previously :-)

@mishkb, I cannot say thank you enough for your post! Not only your answer is right on the spot, it is also concise and fully backed :) Really appreciate your help.
@khemlalnirmalkar, please let me know if you have additional questions!

Hi @mishkb Thank you so much for your help,
I was able to resolve my both queries,
Cheers


Add Deep Linking (Plugin OAuth)

Feature Request: deep linking
It would be nice to have deep linking for Kap, mainly for oauth purposes, or anything else we can think of. My main use-case would be for plugin oauth. Some services like Dropbox don't accept apps if the oauth happens in a "web view". They need it to happen in the user's browser. A way to get around that without having a server running, is to set the callback url to be a deep link to Kap, which can then receive the code. After that we'll need some kind of API for Kap to forward that code to the right plugin (and add that to the plugin docs).
If not able to deep link directly (some services require a https url), we might set up a dummy Now deployment that explains that it will open the app and deep link from there (similar to how Slack does it)

Another solution for #380

We could use this API to register our URL scheme for deep-linking.

yes, I would love to build a plugin for Kap for my how to video site https://relay.how and deep links would be good. Where do I go to get started to make a plugin? I didn't see info on the front page

Here's the documentation for plugins: https://github.com/wulkano/kap/blob/master/docs/plugins.md @MadeByDouglas We should probably add this to the readme?

yeah that would be nice :)


macrostrat basemap labels are absent

Using Macrostrat as a basemap (star-Map Layers/default basemaps- Geology from Macrostrat) displays different color geologic map unit polygons but there are no labels shown for the geology polygons from Macrostrat. A label is needed or a way to connect to a link to see Macrostrat polygon data.
v1.20.1

Added with commits aa2186451c816445e30913ae841a66abc8282326 and b10d2db60d35b85d0498cdee464d9f809f2beb11


When you have ended?

Hi everybody,
i need to understand when the program ends to display the entire string and repeat the loop.
How can i read this information?
Thx.

https://goo.gl/Z8tLTz


using python <IP_ADDRESS> backspace, delete, carriage return stopped working

From<EMAIL_ADDRESS>on 2014-09-22T18:19:23Z
Spyder Version:  2.2.5
Python Version:  2.7.6
Qt Version    :  4.8.4, PyQt4 (API v2) 4.9.6 on Windows
pyflakes >=0.5.0:  0.8.1 (OK)
pep8 >=0.6      :  1.5.7 (OK)
IPython >=0.13  :  2.1.0 (OK)
rope >=0.9.2    :  0.10.2 (OK)
sphinx >=0.6.6  :  1.2.2 (OK)
matplotlib >=1.0:  1.3.1 (OK)
sympy >=0.7.0   :  None (NOK)
pylint >=0.25   :  1.2.1 (OK)
What steps will reproduce the problem?
1.Run python xy
2.Open spyder
3.Open .py file and try using backspace/delete/return
What is the expected output? What do you see instead?
Nothing occurs when those three keys are pressed
Please provide any additional information below
. Started occurring within past three days
Original issue: http://code.google.com/p/spyderlib/issues/detail?id=1980

From ccordoba12 on 2014-11-18T15:38:11Z
Try to update to 2.3.1

From ccordoba12 on 2014-11-18T15:37:53Z
No idea but it seems really weird.
Status: Invalid


Make headers show up in Header Files in VS2019

This puts the simdjson header files into the "Header Files" folder in VS 2019:

Instead of before, where they were mixed with all the headers in the whole wide world in "External Dependencies":

I know, I've been doing a lot of "dev comfort" PRs here, just trying to fix friction points instead of living with them :)

Merging.
cc @ioioioio


Docs: Add docs page for NSM overview

Current State:
The Meshery Docs has a placeholder for a description of NSM and the Meshery adapter's functionality for NSM - https://meshery.layer5.io/docs/adapters/nsm
Desired State:
Ideally, this page gives a short overview about NSM as a project, how Meshery integrates, and what functionality is provided by the integration.
NSM + Meshery Resources:

https://calcotestudios.com/talks/decks/slides-nsmcon-kubecon-na-2019-adopting-network-service-mesh-with-meshery.html
https://drive.google.com/open?id=1oH_yYELjTbuO69oUAZwaRxgc-W9rab7NEY10T39hEhw

Contributor Resources

Meshery documentation site
Meshery documentation source
Instructions for contributing to documentation

@Vineet-Sharma29, we ended up adding documentation to the NSM adapter page, but still need to list the talk, slide, and video above in the Overview page of the docs. You might toss this one in while you're in there making changes.

Would work on this

@leecalcote Overview page of docs has deck and video of NSM adapter in meshery presentation section. So do I need to add them in some other section of overview page?

@leecalcote should I take this up?

@KarenEfereyan The only outstanding item here is to list the ServiceMeshCon talk provided under the NSM + Meshery Resources: section above. Are you available to finish off this week?

@KarenEfereyan The only outstanding item here is to list the ServiceMeshCon talk provided under the NSM + Meshery Resources: section above. Are you available to finish off this week?

@leecalcote I'll try my absolute best to get it sorted this week. Sorry for the delay!!

@leecalcote i'm onto this right now. This link seems to have really small information. Is this all that is available?

@lee I found that the nsm docs page does exist at this link
What do I do about it. The contents of that file are the same as the resources you provided above. What do I do?

Hey @KarenEfereyan apologies for the delay in response, do you mind taking another go at  the issue? Here’s the correct  nsm doc which is same as the one Lee wrote.

Completed.


[DOCS]

Description
Only discord and youtube links are available I propose to add Twitter and Linkedin Hyperlinks also
Screenshots

Additional information
No response

@eddiejaoude please assign this to me as this will be my first contribution

There is no twitter for EddieHub so I will close this issue


unsupported Scan, storing driver.Value type []uint8 into type *time.Time when running migrate apply on MySQL

Running atlas migrate apply a second time on a MySQL database, I get:
Error: sql/migrate: execute: read revisions: sql: Scan error on column index 3, name "executed_at": unsupported Scan, storing driver.Value type []uint8 into type *time.Time

Fixed by adding &parseTime=1 to the connection URL.
I think a better dev-ex is for Atlas to add this flag for the user implicitly as this flag will just become part of the command (its always needed, and the system breaks without it).

closed by https://github.com/ariga/atlas/pull/995
thx @a8m


on mobile:  stuck searching, no results

The issue seems to be with particular browsers such as vanadium and chromite along with their default configurations.  When tried on brave browser, with the same mobile device, pagefind works perfectly.
So, there seems to be room for a notice for incompatibility or some browser/settings detection in order to accommodate such browsers (chrome variations)

another post about the same issue exists


Add testcases hard-follows-soft paths

This follows branch extended_key_test_vector_documentation, which still has tests passing.
With current branch, tests fail.
I put this into its own branch, in case I misunderstood something about bip32 spec and these failure cases are in fact not legitimate.  In that case, extended_key_test_vector_documentation should still be pulled, but current branch should be rejected.
In any case, the issue is that
everything that depends on paths of form  m/0'/1/2' now fails.
I think the pattern that breaks it is hardened, followed by non-hardened, followed by hardened.

parsePath fails here.

fixes #192

This is on purpose. We don't want to support hardened paths following non-hardened paths. That is why @plaprade wrote that complex type-based solution. It actually makes the type system take an active role in guaranteeing that bad use cases are not possible.

Why not allow hardened paths follow non hardened paths?
It's allowed under the original bip32 spec test vectors.
I think what you want to do is differentiate between hard and soft paths in a type safe way, so that a pub->pub derivation on a hard path gets rejected at compile time.  But that's not the same thing.
These hard-follows-soft paths I added to tests are valid hardened paths.

In the new stuff in
rework_ExtendedKeys
branch, hard keys are
data XKeyHardPath =
                      (:|/) XKeyHardIndex XKeySoftPath
                    | (:/|) XKeySoftIndex XKeyHardPath
                    | (:||) XKeyHardIndex XKeyHardPath
  deriving (Read,Show,Eq,Ord)

We then define
instance XPrvKeyEndoDerivable XKeyHardPath
instance XPrvKeyEndoDerivable XKeySoftPath
instance XPubKeyEndoDerivable XKeySoftPath

but not
instance XPubKeyEndoDerivable XKeyHardPath

Perhaps you want to forbid hard-follows-soft for certain applications. Well, all you need to do then is hide the original data declaration and replace with
data XKeyHardPath =
(:|/) XKeyHardIndex XKeySoftPath
| (:||) XKeyHardIndex XKeyHardPath
deriving (Read,Show,Eq,Ord)

Hey @tphyahoo,
First, sorry for responding this late, it has been a crazy pair of weeks. I really like the work you have done in your rework branch. I would like to have all of your proposed changes for BIP-32 squashed into a single commit rebased against the the secp256k1 branch, and then a single pull request be sent for that. We will just fast-forward the master branch then to your commit, and the pull request will be marked as merged (yes, GitHub can detect Linus-style merges).
This is all pending @plaprade approval, but I don't expect any objections from him. Your code is much better than what was there before.
Feel free to close this and related requests and then open a single one with the whole BIP-32 rework. I promise I will review it faster and get @plaprade to do so too and get it merged.
Greetings

I forgot, yes, add strictness annotations to your data types. It is good for performance not to create unnecessary thunks.

Good to hear you liked the work.
I added strictness annotations.
I am used github flow for collaborating.
https://guides.github.com/introduction/flow/
With github flow, you would get your secp256k1 branch blessed into master.  Then I would merge master, and submit my work on top of that.  Or it could be the other way (mine first into master, then secp256k1 off that), but the point is that major features are incorporated into master as the coordination point.
Would that be ok? Otherwise what is the point of my basing rework_ExtendedKeys branch off secp256k1? Is it just to make it easier for you to review? (Just trying to understand.)
How far from merge to master do you think secp256k1 branch is?

Branch secp256k1 is very close to becoming master very soon, that is why I recommend to base your work on it. It is next-in-line to become merged.
The style of merge that we have adopted from Haskoin is somewhat of a hybrid between the GitHub flow and the Linus flow. We like to keep the master branch free from merging commits, and we like to make linear (in time) commits with specific features from other branches, be them in the same repository or in clones. After discussing a pull request and deciding that will become merged, we like to squash all commits into one, and then fast-forward the master branch with that single commit. This has the effect of leaving the history of the repository quite clean, and linear.

It seems that if I do as you say it would violate
https://www.atlassian.com/git/tutorials/merging-vs-rebasing/the-golden-rule-of-rebasing/
since rework_ExtendedKeys is a public branch (albeit not a huge number of eyes on it).
I guess this is a soft rule, or are there extenuating circumstances in this case I'm not aware of?

In light of this, I will probably either
a) do nothing till secp256k1 gets into master or
b) merge (but not rebase) secp256k1 into rework_ExtendedKeys, in anticipation of making future merge to master easier, without having to deal with messiness of rebase.
Is this ok, or do you still really prefer a rebase?

superceded by #200.

reopening since #200 is no-pull.

reclosing, superceded by #202


Example from README produces an error

const { uploadState, itemError } = await client.uploadExisting(fs.createReadStream(zip));

produces a TypeScript error:
TS2345: Argument of type ReadStream is not assignable to parameter of type ReadableStream<any>

Basically,
https://github.com/fregante/chrome-webstore-upload/blob/858ffb7e88315c74efbb0b2005f4acb6a79a8f48/source/index.ts#L72
expects a ReadableStream whereas fs.createReadStream returns a ReadStream

Thanks! This seems to be a type error since both ReadStream and ReadableStream are passed in the cli:
https://github.com/fregante/chrome-webstore-upload-cli/blob/8d53b9e45c1f87ce926f5933451081a0d5172864/wrapper.js#L10-L12
With yazl using ReadableStream
https://github.com/DefinitelyTyped/DefinitelyTyped/blob/c32c8c1a24a6cbfd8b2b44b4de718c6d07eef71c/types/yazl/index.d.ts#L32
I'll send a PR

I fixed the types for now. Does it work eventually? It's entirely possible that nobody uses zip uploads this way so it has been broken for a while. Let me know.

Now I get
error TS2307: Cannot find module 'type-fest' or its corresponding type declarations.

which refers to
https://github.com/fregante/chrome-webstore-upload/blob/858ffb7e88315c74efbb0b2005f4acb6a79a8f48/source/index.ts#L5

Fixed

The TS conversion was recent (https://github.com/fregante/chrome-webstore-upload/pull/84) so the types haven't seen much testing in the real world.

Thanks for the quick fixes!

There is another case of incompatible types where uploadExisting returns a string uploadState and an object array itemError while both are treated in TypeScript as JSONs

@fregante I'd appreciate it if you could solve the type discrepancies


10731.1 DEV Update migrations.sql to add url fields in the masterIntegrationFields of auth type generic masterInts

https://github.com/Shippable/pm/issues/10731

This is complete.
Closing.


Cursor not appearing

osx_native_app/7.4.58

Lots of times when I click in the time field to change the starting or ending time, I can't see a cursor. It's there, but I can't see it.

Logs: #550914

Update from the user:

After removing Toggl, upgrading to macOS High Sierra and reinstalling
Toggl, I can confirm that the cursor bug is still there. It's intermittent.
I don't know what causes it, but I click in the time field and can't see my
cursor. I close it and open the item again and this time it's fine.

Outdated issue.


Images cannot be displayed in Voyager Admin Panel

Laravel Version: 5.6
Voyager Version: #.#.#
PHP Version:7.2.3
Database Driver & Version:

Description:
I have an issue about image that cannot be displayed in all the admin panel and avatar image is not working
I have tried change APP_URL = http://localhost:8000 and rebuild symlink with this command php artisan storage:link but doesn't work at all.
Can you guys help me???
Steps To Reproduce:

Please share the URL to your site (feel free to use example.com to anonymize it if desired), and a link to one of the broken images (the href from the page source).  This will help us identify your problem.
Also, ALL version information is required when submitting issues here.  Please update your issue description to include the Voyager and Database version info.

I'm got the same.
There was an error during the install The "public/storage" directory already exists., but the symlink  to the storage directory wasn't created.

Database: mysql
how to check the version of voyager?
i couldnt find the href that lead to the image..i only can find when i use inspect..

my admin panel does not show like image above.

Widgets are part of dummy data, so it would appear as though you did a basic install, not a dummy data install.
The head I mentioned is 100% from the markup, so you're correct that you need to use your browser dev tools.

thank you..my problem is fix :+1:


Packaging request : hdt

Project description
C++ implementation of the HDT compression format
Metadata
homepage URL: www.rdfhdt.org
source URL: https://github.com/rdfhdt/hdt-cpp
license: lgpl3
platforms: linux

Pull request awaiting to be merged:  #87634


Help can't understand documentation

Hello, I'm trying to use this plugin and I'm sure I've configured it wrongly but can't see how, first off in index.html where I need to insert the blocks I've added the following lines:
        <!-- fileblock:dev js-->
        <!-- endfileblock -->

        <!-- fileblock:dev app-->
        <!-- endfileblock  -->

And in my Gruntfile.js I've configured the plugin like so:
fileblocks: {
            dev: {
                files: [
                    {   src: 'index.html',
                        options: {
                            removeAnchors: true,
                            rebuild: true
                        },
                        blocks: {
                            'js': { src: jsFiles},
                            'app': { src: angularFiles }
                        }
                    }
                ]
            }
        },

Where jsFiles and angularFiles are lists of my depencies respectively the files of my app, which I'd like to introduce into those two blocks, (I'm not using a regex because the structure of the files is too uneven)
Then running the command grunt fileblocks the output shows a sucess but none of the script tags are inserted.

You just have the template type and block name reversed in the comment. The part directly after the colon determines the type of template that will be used. In your case you want the JavaScript (js) template. Replacement Blocks
<!-- fileblock:js blockName1 -->
<!-- endfileblock -->

<!-- fileblock:js blockName2 -->
<!-- endfileblock -->

Then your configuration would like like this:
fileblocks: {
  dev: {
    files: [{
      src: 'index.html',
      options: {},
      blocks: {
        'blockName1': { src: [...file names...] },
        'blockName2': { src: [...file names...] }
      }
    }]
  }
}

and be run with
$grunt fileblocks

or
$grunt fileblocks:dev

@rrharvey Thank you, this solved the problem and now it works perfectly, thank you very much for writing this plugin.


Enable shorthand compacting when building source maps

See https://github.com/jakubpawlowicz/clean-css/issues/414#issuecomment-71029228


The server might crash when users disconnect

This could be related to generating outbound messages. The code doesn't check if the referenced users are still online, though I'm not sure if it's possible for the player object to be removed during an update.

Fixed in 3efcd09.

Re-opening. If the player disconnects while standing in a room with an NPC, the server crashes.

Not a duplicate of #200.

Two issues reproducibly caused this, fixed in 0eaa402 and df7556d.


Update Readme to clarify that selection doesn't work in Safari on iOS

From reading through Issue #26, and from testing http://clipboardjs.com/ on an iPad running iOS 9.0, it seems that clipboard.js's current behavior in Safari on iOS is that it moves the text cursor into the copyable element (if it's an editable element, like an input or a textarea).
This runs contrary to how I interpreted the Readme, which says "Although copy/cut operations with execCommand aren't supported on Safari yet (including mobile), it gracefully degrades because Selection is supported."
I see there is some development towards getting text selection working on Safari mobile, but until that gets added into clipboard.js it would be helpful to clarify that the fallback behavior in iOS is cursor placement, not text selection.

Hey @agwells,
Thanks for pointing this out. Selection now works on iOS Safari <input> and <textarea> elements: https://github.com/zenorocha/clipboard.js/releases/tag/v1.5.5

Moved this information for Known Limitations


feat(ui-Snackbar): Optimized code

Checklist

[ ] Fix linting errors
[ ] Tests have been added / updated (or snapshots)

Change information

这优化了啥？三目的可读性并不一定比if好啊


Add tests that don't rely on google

It would be nice if we could keep the tests contained to the machine. We could use UniversalDashboard to stand up a website\webserver and then test the selenium module with it

@adamdriscoll  I was thinking that maybe we should add a test page here on GitHub and use it for testing of the module? What do you think ?
-DM

I like that idea! We could setup some GH Pages to host some HTML


BUG in exponentially decaying interaction

Describe the bug
What algorithm are you calling / what are you trying to do?
I am using SpinModel and it seems that the exponential interaction does not seem to work. For example, if I set
model_params = {
'Jx': 0,
'Jy': 0,
'Jz': 0.3,
'Jxp': 0.,
'Jyp': 0.,
'Jzp': 0.,
'hx': 0,
'hy': 0,
'hz': 0,
'bc_MPS': 'infinite',
'L': unitcell,
'conserve': conserve,
'verbose': verbose
}
M = SpinModel(model_params)
M.add_exponentially_decaying_coupling(10, 0.1, 'Sx','Sx')
M = SpinModel(model_params)
M.add_exponentially_decaying_coupling(10, 0.1, 'Sx','Sx')
dmrg_params = {
#'mixer': True,  # setting this to True helps to escape local minima
'mixer': True,
'mixer_params': {
'amplitude' : 1e-4,
'disable_after' : 40,
'verbose' : True,
},
'trunc_params': {
'chi_max': 200,
'svd_min': 1.e-10,
},
'max_sweeps': 100,
'max_E_err': 1.e-10,
'start_env': 20,
#'chi_list': {0: 30, 30: 100, 60: 200, 80: 300},
'chi_list': {0: 100},
'verbose': verbose,
}
psi.canonical_form()
info = dmrg.run(psi, M, dmrg_params)
Then, it seems that the DMRG run behaves as if the exponentially decaying term does not exist. Is there any subtlety in the use of exponentially decaying coupling? When I look through the code, it does not seem to be the case.

I believe it is worth to leave a remark -- dmrg.run() does not re-calculate H_MPO. Therefore, when we are adding further interactions, we should re-initialize the model. This solves the issue.

You're absolutely right, one needs to re-calculate H_MPO.
I've updated the code to raise a warning in case one of the CouplingMPOModel.add_* functions gets called, such that this won't be an issue any more in the future. Also, the code for re-initialization is now just calling M.init_H_from_terms().


Typescript 4 version not pushed to Package Control

would love to use labelled tuples but my editor is getting confused at the moment

Any way we could get this out?
Can't use any of the ||= operators :'(

This was blocked by #765

Hey @orta , glad this is finally moving forward :)
Is there anything left to do to have 4.0-tag pushed, so PackageControl receives the new version? Or is there any ETA defined yet?

Nope, we're probably going to release with the usual process for 4.2


[2.6] Bug 2124581: Add alert to Host Inventory card when no OpenShift images are available

When installing a cluster using host inventory, if there are no clusterImageSets available, user is not able to select and OpenShift version and gets blocked in the cluster creation wizard. This change disables the Host Inventory card and adds hint on how to add release images.
Fixes BZ2124581
Cherry-picked from 0d3a2365
Signed-off-by: Jiri Tomasek<EMAIL_ADDRESS>

/lgtm

/test lint-check-unittests-sonarcloud

/test lint-check-unittests-sonarcloud


Roll Flutter Engine from bcaaa0e125fe to 6e3fc6960a18 (1 revision)

https://github.com/flutter/engine/compare/bcaaa0e125fe...6e3fc6960a18
2023-08-14<EMAIL_ADDRESS>Roll Fuchsia Mac SDK from yfMzjtavZwtK0QM4C... to JKTVoxVrHjZjBaxG4... (flutter/engine#44673)
Also rolling transitive DEPS:
fuchsia/sdk/core/mac-amd64 from yfMzjtavZwtK to JKTVoxVrHjZj
If this roll has caused a breakage, revert this CL and stop the roller
using the controls here:
https://autoroll.skia.org/r/flutter-engine-flutter-autoroll
Please CC chinmaygarde@google.com,rmistry<EMAIL_ADDRESS>on the revert to ensure that a human
is aware of the problem.
To file a bug in Flutter: https://github.com/flutter/flutter/issues/new/choose
To report a problem with the AutoRoller itself, please file a bug:
https://bugs.chromium.org/p/skia/issues/entry?template=Autoroller+Bug
Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+doc/main/autoroll/README.md

Commit queue failed; closing this roll.


Computing likely next actions

Hi! I'm trying to compute the top k most likely next actions given a partially generated molecule. Each "next action" consists of first selecting an atom/motif via PickAtomOrMotif, then picking an attachment and bond via PickAttachment and PickBond (assuming END_GEN isn't sampled). The most likely actions can be determined by the conditional probability of observing each selection (atom/motif, then attachment, then bond) given the initial scaffold. How would I go about doing this with the current API?
Thanks for your help!

You could do something like the below to get a sequence of decoding steps:
from molecule_generation import load_model_from_directory
from molecule_generation.utils.moler_decoding_utils import *

with load_model_from_directory("./chkpt_repo") as model:
    [embedding] = model.encode(["O=CNc1ccccc1"])
    [(smiles, steps)] = model.decode([embedding], include_generation_steps=True)

    print(f"Decoded SMILES: {smiles}\n")

    for idx, step in enumerate(steps):
        print(f"Step {idx}")

        if isinstance(step, MoleculeGenerationAtomChoiceInfo):
            print(f"Atom choice step with options:")
            for idx, prob in enumerate(step.type_idx_to_prob):
                if prob > 0.02:
                    print(f">> node type idx {idx}; prob {prob}")
        elif isinstance(step, MoleculeGenerationEdgeChoiceInfo):
            print(f"Edge choice step with options:")
            for option in step.candidate_edge_infos:
                print(f">> to node {option.target_node_idx}; logprob {option.logprob}")
        elif isinstance(step, MoleculeGenerationAttachmentPointChoiceInfo):
            print(f"Attachment point choice step with probs {step.candidate_idx_to_prob}")
        else:
            assert False

        print("")

Using the checkpoint from README.md, this prints
Decoded SMILES: O=CNC1=CC=CC=C1

Step 0
Atom choice step with options:
>> node type idx 37; prob 0.44812485575675964
>> node type idx 39; prob 0.5475685596466064

Step 1
Atom choice step with options:
>> node type idx 37; prob 0.9999274015426636

Step 2
Attachment point choice step with probs [1.]

Step 3
Edge choice step with options:
>> to node 0; logprob -0.5086194276809692
>> to node 1; logprob -0.9196093082427979

Step 4
Atom choice step with options:
>> node type idx 37; prob 0.2261890470981598
>> node type idx 165; prob 0.7720987200737

We can see that in the first step the model considered atom/motif type IDs 37 and 39, with the latter being slightly preferred. Knowing what molecule we ended up with, it's easy to guess what these IDs correspond to, but unfortunately I think the mapping is not easily available in the high-level interface. We can use one of the lower-level functions to get it:
from molecule_generation.utils.model_utils import load_vae_model_and_dataset

dataset, _ = load_vae_model_and_dataset("./chkpt_repo/GNN_Edge_MLP_MoLeR__2022-02-24_07-16-23_best.pkl")

for type_id in [37, 39]:
    print(f"Node type ID {type_id} = {dataset._node_type_index_to_string[type_id + 1]}")

which (unsurprisingly) gives us:
Node type ID 37 = C1=CC=CC=C1
Node type ID 39 = NC=O

Note the +1 in the code above; this is due to the fact that the first node type is technically an UNK which is later stripped away, hence the shift.
Coming back to our sequence of steps, we know that the model added 39 (NC=O) in the first step, and indeed in the second step it chooses to add the other motif (37 i.e. c1ccccc1). It then chooses an attachment point (due to symmetry there is only one choice, so nothing to do here), adds a bond between the motifs, and finally chooses END_GEN. The bond/attachment steps contain atom IDs, which one would have to map back looking at the underlying rdkit molecules, but it hopefully shouldn't be too hard to do that.
In a scaffold-based scenario decode would need the scaffold as an argument, and then the sequence of steps would start from the scaffold instead of starting from scratch. Other than that things should work in the same way.
Finally, you can also take a look at our visualization CLI and the code that underlies it. It has to do essentially the same analysis to understand and plot the steps taken during decoding. However, note that this code uses the lower-level utils instead of the higher-level wrapper, partially due to the fact that it predates the latter.
Hope this helps, and let me know if you have any further questions.

Thanks for your detailed explanation, that's really helpful. Is there any way to probe the decoder to allow for selection of an atom/motif/bond/etc. that doesn't necessarily have the highest probability? In your code above, I'm wondering if it's possible, for example, to see how Steps 1-4 would have played out should the model have selected node type idx 37 instead of node type idx 39 in Step 0. I'm assuming that this would require a more step-by-step decoding process, is there support for that?
Thanks again for the help!

Is there any way to probe the decoder to allow for selection of an atom/motif/bond/etc. that doesn't necessarily have the highest probability?

You'd need to play around with some internals to achieve this; what to change exactly would depend on what level of control you'd like to have. If you just want to obtain several likely sequences of actions, then you can pass a beam_size argument to the model wrapper, which will tell the decoder to explore a beam of sequences of a certain size. However, it would still return the most likely beam, but it's easy to extract what the beams were: if you look at _decode_from_latents in moler_inference_server.py, at some point it does
best_decoder_state = max(per_sampled_latent_results[1], key=lambda s: s.logprob)

which is when we limit ourselves to only the best beam; you could simply print out the sequences of steps in the other beams if that's what you want. However, note that the different beams are not guaranteed to give different final molecules, as there may be many ways to build up the same molecule.
If you want more control over which sequences of steps are explored then you might need to hack the decode function itself in moler_decoder.py.


create a script & slide set for the final presentation

feel free to add any ideas or scripts here (we can create a google drive folder or slack channel for the media)

pipeline:
pdf -> parsed text and metadata -> output -> structured output

also show the LaTex package in the end

It would be great to start with the demo/pitch as soon as possible as this is what is judged in the end!
The slide deck (or let’s call it scrap slide deck for ideas) is on the Google drive

[ ] team acknowledgement slide (everyone)
[ ] technical overview slide (Magda)
[ ] introduction slide (perhaps Dieter), case study zeolites


From afar, inviting

I am an Android developer from China, now see your project in GitHub, and now you want to project, adding Chinese translation comment commentary in Chinese community to share learning, hoping to get your approval

Thanks for your interest. I thought I had replied already.
If you want to translate the samples, or to translate the Readme into Chinese, sure.Thanks!


feat: better RAG

Is your feature request related to a problem? Please describe.
The document-based RAG feature shows a glimpse of how useful it can be. Unfortunately for most practical applications, data is not sitting in a single self contained file:

Source code repos span multiple files
Cloud services like Jira, GitHub, Wordpress, Slack, etc. have REST APIs/webhooks and exporting data to a flat file is clunky and not always possible
Structured data sources like MySQL or MongoDB databases

Describe the solution you'd like

Generalize the Documents tab to Data Sources
Keep the Document option as a Data Source
Allow a Folder to be a Data Source, and recursively include all its containing files
Allow for an API connector to connect common cloud tools like Slack, Jira, GitHub, Notion
Allow for database connectors like MySQL, MongoDB so folks can enter a connection string and access the data
Allow for generic REST API so folks can connect their own services

Describe alternatives you've considered

Exporting from the sources to a flat file, then uploading the flat file

Additional context

Happy to help if the team decides to do this
Better to do it one step at a time, since each new Data Source adds incremental value to the tool

We'd love to this see feature! Feel free to make a draft PR, I'm sure a lot of people in the community would be interested in helping as well.

@tjbck Do you have any pointers in terms of docs/code I could look at to see how the RAG is implemented? Happy to take a look

add support for mysql and other db is a good idea

Please allow reporting by or across sources. By would permit iteration through a set of sources.

We'd love to incorporate all the amazing ideas to our webui, but the current RAG implementation requires major overhaul to accommodate all requested features. I believe I should have more time in April to actually start taking a look at this, let's make our webui to feature the best RAG implementation to ever exist and beyond! 🚀
@zachrattner Feel free to join our discord! All the contributors are extremely active on our server, and I would love to establish high bandwidth communication before we start working on this feature. As for the pointers for the current implementation, I'd suggest you take a look at these files:

https://github.com/open-webui/open-webui/tree/main/backend/apps/rag
https://github.com/open-webui/open-webui/blob/86aa2ca6cb14df2399f8297726a3bd978ab3d541/backend/main.py#L76

I will start working on this, probably tomorrow

Relevant: https://github.com/open-webui/open-webui/pull/1693

As part of this proposal to improve RAG support, please consider integrating injection of specific documents into context as suggested in #1719.
The current approach based on semantic and hybrid search methods does not cover all RAG use cases. Especially, the current method does not work properly according to my tests when the goal is not to retrieve or ask about specific information semantically related to the query, but to ask general questions about the document or to generate new information given all the information it contains.
In addition, we must consider what will happen when the document is larger than the available context of the selected model. Chunking (preferably using smart splitting techniques such as [1]) and summarization could be an option, or maybe injecting only the N last/first tokens into the available context. Letting the user select relevant passages or sections or transparently selecting those that are relevant for the given query using an LLM and some heuristics could also be considered.
[1] https://github.com/nlmatics/llmsherpa

This project has as great RAG for youtube transcripts however the RAG implementation doesn't do a good job summarizing the transcripts. I would like to propose an option (via toggle) to allow summarization through the use of in-context memory. This would import the transcript into the context memory directly instead of a vector store which would then be included with the prompt on how to summarize the text

We're at a stage where we need to start prioritising this. PR/discussion welcome everyone!

An alternative could be something like this: https://microsoft.github.io/graphrag/

GraphRag would be an important addition to Open WebUI due to the many benefits GraphRAG has over pure embeddings-based  RAG such as better contextual understanding, more accurate retrieval, less hallucinations and better understanding and retrieval of complex, connected information and the relationships between entities relevant for a query - in addition to the complementary features and benefits form using both types of RAG together.
Aside from Microsoft Graph Rag there are two more open GraphRAG implementations to consider:
Neo4J s implementation has the benefit of the graph being browse able and editable with the visual graph editor bloom https://neo4j.com/developer-blog/graphrag-llm-knowledge-graph-builder/
LamaIndex also has its own recently improved GraphRAG implementation https://neo4j.com/developer-blog/property-graph-index-llamaindex/
Note the code that offers entity disambiguation and deduplication in the linked LLamaIndex examle. This is one key advantage over standard RAG. Just imagine this would be part of Open WebUI, it would be extremely useful especially when it comes to either larger text files or many shorter text files mentioning the same entities, be they concepts, organizations, people or processes.
Please make GraphRAG a part of Open WebUIs RAg pipeline.

I use ragflow ( https://github.com/infiniflow/ragflow) for rag, which gives good results. It is accessible via API and Docker. It offers the advantage of creating 'datarooms' identifiable by their collection name, which allows it to cross-reference information from one collection to another...

Edit: Ok it seems that #3687 is about to take care of this and much more with an upcoming R2R integration in Open WebUI. R2R includes a Neo4j GraphRAG implementation https://r2r-docs.sciphi.ai/cookbooks/knowledge-graph

Is R2R integration actually happening, I couldn't find any mention in the discussion other than them telling him he could write a custom function.

Edit: Ok it seems that #3687 is about to take care of this and much more with an upcoming R2R integration in Open WebUI. R2R includes a Neo4j GraphRAG implementation https://r2r-docs.sciphi.ai/cookbooks/knowledge-graph

Is R2R integration actually happening, I couldn't find any mention in the discussion other than them telling him he could write a custom function.

God question! This seems to have stalled a bit, but thanks to your question he now responded that the documentation was a bit unclear to him https://github.com/open-webui/open-webui/discussions/3687#discussioncomment-10579619  I hope they assist because this addition would really enhance Open WebUI usecases

In fact, for the official app or web page, such as openai's PLUS members, they should take a relatively expensive method of parsing documents. That is, passing all the content of the document into context anyway, and then adding a layer of RAG search to increase the model's attention and optimize the response, which returns RAG to its original purpose: to enhance context search rather than to replace the entire document. It's much better to have a conversation on openai's PLUS membership page and upload a file. For example, if we upload a short story with the contents deleted and only the text, Let AI tell us the titles of each chapter in order, openai can accurately and in order tell us all the chapter titles, while the current third-party RAG replaces the document directly with the retrieval fragment, resulting in the loss of some chapters. Or the order is completely messed up, which means that OpenAI actually owns the entire document content, and when we ask questions about specified content, OpenAI's attention is surprisingly good, and it can locate exactly where we ask the question in the document, which indicates that it also introduces RAG. I think this is the ultimate reason why there is always a lack of content or the order is messed up compared to the AI answer uploaded by the third-party RAG and the official website. Of course, the cost issue is something we're thinking about, but it should also be selective, and I believe that prices generally decline significantly in the big models, Although the context window is getting bigger and bigger, there are still many people who hope to optimize their performance in document parsing with AI through the same high-cost approach as the official. Most importantly, it is much more reasonable to use RAG only as an enhanced retrieval rather than a direct replacement for the entire document, unless the cost is very pressing. For a scenario where only a few hundred documents are imported into RAG, I think it makes more sense for a knowledge base of probably hundreds of documents to be imported into just a RAG retrieval segment, and we don't have to be so swamped with individual or small amounts of documents. In addition, I hope that when uploading a document, including the file's meta information (file name, extension name, file size), the specific application scenarios we can look at in another issue.  https://github.com/lobehub/lobe-chat/issues/4102

Related - https://github.com/open-webui/open-webui/issues/6133

Support for external Vector DB would be better https://github.com/open-webui/open-webui/discussions/938

Picking up an old notion
I'm not sure how much should be asked of webUI

RAG returns are limited...normally 3-4. This is great if you want one answer across all documents. Many RAG use cases, such as versions of entity recognition, require all valid responses. This requires parsing of resources into chunks that are meaningful units to ask for the presence of the entity (e.g. sentences). This is quite easily done with something like grobid to parse documents and python to sequentially feed them to a LLM. This may not be reasonable to ask of an accessible webUI
2.
context size and missing in the middle seem to have a sweet inverse correlation problem. The bigger the context, the greater the probability of missing in the middle. This, again, requires some sort of carefully thought strategy (perhaps segmentation like in 1, perhaps COT, perhaps passing through a formalisation strategy like the recent stuff on prolog). In any case, these are not the sorts of things I would ask of an idiot friendly webUI
-p

From: muhanstudio @.>
Sent: Thursday, October 10, 2024 02:38
To: open-webui/open-webui @.>
Cc: Tamas, Peter @.>; Comment @.>
Subject: Re: [open-webui/open-webui] feat: better RAG (Issue #1293)
In fact, for the official app or web page, such as openai's PLUS members, they should take a relatively expensive method of parsing documents. That is, passing all the content of the document into context anyway, and then adding a layer of RAG search to increase the model's attention and optimize the response, which returns RAG to its original purpose: to enhance context search rather than to replace the entire document. It's much better to have a conversation on openai's PLUS membership page and upload a file. For example, if we upload a short story with the contents deleted and only the text, Let AI tell us the titles of each chapter in order, openai can accurately and in order tell us all the chapter titles, while the current third-party RAG replaces the document directly with the retrieval fragment, resulting in the loss of some chapters. Or the order is completely messed up, which means that OpenAI actually owns the entire document content, and when we ask questions about specified content, OpenAI's attention is surprisingly good, and it can locate exactly where we ask the question in the document, which indicates that it also introduces RAG. I think this is the ultimate reason why there is always a lack of content or the order is messed up compared to the AI answer uploaded by the third-party RAG and the official website. Of course, the cost issue is something we're thinking about, but it should also be selective, and I believe that prices generally decline significantly in the big models, Although the context window is getting bigger and bigger, there are still many people who hope to optimize their performance in document parsing with AI through the same high-cost approach as the official. Most importantly, it is much more reasonable to use RAG only as an enhanced retrieval rather than a direct replacement for the entire document, unless the cost is very pressing. For a scenario where only a few hundred documents are imported into RAG, I think it makes more sense for a knowledge base of probably hundreds of documents to be imported into just a RAG retrieval segment, and we don't have to be so swamped with individual or small amounts of documents. In addition, I hope that when uploading a document, including the file's meta information (file name, extension name, file size), the specific application scenarios we can look at in another issue. lobehub/lobe-chat#4102https://github.com/lobehub/lobe-chat/issues/4102
—
Reply to this email directly, view it on GitHubhttps://github.com/open-webui/open-webui/issues/1293#issuecomment-2403673361, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AYKOUNMZVEYQLSJJ23ZOZI3Z2XD6XAVCNFSM6AAAAABFGZLQXWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIMBTGY3TGMZWGE.
You are receiving this because you commented.Message ID: @.***>

Hi, i have seen a strange behaviour using rag and pipelines
The workflow is as follows:
Documents are loaded and fed into OpenWebUI.
OpenWebUI encodes the documents, splits them into chunks, and stores them.
The /inlet endpoint on the pipeline is called.
OpenWebUI then performs the RAG operation.
The pipeline’s /pipe endpoint is triggered, displaying the response on OpenWebUI.
Finally, the client calls the /outlet endpoint
Question on Implementation:
Why do the /inlet, /pipe, and /outlet endpoints each have different request bodies?
Why the process is openwebuiClient->inlet->openwebuiClient->pipe->openwebuiClient->outlet->openwebuiClient?
If I develop RAG on my custom pipeline in pipe logic tha RAG of openwebui is still executed.

It would appear that even the current implementation of RAG in openwebui is broken for the most part. Here are the issues I've encountered:

Large documents are ignored completely. I upload a large document, nothing happens.
I upload a set of several document, nothing happens either.
Even though I appear to be able to upload different data types, querying PDFs absolutely does not work. I don't know if it's the LLM or openwebui's fault though.

There is zero diagnosticity with RAG uploads. I upload a file and just have to wait for it to show up. Sometimes it does, sometimes it doesn't.


🔨 fix(ToolCall): Check output string type before performing .toLowerCase()

Pull Request Template
⚠ Before Submitting a PR, Please Review:

Please ensure that you have thoroughly read and understood the Contributing Docs before submitting your Pull Request.

⚠ Documentation Updates Notice:

Kindly note that documentation updates are managed in this repository: librechat.ai

Summary
Fixes issue #4303: This PR adds a type check for output before calling .toLowerCase() to ensure it is a string. This prevents potential runtime errors when output is undefined or not a string.
Change Type
Please delete any irrelevant options.

[x] Bug fix (non-breaking change which fixes an issue)

Testing
Create an assistant action, and let the assistant call it. It used to throw errors and break the UI, now it works perfectly.
Test Configuration:
Checklist
Please delete any irrelevant options.

[x] My code adheres to this project's style guidelines
[x] I have performed a self-review of my own code
[x] My changes do not introduce new warnings

Are you sure that your custom endpoint is even being used? looking at the code, it should actually fail, and maybe another configured endpoint is being used

This fix is only tested on Assistants and not agents

This fix is only tested on Assistants and not agents. Also, I created a fresh assistant and added only 1 endpoint for the sake of test. My endpoint is a local one so I added logging to make sure it is being accessed and yes, it is being accessed and the function is running to the end.

Thanks for letting me know and for your contribution!


IAM Role for Driver and Executor Pods?

Hi all,
I wanted to check if it is possible to define an AWS IAM role that should be attached to driver and worker pods in Spark application YAML file. As per my understanding, currently these pods inherit the role from EKS worker nodes, but I would like to specify my own custom role in the YAML file. Can somebody please suggest on the possibility ?
Thanks in advance :)

I think you are looking for IRSA https://docs.aws.amazon.com/eks/latest/userguide/iam-roles-for-service-accounts.html? In your SparkApplication Pod spec you can then define the used ServiceAccounts for the driver und executor.

Hi @mrkwtz .
I followed the steps in this document and created a service account with name "svc-spark-account". But still getting the same error on using that service account in SparkApplication.
Below is what my YAML file looks like for reference:
apiVersion: "sparkoperator.k8s.io/v1beta2" kind: SparkApplication metadata:   name: test-pyspark-app   namespace: dev spec:   type: Python   pythonVersion: "3"   mode: cluster   image: "coqueirotree/spark-py"   imagePullPolicy: Always   mainApplicationFile: s3a://my-bucket/TestFile.py   sparkVersion: "3.0.0"   sparkConf:     "spark.kubernetes.driverEnv.serviceAccount": "svc-spark-account"     "spark.kubernetes.driverEnv.serviceAccountName": "svc-spark-account"     "spark.kubernetes.authenticate.driver.serviceAccount": "svc-spark-account"     "spark.kubernetes.authenticate.driver.serviceAccountName": "svc-spark-account"     "spark.kubernetes.executorEnv.serviceAccount": "svc-spark-account"     "spark.kubernetes.executorEnv.serviceAccountName": "svc-spark-account"     "spark.kubernetes.authenticate.executor.serviceAccount": "svc-spark-account"     "spark.kubernetes.authenticate.executor.serviceAccountName": "svc-spark-account"   driver:     cores: 1     coreLimit: "1200m"     memory: "512m"     labels:       version: 3.0.0     serviceAccount: svc-spark-account     serviceAccountName: svc-spark-account   executor:     cores: 1     instances: 1     memory: "512m"     labels:       version: 3.0.0     serviceAccount: svc-spark-account     serviceAccountName: svc-spark-account
Can you please advise if I should do something differently in this case?
Thanks.

You can't use IRSA for the S3 authentication with spark itself. That's because spark uses the hadoop-aws[1] library to implement the S3 functionality and this library uses an old version of the aws-sdk[2] which doesn't support Webtoken / OIDC / IRSA. For now you are limited to access / secret key or InstanceProfile/Role authentication.
[1] https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-aws/3.3.0
[2] https://docs.aws.amazon.com/eks/latest/userguide/iam-roles-for-service-accounts-minimum-sdk.html

That's surprising. I saw spark documentation saying that it is supported at this link: https://spark.apache.org/docs/latest/running-on-kubernetes.html#rbac
Looks like the GCR image needs some updates to support this ?

Thats just that your Spark Application / Job can assume special rights in k8s itself, but is has nothing to do with AWS IAM - unfortunately.

You can take a look at https://github.com/bbenzikry/spark-irsa for reference Dockerfiles for spark and pyspark.
Examples are for 2.4.6 but a similar approach should be fine for other spark versions.
hadoopConf:
  "fs.s3a.aws.credentials.provider": "com.amazonaws.auth.WebIdentityTokenCredentialsProvider"

If you encounter an error such as
org.apache.hadoop.fs.s3a.auth.NoAuthWithAWSException: No AWS Credentials provided by WebIdentityTokenCredentialsProvider : com.amazonaws.SdkClientException: Unable to locate specified web identity token file:

Make sure that you have securityContext set as follows ( more on that @ https://github.com/kubernetes/kubernetes/issues/82573 )
securityContext:
  fsGroup: 65534

Tested on EKS 1.16.8 + 1.17

@bbenzikry - I tried this approach but am still getting the below error even after specifying the security context parameter:
org.apache.hadoop.fs.s3a.auth.NoAuthWithAWSException: No AWS Credentials provided by WebIdentityTokenCredentialsProvider : com.amazonaws.SdkClientException: Unable to locate specified web identity token file:
I specified the security context at all below levels:

under "spec" section i.e. same level as "hadoopConf" and "sparkConf"
under "spec->driver" i.e. same level as "spec->driver->labels"

Can you please suggest if I should be defining security context at some other level ?

Hi @batCoder95 , it should be set like this:
  driver:
    .....
    labels:
        .....
    serviceAccount: spark
    securityContext:
      fsGroup: 65534

I saw you replied in #885, if you want to go around this for the meantime, you can do add ( again, probably bad practice ;] )
---
apiVersion: v1
kind: ServiceAccount
metadata:
 name: default
 namespace: SPARK_JOB_NAMESPACE
 annotations:
   eks.amazonaws.com/role-arn: "arn:aws:iam::ACCOUNT_ID:role/executor-role"

Hi @bbenzikry - Yes I think this approach would be feasible, but I agree that this is not a good practice.
On another note, I observed that this limitation is only from GCP operator. As Spark official doc, we are able to pass custom service account. I haven't tried it yet, but it does seem to be available for use. Or am I misreading into it ?

@batCoder95 Sorry for not replying sooner.
From what I read, the docs don't reference the executor pod default service account constraint that is handled in the spark PR that should be added in 3.1.
So right now, executors( whether submitted via the operator or not ) will still have that problem.
From browsing the PR code, it seems that without any configuration the executor pods will default to the driver's service account ( which seems like a good enough solution until #885 has an implementation )
In order to use it you'll have to either wait for 3.1 or build spark from source.

@bbenzikry - No issues :)
Yeah I guess currently I will have to go with building spark image from scratch only or wait for 3.1 release. Will check it out.
Thank you so much for all your help on this. It has been really really helpful :)
Will close this issue. Stay safe :)

Hi @bbenzikry ,
It turns out I was finally able make this work using the Spark IRSA Dockerfile that you have provided :)
Just wanted to say thanks a lot for such a bug help :)
Cheers!

@batCoder95 Thanks, happy to help - I'm a little busy at work, but I'm going to release a small project soon that shows how we work with both IRSA and the AWS Glue catalog using the operator on Spark 3

Hi @bbenzikry ,
It turns out I was finally able make this work using the Spark IRSA Dockerfile that you have provided :)
Just wanted to say thanks a lot for such a big help :)
Cheers!

Hi just wonder which spark version you were tested, spark2.4.6 or spark3.1?  if spark3.1, you build yourself or download from official ?

Hi @zhaohc10, you can see an example for use with spark 3 ( 3.0.1 ) here: https://github.com/bbenzikry/spark-eks
While we don't use 3.1, you can find an example for a 3.0.1 custom build with glue support in the following repo: https://github.com/bbenzikry/spark-glue
Should be very similar for 3.1


fix get resource - admin token gets 404

admin cannot access or list user resources

same for delete

fixed


Add node-sass dependencies

@borisyankov that npm start does not work in windows at the moment, are you developing on windows machine? or just testing ?

I do develop, Windows is my main machine. Have a look at it, I will too :P


Added polygon buffering to VectorToRasterTask

Implemented polygon buffering before rasterization, mainly for eroding polygon before rasterizing them by using negative buffer arguments.

Codecov Report

Merging #130 into develop will increase coverage by 0.02%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##           develop    #130      +/-   ##
==========================================
+ Coverage    76.48%   76.5%   +0.02%
==========================================
  Files           40      40
  Lines         4069    4073       +4
==========================================
+ Hits          3112    3116       +4
  Misses         957     957

Impacted Files
Coverage Δ

geometry/eolearn/geometry/transformations.py
91.41% <100%> (+0.21%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3f87d45...db97a97. Read the comment docs.


Add a header

Use the first header on this example page: https://getbootstrap.com/docs/5.3/examples/headers/
Have sections for home, resume, and interviewing tips.

Done with commit: https://github.com/drlholloway/drlholloway.github.io/commit/198e1232145deeff0bdbd9459fbc0a3861e780a1


[docs] Add rjsf-material-ui to the TextField complementary projects

[x] I have followed (at least) the PR section of the contributing guide.

As react-jsonschema-form supports themes since v1.6.0, it was time to create a Material UI theme.
Check the theme out at https://github.com/cybertec-postgresql/rjsf-material-ui!
Here is the live playground: https://cybertec-postgresql.github.io/rjsf-material-ui/
This change adds our react-jsonschema-form material-ui theme implementation to the list of complementary projects in the TextField example documentation page.

@LorenzHenk Thanks for sharing. We are happy to see this new form library. However, we promote existing, well-established solutions in the documentation. Maybe you could give it a try in the future if the project gets traction?
On a broader topic, I think that Material-UI should double down on better supporting Formik: #15585.

Alright, thanks for your time!

pity, I think integration with jsonschema/rjsf is an interesting theme for MUI. There are several libraries attempting to do so, but @LorenzHenk 's is the only one that tries using TypeScript, as much as incomplete the mapping may be and the traction still low.
I understand Formik is a great project, but I really like the (meta) data-driven, declarative approach of rjsf. I hope to hear some news on this front in the future.


Sandbox

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcdef

create release notes for abcdef

create release notes for abcdefg

create release notes for abcdefg

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for fghij

create release notes for fghij

create release notes for fghijk

create release notes for fghijk

create release notes for fghijkrr

create release notes for fghijkrr

create release notes for ab

create release notes for ab

create release notes for cd

create release notes for cd

create release notes for abc

create release notes for abc

create release notes for abc2

create release notes for abc2

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for buddybuddy

create release notes for buddybuddy

create release notes for buddybuddy

create release notes for buddybuddy

create release notes for buddybuddy2

create release notes for buddybuddy2

create release notes for buddybuddy3

create release notes for buddybuddy3

create release notes for buddybuddy4

create release notes for buddybuddy4

create release notes for buddybuddy5

create release notes for buddybuddy5

create release notes for buddybuddy6

create release notes for buddybuddy6

create release notes for buddybuddy7

create release notes for buddybuddy7

create release notes for buddybuddy8

create release notes for buddybuddy8

create release notes for buddybuddy9

create release notes for buddybuddy9

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde

create release notes for abcde


Google Pay or Phone Pay or Paytm Pay API Checkout

I have a customer who have google pay or phone pay or paytm  account they give the details of phone number.
Now I need to withdraw the amount from there google pay or phone pay or paytm  account without using payment_link.
I could not find it in API Documentation . I want to know if this possible.
Is it possible with Razor pay API payment gateway integration.
I found this link useful But it is using JavaScript. can I do it in using  Razor PAY PHP SDK
Google Pay Checkout using Razor Pay
Same way is it possible Phone Pay and Paytm Pay using Razor Pay

@blpraveen from server-side (Razorpay sdk) you can use this api or you can also check this documentation if want to payment through card , netbanking or UPI . but you can't use checkout without javascript.
Closing this issue for now let us know if you need help.


5 avril 2016

Some easy item for learning the current code, more info tomorrow
Todo in the beginning of the course, or before:

Download https://sourceforge.net/projects/boost/files/boost-binaries/1.60.0/boost_1_60_0-msvc-14.0-32.exe/download (Only on Windows) and install it, keep default folder (C:\local\boost_1_60_0)

Todo in class:

Add a cache functionality for ResourceManager
Add a config object or struct, loaded from "conf.json" at startup, and accessible with static getter
Better keyboard event, by looking for key press and key release

Todo (Admin):

Add item to "journal de travail"

[ ] Add a cache functionality for ResourceManager


xVhdFile - with network share not working

I tried to use xVhdFile to copy some installation media onto the vhdx file.
There is no error message but the files are missing
The source is a network share.
My configuration:
MSFT_xFileDirectory {
SourcePath = $Node.InstallationMediaFolder
DestinationPath = "InstallationMedia"
Ensure = "Present"
Recurse  = $true
Type = "Directory"
Force = $true
}
My Node Data:
@{
AllNodes = @(
@{
NodeName = '*'
InstallationMediaFolder = "\networksource\share\AutomatedInstallation\InstallationMedia"
}
)
}

@dominikheeb When copying files over the network you will need the credentials to authenticaate. The LCM runs under the LOCALSYSTEM context and won't have access to the network share - unless you've granted the computer account access.
Can you try granting the computer's account access to the network share? If you're using WMF 5.0 (or later) you can also try using the PSDSCRunAsCredential built-in parameter.

Thank you for the answer.
The issue was due to a network problem and is solved now.
The Permission i had already added.


Missing from Homebrew?

I can't find any record of Navi being a Homebrew package.
~/P/A brew update
Already up-to-date.

~/P/A/ brew install navi
Error: No available formula with the name "navi"

I search https://brew.sh/ for good measure.
The documentation doesn't say anything about a special formula, and I don't see a formula definition in the repo at first glance.
Am I missing something?

@Boztown brew install denisidoro/tools/navi will be fine

Oops, I had removed the install instructions without realizing. I've just added them back now.
In addition, I have a PR on homebrew to add the navi formula. It'll hopefully be merged later this week.

This is a link to the mentioned PR
https://github.com/Homebrew/homebrew-core/pull/44514
The formula was finally not added in that PR, perhaps will be in the future it will be


[issue-2] Resurrect Sprightly

I've addressed all the comments in the last two commits I pushed
I've removed error classes and just used the generic Error class. And made it so that we don't need to identify the error anymore, we can just rethrow it. This was possible due to the fact that we passed the entry point to the parse function
I exported both sprightly and sprightlyAsync
I've handled all the cases where we have nested paths, it is working correctly now.
There's nothing being added to my pnpm.lock file when I run pnpm install
I'm facing no issues with Husky

Thank you for the great review معلم 🥰


Add colspan/rowspan support to Table

Blocking https://github.com/jgm/pandoc/pull/3508

Obsoleted by #65


unintended logic, when i log in, my cart updates to what the latest cart was instead of going back to the cart i had for that logged in user

redid the cart logic and this is no longer an issue, when a user is logged in the cart system checks if there is already a cart before logging in and responds accordingly now

redid the cart logic and this is no longer an issue, when a user is logged in the cart system checks if there is already a cart before logging in and responds accordingly now


Roll Plugins from c254963c1e2b to 6716d75c08cb (1 revision)

https://github.com/flutter/plugins/compare/c254963c1e2b...6716d75c08cb
2021-10-13<EMAIL_ADDRESS>Update integration_test README  (flutter/plugins#3824)
If this roll has caused a breakage, revert this CL and stop the roller
using the controls here:
https://autoroll.skia.org/r/flutter-plugins-flutter-autoroll
Please CC<EMAIL_ADDRESS>on the revert to ensure that a human
is aware of the problem.
To file a bug in Flutter: https://github.com/flutter/flutter/issues/new/choose
To report a problem with the AutoRoller itself, please file a bug:
https://bugs.chromium.org/p/skia/issues/entry?template=Autoroller+Bug
Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+doc/main/autoroll/README.md

Commit queue failed; closing this roll.


Add documentcloud_pages to HeaderCd.rec_type (in common.py)

Overview
Add documentcloud_pages to the rec_type field on HeaderCd the database model.
Basically, we think rec_type should be defined as a "choice field" (in Django parlance), which just means it's a field with a defined list of valid values and an intelligible definition for each value.
Our goal is for every potential choice field to include references to locations in the official documentation where the field's valid values and their meanings are described AND to have those choices included in the field's definition.
And we need your help!
What to do
Step 1: Claim this ticket by adding yourself as an Assignee (to the right)
Step 2: Find where in the official documentation rec_type's list of valid values is defined.
The best place to look first is in the .CAL layout documents: .CAL Format version 2.01 and .CAL Format version 1.05.02. These are documents that describe the layout of the .CAL file format, which is the required electronic format of any filings ingested by the CAL-ACCESS system (more on that here if you are interested).
You can start by opening the document and just searching for "rec_type". For example, if you were assigned to tackle the stmt_type field on the CvrCampaignDisclosureCd model, you would be looking for something like this::

But note that the same column might appear on multiple tables, and the list of valid values may vary depending on the table. We want to be sure to find the list of valid values for the rec_type on the HeaderCd model.
Another good place to look is in the MapCalFormat2Fields document, which describes how .CAL format fields are mapped to CAL-ACCESS database table columns. Note the Valid_V column on the far right.
Step 3: Copy the DocumentCloud ID and the page number(s) where rec_type's list of valid values is defined.
The DocumentCloud ID can be found the in the URL that points to the document. For example, the url to the .CAL Format version 2.01 doc is http://www.documentcloud.org/documents/2712034-Cal-Format-201.html#document/p1, and the id is 2712034-Cal-Format-201.
And the start page we want to grab is the DocumentCloud page number, not the page number printed on the .PDF. If the list of valid values spans multiple pages, then grab the page where the list ends as well.
Step 4: Find where rec_type is defined in common.py in the /calaccess_raw/models/common.py file underneath the HeaderCd class.
Since the model files are rather long, take care to be sure you find the where rec_type is defined for the HeaderCd model. It should look something like this:
    class HeaderCd(CalAccessBaseModel):
        # ...
        # several lines of code later...
        # ...
        rec_type = fields.CharField(
            max_length=11,
            db_column='REC_TYPE',
            blank=False,
            verbose_name='record type',
            help_text='',
        )

Step 5: Add the document references
Say you found the list of valid values listed in three places. You would list them in the documentcloud_pages attribute like this:
    class HeaderCd(CalAccessBaseModel):
        # ...
        # several lines of code later...
        # ...
        rec_type = fields.CharField(
            max_length=11,
            db_column='REC_TYPE',
            blank=False,
            verbose_name='record type',
            help_text='',
            documentcloud_pages=[
                DocumentCloud(id='2711616-MapCalFormat2Fields', start_page=10),
                DocumentCloud(id='2712033-Cal-Format-1-05-02', start_page=19),
                DocumentCloud(id='2712034-Cal-Format-201', start_page=24, end_page=25),
            ]
        )

Note: You only need to specify the end_page if the list spans multiple pages.
Step 6: Update the rec_type's help_text (if necessary)
It might be missing or it might be an empty string or it might not be consistent with what you see in the documentation. Note: The entire help_text string needs to be enclosed in single- or double-quotes like this:
    help_text='This is the help text',

If the help text is really long (80+ characters), then it needs to span multiple lines like this:
    help_text='This is the help text...blah...blah...blah...blah...blah...blah...\
...blah...blah...blah',

If you can, check the rec_type's defined choices against the actual values in rec_type's database column.
This will require you to install the app and run the updatecalaccessrawdata command. Then you can get the distinct column values with a GROUP BY query like this:
    SELECT REC_TYPE, COUNT(*)
    FROM HEADER_CD
    GROUP BY 1
    ORDER BY 1;

It's likely that you'll find undocumented values in database column, some of which are variants of the valid values. You can note these by repeating the same definition for each variant like this:
    OFFICE_CD_CHOICES = (
        ('GOV', 'Governor'),
        ('gov', 'Governor'),
        ('GUV', 'Governor'),
        # ...
    ),

If you're dealing with a set of choices that's been consolidated into calaccess_raw/annotations/choices.py, you can map the different variants to the same definition using the key of the choices dict like this:
    OFFICE_CD_CHOICES = (
        ('gov', look_ups.OFFICE_CODES['GOV']),
        ('GUV', look_ups.OFFICE_CODES['GOV']),
        # ...
    ),

If you're not able to check the database column values for whatever reason, don't sweat it. We'll deal with it in a later issue.
Wrap up: Review your changes and create a pull request

That's it!
PS: If any of this feels confusing, or if it doesn't seem to match up with what you are seeing, or if you have any suggestions about another approach, don't hesitate to speak up. You can post a comment below, or hit up the #california-civic-data channel on the News Nerdery Slack.

Done.


Cody is adding a "Reload Window" action to many views

Took me a while to track down which extension, and then to find exactly where, but this looks like the culprit. I'm not sure of the intent here, but since there isn't a when condition it will apply to all views
https://github.com/sourcegraph/cody/blob/main/vscode/package.json#L623-L627

Thank you for tracking this down and filing this @eamodio! 🙏🏼


Import/output songs/instruments to JSON via CLI

Hello, thanks for the great work! One feature that would be useful for people who are not good JS programmers like me is to export songs (.m8s) and instruments (.m8i) to JSON from the command line. That way it would be possible to say, export a song to JSON, manipulate the JSON data in some other language, and then convert that back into .m8s.
I'm imagining something like m8 song export foo.m8s foo.json and m8 song import foo.json foo.m8s, and analogous commands for .m8i.

I'm going to give this a shot and get your opinion before releasing it. Long story short, I have some thoughts around using M8 byte values in all places (like I could see a kind or type property in the generated Object to keep track of its type instead of a byte value).For example, would you rather see kind: WAVSYNTH or kind: 0x00 when an Instrument is turned into JSON? I'll start with the M8 approach and as I encounter places where we could make the JSON more human readable, I'll take note and share in the follow-up.

I'm leaning toward the following: Any place where the M8 UI shows a string value for its raw numerical value, we will have a read-only property (read-only in that its value is ignored when importing JSON) ending in {propName}Str that has the string representation of the numerical value. We need to make sure the exported JSON includes the raw value (to allow for import support) but the string representation would be useful as well.

I think having a string in addition to ints would be super useful! (Wouldn't be opposed to just having strings, and some kind of enum to map ints to strings and vice-versa, but having both also makes sense).

This was released today in<EMAIL_ADDRESS>m8 export, m8 import and the API of every m8-js all support exporting to and importing from JSON.

nice, it works!


[Issue 5309][docs] Clarify wording around retention policies

Fixes #5309
Docs are confusing.
Replaced retention wording to make distinction between acked and non-acked messages clearer.
(If this PR fixes a github issue, please add Fixes #<xyz>.)
Fixes #5309
Motivation
Docs are confusing.
Modifications
Replaced retention wording to make distinction between acked and non-acked messages clearer.
Verifying this change

[ ] Make sure that the change passes the CI checks.

This change is a trivial rework / code cleanup without any test coverage.
Does this pull request potentially affect one of the following parts:
No

@Jennifer88huang how long does it take before this change causes this page to update? https://pulsar.apache.org/docs/en/next/cookbooks-retention-expiry/

@rocketraman One day after merging the PR. The website builds automatically every day. If it's urgent, we can build it manually.
I'm building the website manually just now, so the update will be displayed on website soon after the build completes.

@rocketraman I've just checked, the update is already displayed on our website at https://pulsar.apache.org/docs/en/next/cookbooks-retention-expiry/#retention-policies
Since the PR content is merged to master, it takes effect in the next version, so it's not displayed for version 2.4.1 yet.
If you want to update it in version 2.4.1, you need to copy the update to ../site2/website/versioned_docs/version-2.4.1.
Since i've changed the Milestone to 2.4.2, and 2.4.2 release is due 10/31, so when 2.4.2 is released, you update will also be displayed in 2.4.2 as well.


Twilight Forest Charm of Keeping destroys items

Describe the bug
On death the charm of keeping will instead of giving you the lost items, delete them from the grave's inventory and just not give the items back. My cousin lost all of his armor and his sword to this. We checked around where he spawned to see if the items dropped on the floor for some reason but there was nothing.
To Reproduce
Steps to reproduce the behavior:

Die while the charm of keeping is in your inventory of equipped on your belt slot.
Click respawn at which point the items should be restored.
The items are not restored, then check the grave. The items are not there either.
See error

Expected behavior
The items should be removed from the grave, and then put into your inventory. I'm not sure if this is a problem that only the Twilight Forest devs can fix but I'll write a report there as well.
Desktop (please complete the following information):

OS: Windows 11
Minecraft Version: 1.19.2
Version: 1.4.6

Additional context
Might be an issue on the Twilight Forest devs' side.
Screenshots
None.

I got a response saying to update both packs from someone when i reported it on the twilight forest page, so i guess this is fixed now.


Convert new repo filename to lowercase

When creating a new repo, should the filename be converted to lowercase, e.g. a new repo with title "FooBar", could become "foobar.git" - it's easier to type, and a nice way of making repo names constant.

Why? Both GitHub and GitLab don't have this behaviour. I think it best to let the people decide if they want to use repository names with upper, lower or mixed case?

2016-01-25 14:05 GMT+03:00 Jorrit Klein Bramel<EMAIL_ADDRESS>
Why? Both GitHub and GitLab don't have this behaviour. I think it best to
let the people decide if they want to use repository names with upper,
lower or mixed case?

Internally github uses lowercase as i see? Why we need this feature?
--
Vasiliy Tolstov,
e-mail<EMAIL_ADDRESS>

It's impossible to set a filename when creating a repo, so to create a repo of lowercase, your title must be lowercase. I think converting to lowercase will be good because of case-inconsistent OS's that don't care for caps.

@ChangePlaces i think you right +1 for this

I don't understand this issue?
All repositories' directories are converted to lowercase on file system.

I updated to 0.8.1 the other day, created a repo called FooBar, and I have to push to FooBar.git

cloning derp/FooBaz with http://example.com/derp/foobaz.git works just fine, though the WebUI says http://example.com/derp/FooBaz.git so if anything it's a UI-bug, not a system-bug

what os are you using for client, and git server?

Linux/Arch for client and Linux/Debian for server. I can test more
combinations if you want, though I don't think that the result will change
:)

I updated to 0.8.1 the other day, created a repo called FooBar, and I have to push to FooBar.git

It might be a bug with SSH push in 0.8.1, but I'm sure it is fixed in recent versions.

Interesting, I'll have a play and report back!

ping @ChangePlaces

sorry, i haven't had time to update and check this out due to personal life. i've penciled it in for the weekend

created new repo withon Organization with RepoName
gogs currently creates the file structure like  gogs-repositories/organization/reponame.git, which is ok.
But UI still shows ..Organization/RepoName.git.
If click "copy to clipboard" and try to clone with e.g. SourceTree, i become "not a git repository" message.
changing to lowercase - clone successful.

Can it be fixed or configured somehow?

This feature should be optional.

@vilinski what is your Gogs version? That should only happen in old versions.
@linquize it is the problem about the consistency of finding repository on the file system, not a feature that we can provide options.

@Unknwon the latest binary version 0.8.25, downloaded from here
and yes, currently i can use only absolute path like /git/home/gogs-repositories/OrgName/RepoName.git instead of just orgname/reponame.git. Can't actually solve it using proper ssh key

@vilinski you are not allowed to both login shell and use SSH for clone git repositories for same system user. That's why you need full path.

Close due to lack of feedback.


Discussion: use Jinja to manage SQLs in tests

Jinja is a template engine for Python and is also used by dbt to manage the codebase of SQLs.
Since we have both batch and streaming to test, in theory, the tests used for batch should also be used for streaming with proper modification. We don't want to write almost the same code(SQL) twice.
Also, for certain queries, batch and streaming modify differently in terms of the where condition, so that they can output something other than empty.
So we write some additional Jinja in SQL files as template files, and then generate the real SQLs to be tested when we want to test them.
Not necessarily Jinja, and also looking for tools other than Jinja to achieve the same goal.

This is a good tool for templating in such a scenario.  +1 for this idea.

Another use case is to avoid abuse of include in slt file. For example, if we can support template, we no longer need to include all slt.part files in another file, which prohibits parallel execution of slt files.

block by #7577


chore(BUX-628): add admin panel to start.sh

Pull Request Checklist

[x] 📖 I created my PR using provided  : CODE_STANDARDS
[x] 📖 I have read the short Code of Conduct: CODE_OF_CONDUCT
[x] 🏠 I tested my changes locally.
[ ] ✅ I have provided tests for my changes.
[x] 📝 I have used conventional commits.
[ ] 📗 I have updated any related documentation.
[x] 💾 PR was issued based on the Github or Jira issue.

testing


Add helm chart for operator deployment

A lot of users are running helm, so it makes sense to meet them where they are and support helm. We don't need to continue to support both istioctl+helm fully, but instead should just have a simple helm chart, that follows standard best practices and is present in https://hub.helm.sh/.
This chart will be ~100 lines with minimal templating

It will also enable chart maintainers that have dependencies on Istio to be able to cleanly specify them in their Helm charts. Helm v3 is a client side only package manager for end users, and Helm hub is federated. All in all its pretty similar to the 'apt-get model' now. Link to existing issue:
https://github.com/istio/istio/issues/14951

@ostromart this issue and issue #21861 have both been closed yet PR #21864 is only recorded as a partial implementation. I've tried to figure out if the operator Helm chart was actually built but I can't see it in the release artifacts.

They are in manifests/charts/istio-operator

Thanks @ostromart. Is there a reason why the chart isn't being published?

Similar to #29222 and #25467