TLS Authentication on proxy prevents Prometheus metrics collection

I am running a Pulsar deployment with TLS and Authentication on enabled on the proxy only, and neither TLS nor Authentication enabled inside the private cluster.
When Prometheus attempts to scrape metrics from the proxy component, the following errors are produced in the log:
15:21:54.630 [pulsar-external-web-4-8] INFO  org.eclipse.jetty.server.RequestLog - <IP_ADDRESS> - - [20/Apr/2020:15:21:54 +0000] "GET /metrics HTTP/1.1" 302 0 "-" "Prometheus/1.6.3" 27
15:21:54.641 [pulsar-external-web-4-2] WARN  org.apache.pulsar.broker.web.AuthenticationFilter - [<IP_ADDRESS>] Failed to authenticate HTTP request: Authentication required
15:21:54.642 [pulsar-external-web-4-2] INFO  org.eclipse.jetty.server.RequestLog - <IP_ADDRESS> - - [20/Apr/2020:15:21:54 +0000] "GET /metrics/ HTTP/1.1" 401 353 "http://<IP_ADDRESS>:8080/metrics" "Prometheus/1.6.3" 20

Is there a way to allow Prometheus to gather proxy metrics in my configuration?

You can either configure authentication in your Prometheus scrape job or disable authentication on the proxy metrics endpoint. To disable, you should be able to set the following in your proxy.conf:
authenticateMetricsEndpoint=false

See https://github.com/apache/pulsar/pull/4921 for more details.

Oh, excellent. I see that is even in the docs -- I don't know how I missed it.
Adding:
  PULSAR_PREFIX_authenticateMetricsEndpoint: "false"

to the appropriate ConfigMap fixed this for me.
Thank you for your help!


Control should go to rows even it is read only mode

Bug Report
Description
On Readonly table, the control should go to all rows as per accessibility testing for the user to view the reconds when the scroll is enabled

Steps to Reproduce
Make a table to read-only then on tab navigation selection will skip the table
Additional Context / Screenshots

Expected Behavior
control should go to all rows in accessibility testing
Possible Solution

Environment

Component Name and Version:
Browser Name and Version:
Node/npm Version: [e.g. Node 8/npm 5]
Webpack Version:
Operating System and version (desktop or mobile):

@ Mentions

Can we get a code sample of the table you are trying to test with?

Please find below git hub url https://github.cerner.com/hi-malvern/dwt-app/blob/master/src/configuration/QueueDialogBoxContent.js

team any update we can navigate table using up and down arrows?

@sudheervilluri This seems to be more of an issue related to the scroll content in general, and not to do with the terra-table. In this case I believe the issue would be the underlying terra-scroll component within your terra-content-container.
https://github.com/cerner/terra-core/issues/2787
The terra-table v4 introduces it's own scrollable container, which may get your around the problem you are seeing in the mean time if you use it's fixed header styling.
With all containers, unless it or an element inside it gaines focus, keyboard commands will not work. This is often negated by always using body scrolling, however in the case of nested fill style components this is not so easily achieved.
Feel free let me know if we can close this issue in favor of the other broad issue to address scrolling across the application.


Better content description for rewind and course view mode buttons

Description
MA-2717
MA-2641
Rewind video has a modified contentDescription
Mode picker has a modified title.
Testing
Use talkback to hear updates.
Reviewers
If you've been tagged for review, please check your corresponding box once you've given the :+1:.

[x] Code review: @bguertin
[ ] Code review: @mdinino
[ ] UI strings/error msgs review: @catong

@@             master       #801   diff @@
==========================================
  Files           484        484
  Lines         19862      19827    -35
  Methods           0          0
  Messages          0          0
  Branches       2810       2809     -1
==========================================
- Hits           3704       3690    -14
+ Misses        15730      15711    -19
+ Partials        428        426     -2

Review #801 on Codecov

Powered by Codecov. Last update d7249ad...e540ebf

👍


[REQUEST] Add a ExecutionParameterRepository interface

Is your feature request related to a problem? Please describe.
There is a lot of code in the Main method relating to CLI parsing. It obfuscates the more important code as well as being error prone and untested.
Describe the solution you'd like
The object of this PR is to mimic what has been done with other repositories and have a generic CommandLineRepository  interface through which command lines values would be retrieved.

usage of Apache CLI parser should be encapsulated in the adapter layer/module
repository should handle the presence/absence of options and have configurable defaults through a resource file in JSON
all implementation files should come with tests done with mockito

Keep in mind having a POJO object for those parameters so that they could be deserialized directly with Jackson in the JSON implementation.


[FLOC-3484] Change admin test suite to use Flocker-supplied base test case class

Fixes https://clusterhq.atlassian.net/browse/FLOC-3484

Thanks @exarkun
Looks good to me.
I clicked rebuild on some unrelated failed builds.
Merge when you're satisfied with the results.


TabNavigator header

How can i create something like this
Main: {
  screen: TabNavigator({
    Contacts: {
      screen: ContactsView
    },
    Projects: {
      screen: ProjectsView
    }
  }),
  navigatorOptions: {
    header: <Text>HEADER</Text>
  }
}

navigatorOptions here is not working

Your screen will need to be a StackNavigator to have a header. TabNavigators by default do not have a header component. StackNavigators, however, do.

I need to create something like this. Including custom header and custom tab switchers

So i need TabNavigator

I solved this problem. Just include header in each TabNavigator child. Don't know is this right?

@xahon do you mean you added into each screen a header component?

@jsbranco yes

@xahon  right, I also did the same approach for one of my projects.  The current project I am working on I did used TabNavigator as base, and each screen in the TabNavigator is a StackNavigator.
My use case for this current projects requires each screen to have its own stack so it fits nicely.

@jsbranco Didn't you think to do navigator as singleton for easier navigation?

@jsbranco I had remake my project from react-native-router-flux to your plugin ans stucked into #2095 problem. Another navigator plugins have single navigator instance and was more comfortable, but their unintuitive behavior make me search antoher plugin like this. I cannot find gold mean in this dozens of plugins

@xahon I know, is like almost every day there is a new library to handle the same problem.
I reckon in certain cases it feels more natural to nest navigators, the level of complexity added doesn't seem to be too much to put me off.
Then again, some projects you really don't need nesting if you are for example having an app which only has Tabs and then from the tabs you popup a modal then it works pretty well.
To me nesting navigators doesn't seem to still keep navigation relatively easy to navigate and develop.
Although this project is still evolving but currently I am sticking with this one because so far I have not encountered any big obstacles while working with it.

@xahon can you show an example? I'm stucked in the same problem

@kaueDM I just use RNRF with custom header component that has touchable. I've created layouts and wrap into them all of my screens. Each layout has this custom header and back button (touchable)

You can use StackNavigator and TabNavigotor together.
Main
const Main = StackNavigator({   Main: {     screen: Tabs   } })
Tabs
export const Tabs = TabNavigator({   X: {     screen: XScreen,     navigationOptions: {       tabBarLabel: 'X',       title: 'X Title'      }   },   Y: {     screen: YScreen,     navigationOptions: {       tabBarLabel: 'Y',       title: 'Y Title'      }   },   Z: {     screen: ZScreen,     navigationOptions: {       tabBarLabel: 'Z',       title: 'Z Title'      }   } })

You can set the tabBarComponent, in the second argument of the TabNavigator function to a wrapped view containing the actual tab bar. Look:
TabNavigator(tabs, {
  tabBarComponent: (props, state) => (
    <View>
      {/* your code here */}
      <TabBarBottom {...props} {...state} />
    </View>
  ),
})

Don't forget to include the TabBarBottom component from the react-navigation package!

If i make each screen within a TabNavigator a Stack then I can no-longer pass params to this stack and all the other tabs.


rancher UI could not login by nginx server IP

What kind of request is this (enhancement):
enhancement
Steps to reproduce (least amount of steps as possible):
1,RKE create k8s cluster(three vm node，hostname as rancher1（73.161），rancher2（73.162），rancher3（73.163）),detail info in the following
2, helm install cert-manager， traefik;  then install  rancher use following command.
helm install rancher ./rancher-2.5.2.tgz --namespace cattle-system --set hostname=rancher.bigtera.com

## check the rancher ingress status
bigtera@rancher3:~$ kubectl get ingress --all-namespaces
Warning: extensions/v1beta1 Ingress is deprecated in v1.14+, unavailable in v1.22+; use networking.k8s.io/v1 Ingress
NAMESPACE       NAME      CLASS    HOSTS                 ADDRESS                                     PORTS     AGE
cattle-system   rancher   <none>   rancher.bigtera.com   <IP_ADDRESS>,<IP_ADDRESS>,<IP_ADDRESS>   80, 443   4d21h
bigtera@rancher3:~$

3，client  manually add  DNS entry <IP_ADDRESS> rancher.bigtera.com into client's hosts file
client web browser login rancher web ui ok,  and input user/password login successful
4，add one vm as nginx server as reverse proxy（IP is 72.228） （detailed conf in the following）
server {
        listen 9090 ssl;

        ssl_certificate /etc/ezs3/ssl/ezs3_server.crt;
        ssl_certificate_key /etc/ezs3/ssl/ezs3_server.key;
        root /var/www/html;
        index index.html index.htm index.nginx-debian.html;

        server_name _;

        location ^~ / {
               proxy_pass https://rancher.bigtera.com;
               proxy_set_header Host rancher.bigtera.com;
        }
}

## i have add the rancher.bigtera.com to the nginx server's hosts file
root@rac04:~# cat /etc/hosts
<IP_ADDRESS> localhost.localdomain localhost
<IP_ADDRESS> rancher.bigtera.com

Result:
client browser login URL: https://<IP_ADDRESS>:9090/   you can see the login windows，but input user/password could‘t login.
the reason looks like browser detect a cross domain access caused by rancher api authProviders (detail info in the following).
i think in some situation，we could not modify the client’s hosts file，so we need to login rancher web ui by IP
Other details that may be helpful:
1, I use the same nginx conf to proxy to harbor ingress(harbor ingress is in another k8s cluster), can login successful
2, in nginx server ，i test the following api ， i doubt the api authProviders is the root cause
root@rac04:/etc/nginx# curl --insecure https://<IP_ADDRESS>:9090/v3-public/authProviders
{"type":"collection","links":{"self":"https://rancher.bigtera.com/v3-public/authProviders"},"actions":{},"pagination":{"limit":1000,"total":1},"sort":{"order":"asc","reverse":"https://rancher.bigtera.com/v3-public/authProviders?order=desc","links":{"type":"https://rancher.bigtera.com/v3-public/authProviders?sort=type","uuid":"https://rancher.bigtera.com/v3-public/authProviders?sort=uuid"}},"filters":{"created":null,"creatorId":null,"name":null,"removed":null,"type":null,"uuid":null},"resourceType":"authProvider","data":[{"actions":{"login":"https://rancher.bigtera.com/v3-public/localProviders/local?action=login"},"baseType":"authProvider","creatorId":null,"id":"local","links":{"self":"https://rancher.bigtera.com/v3-public/localProviders/local"},"type":"localProvider"}]}
root@rac04:/etc/nginx#

root@rac04:/etc/nginx# curl --insecure https://rancher.bigtera.com/v3-public/authProviders
{"type":"collection","links":{"self":"https://rancher.bigtera.com/v3-public/authProviders"},"actions":{},"pagination":{"limit":1000,"total":1},"sort":{"order":"asc","reverse":"https://rancher.bigtera.com/v3-public/authProviders?order=desc","links":{"type":"https://rancher.bigtera.com/v3-public/authProviders?sort=type","uuid":"https://rancher.bigtera.com/v3-public/authProviders?sort=uuid"}},"filters":{"created":null,"creatorId":null,"name":null,"removed":null,"type":null,"uuid":null},"resourceType":"authProvider","data":[{"actions":{"login":"https://rancher.bigtera.com/v3-public/localProviders/local?action=login"},"baseType":"authProvider","creatorId":null,"id":"local","links":{"self":"https://rancher.bigtera.com/v3-public/localProviders/local"},"type":"localProvider"}]}
root@rac04:/etc/nginx#

3，i change rancher web-->global-->setting-->server url  from "https://rancher.bigtera.com" to  "https://<IP_ADDRESS>:9090"
the problem is same
4, i think maybe change the response of /v3-public/authProviders  from "https://rancher.bigtera.com" to "https://<IP_ADDRESS>" maybe solve the problem， but don't now how ?
any help could be appreciate ,thanks
Environment information

Rancher version (rancher-2.5.2 ):
Installation option (HA):

Cluster information

Cluster type (created by RKE，detailed info in the following):
Machine type (vm，4核4G)
Kubernetes version (in the following):

bigtera@rancher3:~$ kubectl version
Client Version: version.Info{Major:"1", Minor:"19", GitVersion:"v1.19.4", GitCommit:"d360454c9bcd1634cf4cc52d1867af5491dc9c5f", GitTreeState:"clean", BuildDate:"2020-11-11T13:17:17Z", GoVersion:"go1.15.2", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"19", GitVersion:"v1.19.3", GitCommit:"1e11e4a2108024935ecfcb2912226cedeafd99df", GitTreeState:"clean", BuildDate:"2020-10-14T12:41:49Z", GoVersion:"go1.15.2", Compiler:"gc", Platform:"linux/amd64"}

bigtera@rancher3:~$ kubectl get nodes -o wide
NAME            STATUS   ROLES                      AGE   VERSION   INTERNAL-IP     EXTERNAL-IP   OS-IMAGE             KERNEL-VERSION      CONTAINER-RUNTIME
<IP_ADDRESS>   Ready    controlplane,etcd,worker   5d    v1.19.3   <IP_ADDRESS>   <none>        Ubuntu 16.04.6 LTS   4.4.0-142-generic   docker://18.9.7
<IP_ADDRESS>   Ready    controlplane,etcd,worker   5d    v1.19.3   <IP_ADDRESS>   <none>        Ubuntu 16.04.6 LTS   4.4.0-142-generic   docker://18.9.7
<IP_ADDRESS>   Ready    controlplane,etcd,worker   5d    v1.19.3   <IP_ADDRESS>   <none>        Ubuntu 16.04.6 LTS   4.4.0-142-generic   docker://18.9.7

Docker version (use docker version):

bigtera@rancher3:~$ docker version
Client:
 Version:           18.09.7
 API version:       1.39
 Go version:        go1.10.4
 Git commit:        2d0083d
 Built:             Wed Oct 14 19:42:56 2020
 OS/Arch:           linux/amd64
 Experimental:      false

Server:
 Engine:
  Version:          18.09.7
  API version:      1.39 (minimum version 1.12)
  Go version:       go1.10.4
  Git commit:       2d0083d
  Built:            Wed Oct 14 17:25:58 2020
  OS/Arch:          linux/amd64
  Experimental:     false
bigtera@rancher3:~$

any help will be appreciated .

You're forcing the host header that the Rancher container receives to be Host rancher.bigtera.com, so it sends back API responses which contain that, which the Ui tries to follow, but can't because they are now cross-origin.  X-Forwarded-* headers need to be set so the container knows the original request URL and can produce responses that correspond to it.

@vincent99   so many thanks for you reply,  i modify the nginx conf follow your advice(details in the following) , the problem is still there， i am so sad
## nginx conf now is
server {
        listen 9090 ssl;
        ssl_certificate /etc/ezs3/ssl/ezs3_server.crt;
        ssl_certificate_key /etc/ezs3/ssl/ezs3_server.key;
        root /var/www/html;
        index index.html index.htm index.nginx-debian.html;

        server_name _;
        location ^~ / {
                proxy_pass https://rancher.bigtera.com;
                proxy_set_header X-Real-IP $remote_addr;
                proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;

                #proxy_set_header Host rancher.bigtera.com;
        }
}

You're not setting X-Forwarded-Proto: https or X-Forwarded-Host: <IP_ADDRESS>:9090.  The server needs to receive enough information from the proxy to be able to (re)construct absolute URLs in the response that will match what the original request was (https://<IP_ADDRESS>:9090/...), not what the actual request it receives is (https://rancher.bigtera.com/...).

@vincent99 thanks again， follow your instruction， still have problem
now nginx conf as following
server {
        listen 9090 ssl;
        root /var/www/html;

        # Add index.php to the list if you are using PHP
        index index.html index.htm index.nginx-debian.html;
        server_name _;

        location ^~ / {
                proxy_pass https://rancher.bigtera.com;
                proxy_set_header X-Real-IP $remote_addr;
                proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
                proxy_set_header X-Forwarded-Host <IP_ADDRESS>:9090;
                proxy_set_header X-Forwarded-Proto https;
...

chrome still can not login rancher, ant the api response is as before
root@rac04:~# curl --insecure https://<IP_ADDRESS>:9090/v3-public/authProviders
{"type":"collection","links":{"self":"https://rancher.bigtera.com/v3-public/authProviders"},"actions":{},"pagination":{"limit":1000,"total":1},"sort":{"order":"asc","reverse":"https://rancher.bigtera.com/v3-public/authProviders?order=desc","links":{"type":"https://rancher.bigtera.com/v3-public/authProviders?sort=type","uuid":"https://rancher.bigtera.com/v3-public/authProviders?sort=uuid"}},"filters":{"created":null,"creatorId":null,"name":null,"removed":null,"type":null,"uuid":null},"resourceType":"authProvider","data":[{"actions":{"login":"https://rancher.bigtera.com/v3-public/localProviders/local?action=login"},"baseType":"authProvider","creatorId":null,"id":"local","links":{"self":"https://rancher.bigtera.com/v3-public/localProviders/local"},"type":"localProvider"}]}
root@rac04:~#

i think maybe rancher server did't allow this behavior ?

@vincent99 ，hi， brother， could you give me more suggestions to resolve the problem， many thanks

could any one help me ?

I have the same issue. It seems to pertain to not being able to modify the use-forwarded-headers setting when deploying rancher using the Helm chart.

I have the same issue. It seems to pertain to not being able to modify the use-forwarded-headers setting when deploying rancher using the Helm chart.


childe frames update

Updates Childe frames
Sheet: https://docs.google.com/spreadsheets/d/1iBcJqVG3uWhwyHwCbYQby0mdaLZJ_ZhJCo0I4djnsU8/edit?usp=sharing
Videos: https://youtu.be/FSE7NhQSbHE and https://youtu.be/rpVDDq-F5ZM

This update is not done yet, I need to make sure the code style is ok before I continue
Specifically, line 141 and below is what needs to be reviewed

closing this since the planned new frames system will make this much easier.

one thing to add -- childe's skill, if used while moving, is 1 frame long. however using 1 frame will cause issues with his skill stealing the vaporize from his burst in the common sequence burst, skill. so I recommending making his moving skill frame long enough so this doesn't happen, perhaps 5 frames. also there may be situations where the user wants to use a nonmoving skill, so perhaps a param for choosing moving vs nonmoving is ideal.


Adding references to Azure Database for MySQL and PostgreSQL

This document is also appicable for Azure Database for MySQL and PostgreSQL

@JackStromberg : Thanks for your contribution! The author, @srdan-bozovic-msft, has been notified to review your proposed change.

this needs to be verified with open source database teams

@Mike-Ubezzi-MSFT please assign to @kummanish

The current changes look good.
However, you have missed adding Azure Database for MariaDB in the list which also supports VNet service endpoints.

@JackStromberg : Thanks for your contribution! The author, @srdan-bozovic-msft, has been notified to review your proposed change.

It will be better to keep it "Azure database for MariaDB"  since it is a distinct service and not just "MariaDB"

@JackStromberg : Thanks for your contribution! The author, @srdan-bozovic-msft, has been notified to review your proposed change.

Look good to me now.

#sign-off

@CarlRabeler: I'm sorry - only the author of this article, @srdan-bozovic-msft, can sign off on your changes. But we do have an exception process - if you are on the Microsoft content or product team for this product area, you can ask the PR review team to review and merge it by sending mail to the techdocprs alias.


config socket.io

hi, this is a very good package and i like it, but i want to use socket.io and laravel-echo-server as an alternative to pusher, how to configure it, looking forward to your reply

thanks for your suggestion, i can use laravel-websockets instead of pusher. And I am thinking of using firebase, so does this package have support for firebase? looking forward to your reply 😊

The core messenger package is agnostic as far as the BROADCAST_DRIVER in the consuming app is concerned. This UI package only has pusher.js bundled, so only pusher protocol is supported by default. See:
https://github.com/RTippin/messenger-ui/blob/0ac78019ca1002f9f6d55bb2bcce56c6a5e2224c/package.json#L35
https://github.com/RTippin/messenger-ui/blob/0ac78019ca1002f9f6d55bb2bcce56c6a5e2224c/resources/js/managers/NotifyManager.js#L9
https://github.com/RTippin/messenger-ui/blob/0ac78019ca1002f9f6d55bb2bcce56c6a5e2224c/resources/js/managers/NotifyManager.js#L130-L172
This means that pusher.com, laravel-websockets, or soketi should all work, as they use the pusher protocol.
If you did have a need to use your own socket.io instance, then you will need to fork this package. Once forked, update the NotifyManager as shown above, including importing socket.io in the package.json, then recompile the app.js/css and push your changes to your fork. Then overwrite the app.js/css files you compiled into your parent app, preferably by installing your forked repo of this package.


CharacterBody3D move_and_slide() results in wrong velocity!

Godot version
4.0
System information
windows 10
Issue description
I'm applying a force towards a surface, based on the surface normal.
However, the move_and_slide results in inaccurate velocity after colliding/sliding.

Here is another example using surface normal as the direction:

Steps to reproduce
If you run the example project, it will move the body towards the slope at 45 degrees (Velocity3(0.1,-0.1,0.0) ).. It will hit the slope which is rotated at 45 degrees.
The result is that the body slides up the slope instead of stopping, and has a velocity that is incorrect.
It occurs with angles other than 45 too.. As long as the force is applied along the direction of the surface normal, the resulting velocity is inaccurate and causes it to slide with an inaccurate velocity instead of stop with a velocity of 0!
Minimal reproduction project
slopeJoltBug.zip

Turns out that I had to use get_real_velocity() in order to get the correct velocity.. I'm running into a different issue now, but I'll close this one.


Script in doc is not working

[The script doesn't work.  It uses the port as name and then rejects it]

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 328f78e4-c8b4-301d-16a9-57e931a410ba
Version Independent ID: b19558b2-6ef2-2d3c-44dc-8c7f46638748
Content: Configure DNN listener for availability group - SQL Server on Azure VMs
Content Source: azure-sql/virtual-machines/windows/availability-group-distributed-network-name-dnn-listener-configure.md
Service: virtual-machines-sql
Sub-service: hadr
GitHub Login: @adbadram
Microsoft Alias: adbadram

@lawrkelly Thank you for your feedback!  We've assigned this to the document author for further review.

@lawrkelly Can you elaborate on 'it uses the port as name and then rejects it"? Are you receiving an error message anywhere?

Hi @lawrkelly , thanks for contacting Microsoft! Since it's been some time since we've heard from you, we're going to assume your issue has been addressed. We're going to close out this Git Issue but please feel free to comment should you need anything further.
Thanks again for reaching out and hope you have a wonderful rest of your day!
Masha from the SQL Docs team
#please-close


Nocount test timings

Closes #

What has been done to verify that this works as intended?
Why is this the best possible solution? Were any other approaches considered?
How does this change affect users? Describe intentional changes to behavior and behavior that could have accidentally been affected by code changes. In other words, what are the regression risks?
Does this change require updates to the API documentation? If so, please update docs/api.md as part of this PR.
Before submitting this PR, please make sure you have:

[ ] run make test-full and confirmed all checks still pass OR confirm CircleCI build passes
[ ] verified that any code from external sources are properly credited in comments

Now that benchmarking can happen locally, is it useful to keep this PR open? How about we close this PR for now, then reopen once it's close to being ready for review? (Or create a new PR then.)


models.TripletEmbedding and TripletNet Notfound

Hello I'm going to run the project
but when I come to from models.TripletEmbedding import TripletNet
I cant find the file
could you update it

As it is a baseline model of my partner's paper, I'll release it until his paper has been released.

Is the TripletNetwork available now?

Is the TripletNetwork available now?

It is avaiable now


Fix edge cases with CSS custom properties.

 Handle cases where there are multiple CSS custom properties with the same name.

 When an anchor fn is applied to a custom property, trace usage even if that prop is then applied to another custom property.

 transformCSS() - anchor() function in math functions

@mirisuzanne I think I got it to work for an arbitrary number of custom property re-assignments/pass-throughs! I still need to update some tests, but take a look at the new demos and see what you think. 🙏

@jgerigmeyer impressive! Looks good to me.

@sanajaved7 There's a lot here, and I'm sure this could be cleaner. I'd appreciate your review, and it might be most efficient to walk through the changes together?

@jgerigmeyer still catching up so it would definitely help to review together!

@jgerigmeyer still catching up so it would definitely help to review together!

@sanajaved7 Makes sense -- propose a time on the calendar?

Test comment ?


[C++] Fix the unstable unit tests failure

Fixes #8128
Motivation
The send callback of BatchMessageTest is modifing a global variable which is the count of successfully produced messages. So some tests may failed in multi-thread environment.
Modifications

Add a MessageCountSendCallback class to replace the current send callback function

/pulsarbot run-failure-checks

/pulsarbot run-failure-checks


Authenticate for push but not pull

is it possible?

Closing as this is the wrong repo to open this issue in ask on CNCF slack or in distribution/distribution.


Rewrites README.md opener

It's been a bit -- I think this is a clearer expression of the value proposition
[Short description explaining the high-level reason for the pull request]
Changes
How I tested this
Notes
Checklist

[ ] PR has an informative and human-readable title (this will be pulled into the release notes)
[ ] Changes are limited to a single goal (no scope creep)
[ ] Code passed the pre-commit check & code is left cleaner/nicer than when first encountered.
[ ] Any change in functionality is tested
[ ] New functions are documented (with a description, list of inputs, and expected output)
[ ] Placeholder code is flagged / future TODOs are captured in comments
[ ] Project documentation has been updated if adding/changing functionality.

Trying this one on for size


Local file data source

This is probably the most obvious source, so we should support it.

Resolved by #11. Thanks Scott!


Image not reloading

Hello,
I'm trying to use the library but I'm stuck because the image isn't reloading.
I used the mvvm pattern with the xlabs helpers.
This is my xaml file:
<?xml version="1.0" encoding="utf-8" ?>
<ContentPage xmlns="http://xamarin.com/schemas/2014/forms"
             xmlns:x="http://schemas.microsoft.com/winfx/2009/xaml"
             xmlns:ffimageloading="clr-namespace:FFImageLoading.Forms;assembly=FFImageLoading.Forms"
             xmlns:fftransformations="clr-namespace:FFImageLoading.Transformations;assembly=FFImageLoading.Transformations"
             x:Class="Cartea.View.CropView">
  <ContentPage.Content>
        <ffimageloading:CachedImage HorizontalOptions="Center" VerticalOptions="Center"
            WidthRequest="300" HeightRequest="300"
            DownsampleToViewSize="true"
            Source = "{Binding ImagePath, Mode=TwoWay}">
            <ffimageloading:CachedImage.Transformations>
                <fftransformations:CropTransformation  />
            </ffimageloading:CachedImage.Transformations>
        <ffimageloading:CachedImage.GestureRecognizers>
          <PinchGestureRecognizer PinchUpdated="OnPinchUpdated"/>
          <PanGestureRecognizer PanUpdated="OnPanUpdated"/>
        </ffimageloading:CachedImage.GestureRecognizers>
        </ffimageloading:CachedImage>
  </ContentPage.Content>
</ContentPage>

This is my view code:
public partial class CropView : ContentPage
{
    CropViewModel test;
    public CropView()
        {
            Title = "CropTransformation Demo";
            InitializeComponent();
            test = new CropViewModel();
            BindingContext = test;
        }

        void OnPinchUpdated(object sender, PinchGestureUpdatedEventArgs e)
        {
            test.PinchImage(e);
        }

        void OnPanUpdated(object sender, PanUpdatedEventArgs e)
        {
            test.PanImage(e);
        }
    }

In my viewmodel this is how I initialize my variables:
  public void Init(string pathSource, Stream streamSource)
        {
            ImagePath = pathSource;
            ImageSource = Xamarin.Forms.ImageSource.FromStream(() =>
            { return streamSource; });
            _originalStream = streamSource;

        }

Then the reload method:
 void ReloadImage()
        {
            var currentImage = Xamarin.Forms.ImageSource.FromStream(() => { return _originalStream; });
            CachedImage.InvalidateCache(ImageSource, FFImageLoading.Cache.CacheType.All, true);

            Transformations = new List<ITransformation>() {
                new CropTransformation(CurrentZoomFactor, CurrentXOffset, CurrentYOffset, 1f, 1f)
            };

            ImageSource = null;
            ImageSource = currentImage;
        }

        public void Reload()
        {
            Transformations = null;
            CurrentZoomFactor = 1d;
            CurrentXOffset = 0d;
            CurrentYOffset = 0d;
            ImageSource = Xamarin.Forms.ImageSource.FromStream(() =>
            { return _originalStream; });
        }

var currentImage = Xamarin.Forms.ImageSource.FromStream(() => { return _originalStream; });

You can't do that. _originalStream is disposed after first image loading operation (the same behavior is for standard Xamarin.Forms Image
BTW: Did you try CachedImage. ReloadImage() method?

@daniel-luberda In my Init method I already have the path of the picture too so I tried with the method:
var currentImage = Xamarin.Forms.ImageSource.FromFile(imagePath);

It's not working, same reason than with _originalStream?
I tried to use CachedImage.ReloadImage() but I can't call this function, have you a sample ?

@Spierki The same problem, and I also use the XLabs.forms. So is there any solutions you have?

I don't understand. Could you elaborate?
Simple explanation is that var currentImage = Xamarin.Forms.ImageSource.FromFile(imagePath);  is giving you only a pointer to the file. You have to load it to the image view after that. Eg. cacheImage.Source = currentImage;


Setup SES so we can send emails from the system

Not sure if we need/want to setup SES to send out emails from the new system or if we want to setup our own shared SMPTP mail server for use by all UC3 apps.

What email address do we want the emails to originate from?
https://ucopedu.atlassian.net/wiki/spaces/CUG/pages/47187600/Email+User+Guide
Not recommended to spoof the sender address (this would trigger it to be Spam)
https://nodemailer.com/ - will this be using the relay in the email account
test to see if it works across AWS accounts?


Add GestDown provider to retrieve Addic7ed subtitles

Used by Bazarr, this is imo a nice to have
https://www.gestdown.info/

implemented by #1069


Topography data license

We just discussed the license issue regarding the tidal and atmospheric forcing data, and that we cannot simply redistribute these data. There is probably a related issue to the topography data. Currently, we are hosting the ETOPO5 dataset at https://github.com/CWorthy-ocean/roms-tools-data, from where our python code fetches the bathymetry data.
We need to figure out if that is okay, or whether we need the user to download their own data. Here is a link to the ETOPO website:
https://data.noaa.gov/metaview/page?xml=NOAA/NESDIS/NGDC/MGG/DEM//iso/xml/etopo_2022.xml&view=getDataView&header=none

I'm closing this because we require the user to download the topography data themselves (as instructed here), among other things, for legal reasons. In the future, we should think about a cloud-based solution. I will open a separate issue on that.


Its broken

When ever I load it. I dont get anything
It says, error not found not found

Did You changed the URL of gogoanime site? If not change it from gogoanime.io to www1.gogoanime.ai.
It worked for me.

Use a custom current domain.  The default domain has expired.

Anime  gogoanime


🐛 [BUG] useDraw的shape，在切换形状后导致无法绘制

🐛 Bug description [Please make everyone to understand it]

https://codesandbox.io/p/sandbox/wizardly-thompson-cnlvkp?file=%2FApp.tsx%3A19%2C16

Please provide a link by forking these links LarkMap or GitHub repo, a minimal reproduction.

Required Link to minimal reproduction:

📷 Step to reproduce
🏞 Expected result
🚑 Any additional [like screenshots]

LarkMap Version:
Platform:

升级 L7 至 2.21.3 以上


request help: support jwt-auth plugin for ApisixConsumer

Issue description
We are currently facing a similar issue with these two issues https://github.com/apache/apisix-ingress-controller/issues/986 and https://github.com/apache/apisix-ingress-controller/issues/990.
In Kubernetes we want to create a consumer with the jwt-auth plugin enabled by using ApisixConsumer. However we found out that now only basic-auth and key-auth are supported in this way. We could still add a consumer with jwt-auth via apisix admin api but it would be ideal to use ApisixConsumer from apisix ingress controller directly.

Let me do it!

Assigned
Thanks

#1009  has been merged. I will close this one.


Resume appears but haven't played presentation

Hi Ethan,
I'm working on transcripts for APC 470.  The Resume button appears on the splash screen but I haven't interacted with the presentation previously.  This is happening on a regular basis.
Here's the course I'm working on: https://media.uwex.edu/content/apc/apc470/apc470_project_overview/index.html
Patrick

So sorry. This "will fix shortyly" turned out to be almost 2 years. It is now resuming for the right track and presentation. Fixed in commit 22751c8.


Quantitative Indicators

I repeated the experiment, but there are no quantitative indicators, only qualitative indicators (reconstructed pictures), how do I get qualitative indicators (Acc)?Many thanks.

Did you solve the problem with the pre-training data? What is the quality of the reconstructed image?

@zihang-xu 我只在部分数据上进行了预训练，重建图像的质量有的好有的坏，我用作者的checkpoints得到的ACC
是0.21左右

@zihang-xu 我只在部分数据上进行了预训练，重建图像的质量有的好有的坏，我用作者的checkpoints得到的ACC 是0.21左右

请问性能测试的代码可以分享一下吗


Repo sync for protected CLA branch

The pull request is created from main637861593482911586 to main to fix git push error for protected CLA branch

@opbld17 : Thanks for your contribution! The author(s) have been notified to review your proposed change.


SLA after VMs move to Availability Zones

The is a mistype in last paragraph: The SLA will be 99.99% after move of VMs to Availability Zones.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 3bf7273d-95c9-2e5e-09e6-4425af91e71d
Version Independent ID: 74c468f5-1c56-5fa5-b6c6-d922fbed9aa1
Content: Moving Azure VMs to another region with Azure Site Recovery - Azure Site Recovery
Content Source: articles/site-recovery/azure-to-azure-move-overview.md
Service: site-recovery
GitHub Login: @Rajani-Janaki-Ram
Microsoft Alias: rajanaki

That's awesome! is that a new improvement?

Availabilty zones give you 99.99% SLA. When you move your VMs from AS to AZ I understand it should give you 99.99% and not 99.9% as written in the document.

@SlavaRoikhman Thank you for the feedback. This issue is being assigned to the content author to evaluate and update as appropriate.

Awesome, thanks for that info. I look forward to seeing if anything else gets udpated in the doc.

Fixed. Change will show up later today. #please-close


How to make this work for overlapping entities?

Hi tom, i was wondering how could i make this work for overlapping spans for different entity types and how to extend this to relations extraction as well.
Any help or direction would be super helpful.

Hello!
I'm afraid that this project only works with "flat" NER, i.e. non-nested spans. The approach could be extended to support nested NER, but it would require some changes in both the preprocessing before training and predictions after training.

Tom Aarsen


forwarder as a fallback in circuit breaker

We've been looking at vulcand for our environment, but we're missing some functionality that we'd like to have.
We have a pattern of falling back to a second copy of a service (in another region) before giving up, i.e. the pattern is:

try the local (read) service
if fail (using circuit breaker) try the remote (read) service
if fail -> error

Ideally, we'd handle that in the internals of vulcand, with a second backend or so, but that seems like a lot more change than necessary. We think it should be possible to make a new circuit breaker fallback using the forwarder in oxy that could do this job.
If we were to implement this, is there an appetite to accept a pull request of that nature?

also see #88

yes, go for it


undefined error on first query

I've followed AWS's Amplify tutorial as well as your and react-admin tutorials.
Here is my App.js
import { Amplify } from "@aws-amplify/core";
import React from "react";
import { Resource, ListGuesser, Admin } from "react-admin";
import { buildDataProvider } from "react-admin-amplify";
import awsExports from "./aws-exports";
import * as mutations from "./graphql/mutations";
import * as queries from "./graphql/queries";

Amplify.configure(awsExports); // Configure Amplify the usual way

function App() {
    return (
        <Admin // Replace the Admin component of react-admin
            dataProvider={buildDataProvider({ queries, mutations })}
        >
            <Resource name="todos" list={ListGuesser} />
        </Admin>
    );
}

export default App;

In my models I have
type Todo @model {
  id: ID!
  name: String!
  description: String
}

However, upon running the application http://localhost:3000/#/todos I get no results, the loader spinner keeps spinning and there is a following message on console:

Hi,
Your code looks fine.
Did you add the Auth category on your Amplify backend?
You may need to change the authMode option.
It is set to AMAZON_COGNITO_USER_POOLS by default but it looks like your API is public.
You may try API_KEY instead.

Hi,
Your code looks fine.
Did you add the Auth category on your Amplify backend?
You may need to change the authMode option.
It is set to AMAZON_COGNITO_USER_POOLS by default but it looks like your API is public.
You may try API_KEY instead.

Ah, that was it. Thank you!
This works:
<Admin
            dataProvider={buildDataProvider({queries, mutations}, {authMode: "API_KEY"})}
        >

I'm wondering where that error message is coming from? react-admin? Why would it show up us just undefined

Ah, that was it. Thank you!
This works:
<Admin
            dataProvider={buildDataProvider({queries, mutations}, {authMode: "API_KEY"})}
        >

I'm wondering where that error message is coming from? react-admin? Why would it show up us just undefined

Ah, that was it. Thank you!
This works:
<Admin
            dataProvider={buildDataProvider({queries, mutations}, {authMode: "API_KEY"})}
        >

I'm wondering where that error message is coming from? react-admin? Why would it show up us just undefined

Ah, that was it. Thank you!
This works:
<Admin
            dataProvider={buildDataProvider({queries, mutations}, {authMode: "API_KEY"})}
        >

I'm wondering where that error message is coming from? react-admin? Why would it show up us just undefined

Great :)
You are right, the error is not explicit.
You made me realize that the data provider does not handle errors correctly. It should throw errors like explained here.
I will try to make a PR ASAP

Great :)
You are right, the error is not explicit.
You made me realize that the data provider does not handle errors correctly. It should throw errors like explained here.
I will try to make a PR ASAP


Refine Styling of "Start Tour" and "All Clear" Buttons

Improve the styling of the "Start Tour" and "All Clear" buttons to enhance their visibility and aesthetics.

Heya, can I try to contribute to this project? I don't know much on code as I'm a beginner but I can redesign the buttons if that's what you mean by styling?

hey @Dianesaur do you know about css ?

Hey, I Can Do this Can you assign this to me??

@Neel-07 I don’t sadly, but I can find a tutorial on YouTube or ask my APSCP teacher tomorrow to help?

@amitesh-183 assigned this to you.

@Dianesaur, dont worry lets the remaining issues get resolved then you can update the README Documentation, you can contribute to it.


information_schema.schemata is not supported

The error in goldsky:
Error while creating public.abstract_testnet_raw_blocks table in Postgres: Failed to list tables for database dev

Error message inside RisingWave:
Failed to prepare the statement: Feature is not yet implemented: information_schema.schemata is not supported, please use `SHOW` commands for now.
`SHOW TABLES`,
`SHOW MATERIALIZED VIEWS`,
`DESCRIBE <table>`,
`SHOW COLUMNS FROM [table]`

Tracking issue: https://github.com/risingwavelabs/risingwave/issues/1695

Version: v2.0.2 (RisingWave Cloud Instance)

resolved at v2.1 https://github.com/risingwavelabs/risingwave/pull/18709


fix: C++ Auto-Reconnect

:tada: This PR is included in version 3.2.0-next.12 :tada:
The release is available on:

npm package (@next dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Building schema failing on updates with the WP GraphqlQL WooCommerce extension

Having a strange issue when running my local development server. While running gatsby develop I'm getting random updates on the Product post type and it always gets stuck on "building schema". Have to trigger a rebuild every time.

info  gatsby-source-wordpress  update product TITLE (#23508)

success extract queries from components - 0.750s
success write out requires - 0.002s
error Missing onError handler for invocation 'building-schema', error was 'Error: Cannot find ObjectTypeComposer with name WpProduct'. Stacktrace was 'Error: Cannot find ObjectTypeComposer with name WpProduct
    at SchemaComposer.getOTC (/Users/andreas/code/example.com/node_modules/graphql-compose/lib/SchemaComposer.js:463:11)
    at forEach (/Users/andreas/code/example.com/node_modules/gatsby/src/schema/infer/index.js:30:37)
    at Array.forEach (<anonymous>)
    at addInferredTypes (/Users/andreas/code/example.com/node_modules/gatsby/src/schema/infer/index.js:27:13)
    at updateSchemaComposer (/Users/andreas/code/example.com/node_modules/gatsby/src/schema/schema.js:142:9)
    at buildSchema (/Users/andreas/code/example.com/node_modules/gatsby/src/schema/schema.js:62:3)
    at build (/Users/andreas/code/example.com/node_modules/gatsby/src/schema/index.js:105:18)
    at buildSchema (/Users/andreas/code/example.com/node_modules/gatsby/src/services/build-schema.ts:19:3)'
success  gatsby-source-wordpress  diff schemas - 3.372s
success  gatsby-source-wordpress  ingest WPGraphQL schema - 3.568s
success createSchemaCustomization - 3.624s

info  gatsby-source-wordpress  update user john (#3)

info  gatsby-source-wordpress  update product TITLE (#23508)

⠠ building schema

I'm running the latest  WP GraphqlQL WooCommerce extension 0.6.1 and WP GrahpQL 1.0 with gatsby-source-wordpress-experimental 3.1.3.

Hi @zamson , can you share a reproduction /graphql url as well as the output of gatsby info? Thanks!

Hey, I'm not sure I can share the graphql endpoint since it's a private project. Below is the gatsby info:
System:
    OS: macOS 10.15.7
    CPU: (4) x64 Intel(R) Core(TM) i5-7267U CPU @ 3.10GHz
    Shell: 5.7.1 - /bin/zsh
  Binaries:
    Node: 12.19.0 - ~/.nvm/versions/node/v12.19.0/bin/node
    Yarn: 1.22.10 - /usr/local/bin/yarn
    npm: 6.14.8 - ~/.nvm/versions/node/v12.19.0/bin/npm
  Languages:
    Python: 2.7.16 - /usr/bin/python
  Browsers:
    Chrome: 67.0.3396.87
    Firefox: 83.0
    Safari: 14.0
  npmPackages:
    gatsby: ^2.18.8 => 2.26.1
    gatsby-background-image: ^0.9.14 => 0.9.19
    gatsby-background-image-es5: ^0.9.12 => 0.9.19
    gatsby-cli: ^2.12.105 => 2.13.1
    gatsby-image: ^2.2.34 => 2.5.0
    gatsby-plugin-emotion: ^4.1.18 => 4.4.0
    gatsby-plugin-env-variables: ^2.0.0 => 2.0.0
    gatsby-plugin-google-tagmanager: ^2.1.25 => 2.5.0
    gatsby-plugin-layout: ^1.1.21 => 1.4.0
    gatsby-plugin-manifest: ^2.2.31 => 2.6.1
    gatsby-plugin-netlify: ^2.3.13 => 2.5.0
    gatsby-plugin-offline: ^3.0.27 => 3.4.0
    gatsby-plugin-postcss: ^2.1.18 => 2.3.13
    gatsby-plugin-react-helmet: ^3.1.16 => 3.4.0
    gatsby-plugin-react-svg: ^3.0.0 => 3.0.0
    gatsby-plugin-sass: ^2.1.26 => 2.5.1
    gatsby-plugin-sharp: ^2.3.5 => 2.8.0
    gatsby-plugin-sitemap: ^2.2.28 => 2.6.0
    gatsby-source-filesystem: ^2.1.40 => 2.5.0
    gatsby-source-graphql: ^2.8.0 => 2.8.0
    gatsby-source-wordpress-experimental: ^3.1.3 => 3.1.3
    gatsby-transformer-sharp: ^2.3.7 => 2.6.0
  npmGlobalPackages:
    gatsby-cli: 2.13.1

As for digging deeper, I also get build errors on Netlify when a variable product has been updated. Maybe it's related:
4:34:56 PM: info  gatsby-source-wordpress  A productVariation was updated, but this node type is excluded in plugin options.
4:34:57 PM: error  gatsby-source-wordpress  (undefined)
4:34:57 PM: 	 GraphQL Request must include at least one of those two parameters: "query" or "queryId"
4:34:57 PM:  Error path: undefined
4:34:57 PM:  If you haven't already, try adding define( 'GRAPHQL_DEBUG', true ); to your wp-config.php for more detailed error messages.
info  gatsby-source-wordpress  GraphQL vars: {"id":"cG9zdDoyMzUwNg=="}
4:34:57 PM: error  gatsby-source-wordpress  Error occured while updating a single "productVariation" node.

I have not excluded it in the options, just running some default options setup:
{
      resolve: `gatsby-source-wordpress-experimental`,
      options: {
        url: process.env.WP_GRAPHQL_URL,
        verbose: true,
        develop: {
          nodeUpdateInterval: 3000,
          hardCacheMediaFiles: true,
        },
        production: {
          hardCacheMediaFiles: false,
        },
        debug: {
          graphql: {
            showQueryOnError: false,
            showQueryVarsOnError: true,
            copyQueryOnError: true,
            panicOnError: true,
            // a critical error is a WPGraphQL query that returns an error and no response data. Currently WPGQL will error if we try to access private posts so if this is false it returns a lot of irrelevant errors.
            onlyReportCriticalErrors: true,
          },
        },
        excludeFieldNames: [`blocksJSON`, `saveContent`],
        type: {
          Post: {
            limit:
              process.env.NODE_ENV === `development`
                ? // Lets just pull 50 posts in development to make it easy on ourselves.
                  50
                : // and we don't actually need more than 5000 in production for this particular site
                  5000,
          },
        },
      },
    },

Hi @zamson , please update to the latest versions of WPGatsby, gatsby-source-wordpress-experimental and gatsby core. I believe this is fixed but I can't verify since I don't have access to your site.
Thanks :D

@TylerBarnes I'm experiencing the exact same error under the following circumstances:

Local dev environment with ENABLE_GATSBY_REFRESH_ENDPOINT=true enabled
"gatsby": "2.27.4",
"gatsby-source-wordpress-experimental": "^3.3.0",
WPGraphQL 1.0
WP Gatsby 0.6.7
WPGraphQL WooCommerce 0.6.1

I get this error message when I update a product and have my build hook in WPGatsby set to localhost:8000/__refresh
You have wp-admin access to one of my sanitized backends already via #312, please let me know if you'd like a minimal repo associated with this backend.

Hi @zamson , please update to the latest versions of WPGatsby, gatsby-source-wordpress-experimental and gatsby core. I believe this is fixed but I can't verify since I don't have access to your site.
Thanks :D

Great, thanks - the cached builds to netlify is now working 👍

Glad to hear that fixed it, thanks @zamson ! I'm going to close this issue but feel free to comment here or re-open the issue if you're still having problems @ardiewen .
Thanks everyone :D

Hi @TylerBarnes , unfortunately I'm still experiencing this issue.
My builds on Gatsby Cloud are not failing when using incremental builds, though any changes to the product are not updated unless I clear cache and trigger a manual rebuild. This behaviour is replicable in a local dev environment as well, as described below.
I've updated my minimal reproduction here on the woocommerce branch to demonstrate this:
https://github.com/ardiewen/gatsby-wordpress-preview-minimal/tree/woocommerce
You still have an admin account on my sanitized test backend, to which I've added:
WooCommerce v4.7.1
WPGraphQL WooCommerce v0.7.2
In addition to existing plugins:
WPGraphQL v1.0
WP Gatsby 0.6.7 (tested with "gatsby-source-wordpress-experimental": "^3.3.1", "gatsby": "^2.28.0")
WP Gatsby v0.7.2 (tested with "gatsby-source-wordpress-experimental": "^4.0.0", "gatsby": "^2.28.0")
Steps to reproduce:

clone my repo and checkout woocommerce branch
add .env.development file with

GATSBY_GRAPHQL_URL=https://mybackend/graphql
ENABLE_GATSBY_REFRESH_ENDPOINT=true

gatsby develop
ngrok http 8000 and add the url with /__refresh to the build hook
Update a product using a base post type field (e.g. name, description, etc, no custom taxonomies, ACFs or other plugins)
Click update on the product page.
See the following in my gatsby develop instance:

success  gatsby-source-wordpress  diff schemas - 0.794s
success  gatsby-source-wordpress  ingest WPGraphQL schema - 0.984s
success createSchemaCustomization - 1.067s
success  gatsby-source-wordpress  fetch root fields - 0.517s

info  gatsby-source-wordpress  update user saponettidev (#1)

info  gatsby-source-wordpress  update product Test Product (#73)

success  gatsby-source-wordpress  pull updates since last build - 1.641s
success Checking for changed pages - 0.001s
success source and transform nodes - 1.724s
error Missing onError handler for invocation 'building-schema', error was 'Error: Cannot find ObjectTypeComposer with name WpProduct'. Stacktrace was 'Error: Cannot find ObjectTypeComposer with name WpProduct
    at SchemaComposer.getOTC (/home/ardiewen/Projects/__Testing/gatsby-starter-default/node_modules/graphql-compose/lib/SchemaComposer.js:463:11)
    at forEach (/home/ardiewen/Projects/__Testing/gatsby-starter-default/node_modules/gatsby/src/schema/infer/index.js:30:37)
    at Array.forEach (<anonymous>)
    at addInferredTypes (/home/ardiewen/Projects/__Testing/gatsby-starter-default/node_modules/gatsby/src/schema/infer/index.js:27:13)
    at updateSchemaComposer (/home/ardiewen/Projects/__Testing/gatsby-starter-default/node_modules/gatsby/src/schema/schema.js:142:9)
    at buildSchema (/home/ardiewen/Projects/__Testing/gatsby-starter-default/node_modules/gatsby/src/schema/schema.js:62:3)
    at build (/home/ardiewen/Projects/__Testing/gatsby-starter-default/node_modules/gatsby/src/schema/index.js:105:18)
    at buildSchema (/home/ardiewen/Projects/__Testing/gatsby-starter-default/node_modules/gatsby/src/services/build-schema.ts:19:3)'
⠐ building schema

Output of gatsby info:
  System:
    OS: Linux 4.15 Ubuntu 18.04.2 LTS (Bionic Beaver)
    CPU: (4) x64 Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz
    Shell: 5.4.2 - /usr/bin/zsh
  Binaries:
    Node: 12.19.0 - ~/.nvm/versions/node/v12.19.0/bin/node
    Yarn: 1.22.10 - ~/Projects/__Testing/gatsby-starter-default/node_modules/.bin/yarn
    npm: 6.14.8 - ~/.nvm/versions/node/v12.19.0/bin/npm
  Languages:
    Python: 2.7.17 - /usr/bin/python
  npmPackages:
    gatsby: ^2.28.0 => 2.28.0
    gatsby-image: ^2.5.0 => 2.5.0
    gatsby-plugin-manifest: ^2.6.1 => 2.6.1
    gatsby-plugin-offline: ^3.4.0 => 3.4.0
    gatsby-plugin-react-helmet: ^3.4.0 => 3.4.0
    gatsby-plugin-sharp: ^2.8.0 => 2.8.0
    gatsby-source-filesystem: ^2.5.0 => 2.5.0
    gatsby-source-wordpress-experimental: ^4.0.0 => 4.0.0
    gatsby-transformer-sharp: ^2.6.0 => 2.6.0

Hi @TylerBarnes just wanted to follow up on this. Any chance you can confirm the reproduction and reopen this issue? Or should I open a new issue to track this? Let me know, thanks!

Hi @ardiewen , I've been busy with some things but have this on my list. Thanks for the reminder!

Hey @TylerBarnes, just wanted to follow up on this with some additional information. Looks like there's some additional work to be done on the wp-graphql-woocommerce side of things before this can be fixed.
Some additional findings:

First thing I noticed was that revisions for products are not automatically turned on. Ref wp-graphql-woocommerce #421

After turning on revisions, I tried preview again and got this error:

 ERROR

 gatsby-source-wordpress  (undefined) location: line 1, column: 56
         Unknown argument "asPreview" on field "product" of type "RootQuery".

 Error path: undefined

 If you haven't already, try adding define( 'GRAPHQL_DEBUG', true ); to your wp-config.php for more detailed error messages.

 ERROR #gatsby-source-wordpress-experimental_111002

At this point, I've confirmed the product Root Query via wp-graphql-woocommerce doesn't support the asPreview flag. This needs to be resolved and tested before we revisit this issue again on the source plugin. I guess we can close this for now, thanks.

Hey @TylerBarnes, just wanted to follow up on this with some additional information. Looks like there's some additional work to be done on the wp-graphql-woocommerce side of things before this can be fixed.
Some additional findings:

First thing I noticed was that revisions for products are not automatically turned on. Ref wp-graphql-woocommerce #421

After turning on revisions, I tried preview again and got this error:

 ERROR

 gatsby-source-wordpress  (undefined) location: line 1, column: 56
         Unknown argument "asPreview" on field "product" of type "RootQuery".

 Error path: undefined

 If you haven't already, try adding define( 'GRAPHQL_DEBUG', true ); to your wp-config.php for more detailed error messages.

 ERROR #gatsby-source-wordpress-experimental_111002

At this point, I've confirmed the product Root Query via wp-graphql-woocommerce doesn't support the asPreview flag. This needs to be resolved and tested before we revisit this issue again on the source plugin. I guess we can close this for now, thanks.

Ah, that makes sense. Thanks for the update @ardiewen and apologies on not getting back to you. I've been super busy the last couple months. I agree, lets revisit this in the future like you said 👍

Ah, that makes sense. Thanks for the update @ardiewen and apologies on not getting back to you. I've been super busy the last couple months. I agree, lets revisit this in the future like you said 👍


feature request - load config files from inside of UI

OK I have one more request I'm hoping you can implement for this wonderful app.
The way I use the app, and I imagine others would too, is I am testing various models & verifying the performance to see which gives best results.
The way I do this is create a config.yaml file for each model I use that is set up as needed.
I then created a bash script that runs the webapp with the different config files as an argument, depending on what model I want to test.
If you had this feature inside of the UI it would be extremely handy and I can see this as something other users would appreciate too.
A summary

a config file folder is defined, perhaps as an environment variable in the .env file
the app searches all .yaml files in the config folder and makes them selectable from a drop-down list on the sidebar (we can just assume the user is putting valid config yaml files in the config folder)
if a user wishes to use a load config file, they select the config file they want to change to, press a "load config" button or something to that affect, and the app will load the config inside the UI without having to exit the app and pass the config file as an argument.

This is really the only "quality of life" feature this app is missing for me, since I have about 4 different config files I switch between  because I want to test the various llms performance against my questions.
Hope this is possible!

Thanks for the suggestion, I will try to have a go at it next week!

Hi,
Please check the initial implementation here - https://github.com/snexus/llm-search/tree/feature-webapp-load-configs
This feature is simple on the surface, however, extra care should be taken with GPU memory. Since we are not exiting the app between the reloads, all objects taking the GPU memory (old configuration) have to be cleared before the new configuration can be loaded.
I've tested it with locally hosted models - it appears to be working. Caveat though - GPU memory can spike temporarily when you load a new config due to the fact that the garbage collector in Python might take a bit of time to get rid of the old object.

excellent, will do!

once again, I applaud your work and how fast you turn things around.
I did a good test by first loading a 13B model that fits easily in my 48GB of VRAM.  No problem.
Then I tried to have it load a 70B model, which uses 40GB of VRAM. Unfortunately it ran out of memory.
When I exited the program and just loaded the 70B model first without loading the 13B model, it loaded into memory fine.
For reference, this is what it looks like when I have the 70B model loaded -

You can see it almost fills my memory completely.
So this is a good test of the limits of this feature capability.
I do know this has to be solvable though.  I use other model loaders, particulary textgen-webui.
https://github.com/oobabooga/text-generation-webui
This app is designed to allow you to download & change between models at will, and it manages to have the ability to switch models without any issues.
So should be a way to pull this off, if you want to keep working at it.
Perhaps look at the textgen-webui code and see if you can gain some insights?  it's based on gradio tho and not streamlit, so it's probably tough to compare.
Anyway, I don't think this is quite ready without some additional tweaking to get the previous model out of GPU memory before loading the new one.  Hope you can try to fix it.

Also worth noting, I went from running a local llm to running GPT-4 openai, which obviously shouldn't use any video memory at all.
I watched my memory for several minutes, and it never went down.
So I think the way you currently have this implemented is not unloading the previous model at all.

I would expect my memory usage to be very low with the GPT-4 model configuration loaded.

also, when I ran the same query (same question) after switching from the local llm to GPT-4, it just repeated the exact same answer from the local llm.   It didn't re-run the query using GPT-4 to get a new response.

After closing the app, here's what my video memory looks like -

So definitely once the app is killed, the model gets unloaded from memory.

Thanks for the extensive testing, really appreciate it. Can confirm the problem - as you mentioned, it can be clearly seen when loading offline followed by an OpenAI model - the memory should drop significantly.
Will need to investigate deeper and check what oobabooga does.

Believe the memory issue is fixed at least for llama-cpp based models, hope it works for you.
If you repeat the following experiment again, please pay attention that there should be still some amount (around 1-2GB) of GPU memory used, by the embedding model.

Also worth noting, I went from running a local llm to running GPT-4 openai, which obviously shouldn't use any video memory at all.

good job! Looks like you figured out how to unload the llama models. I watched the console logs and I saw that it did indeed unload the model this time before loading the new one -

I ran a test by loading a 13B model, asking a question, then loading a 70B model.
It's okay for llama-cpp models as that's all I'm using at the moment. If you can reach the point where you want to try to get this working with other local llm loaders, feel free, but I'm happy as long as llama.cpp is working :).
However, I did find a bug when I tried to go from the 70B model to openai-

I accidentally clicked the "load" button twice and that happened.
This was just a silly mistake.  I realize that this is largely a POC application, but could you at least make it where the program won't crash if someone accidentally presses the "load" button a second time while the model is loading?  It's quite easy to accidentally double-click when you're trying to single click, which is what happened in my case.
Perhaps it's possible to make the load button unclickable until the model is fully loaded?
I did another test & checked if the program would crash or do something funny if I tried to load the same config twice, and it handled that well, so that's good :).  If you can just take care of the crash from accidentally clicking the load button twice, I think this feature will be ready to go!

I've pushed a new version, please check if it works for you. The solution isn't as elegant as I hoped it to be due to the tricky nature of Streamlit's event loop. If you are quick enough to press multiple times before the model starts to load, the loading process will stop. In that case, you might need to press the button again to load the model. The app shouldn't crash though when pressing twice or more.
As you probably noticed, there are some limitations with the Streamlit front-end. In the future, I might rewrite it in a different framework, such as Gradio or NiceGUI. Or perhaps there is an option to offload model handling to 3rd party, e.g. oobabooga via API, so can focus more on the RAG logic itself...

yeah, I do admit that offloading the handling of the models & just focusing on the RAG would probably be a good pivot to make at some point.  I'm using llama.cpp right now because your template supports it.  I think you have other model loaders but it's such a fast moving environment its hard to keep up.  I personally try to use exllama2 whenever I can (exl2 models).  Also, with the different models, you have to take into account what prompt template to use (you use an alpaca template by default, but not all model use alpaca format & you'll get bad results if u use the wrong prompt format), there's just so many factors to consider when you start dealing with local models.
But I also have to say as a pure RAG implementation, I find this application very elegant and most of all, performant.
I see the RAG space is rapidly evolving too, so a singular focus there while, as you said, offloading the model handling to something else, sounds logical.
But anyway, I don't want to sound negative.  You fixed the bug from what I can see. I clicked the "load" button multiple times as a model was loading and it didn't crash.  Your worst case scenario of having to press "load" again sounds like a rare edge case, and even then it doesn't cause the program to crash.
Thank you again for implementing my requested features.  This really does exactly what I need it to do now.  In fact, I've found that with a 70B model (synthia v1.5), I get better answers to my queries than I do using GPT-4! Quite amazing what a good local LLM enhanced with a good RAG implementation can achieve.  Keep up the good work.

Completely agree, focusing mostly on RAG will be the best way forward. I will investigate what's the best way to integrate with existing solutions to handle the local models.
Thank you for the testing and suggestions, glad you are getting value from the app.

hmmm... I tested this today and strangely, as I tried to load different models, it kept reloading the same model over and over, despite choosing different configs.  Can you please confirm if you have the same behavior?
I think perhaps when you fixed the bug with hitting the load button more than once not breaking the app, it perhaps made it where it won't switch models correctly.
I swear I tested this before, but I just used it today and I hadn't touched the code since.

Can you describe under which circumstances it is happening? I’ve used it yesterday, it was reloading it properly.
is it possible that you had multiple instances of web interface opened?

it happened by simply loading the app the same way I always had in the past.  it's possible I only quickly tested that it would didn't crash hitting the button multiple times, but never checked proper loading.
I went as far as to delete my original version of the app, pull the latest version from git, then re-build the venv and try again.  It still has the same issue with pressing the "load" button just reloads the same config file over again.
So I did another test by reverting the webapp.py file back to the version before you fixed the crashing issue.
https://github.com/snexus/llm-search/blob/05b815c7fa11781eb88c1ba2380a11a32a5c3cbf/src/llmsearch/webapp.py
When I use this version of webapp.py, I am able to properly load the files again.  It does crash if I hit the load button mid-loading, as expected, but I can properly change config files again.
So not sure why I'm having different results. Ultimately, we're using the same source files, so I can't see how it's only affecting me not you.
If not too much to ask, can you try rebuilding from the latest like I did and see if it still works for you?
In the meantime, I can see if I can troubleshoot and find the problem myself, though I may get to it tomorrow.  But I can confirm that clearing the app completely & re-building it, I still have the same problem.
Thanks again.

Thanks for the details, I will rebuild from scratch and test as you suggested.

Using a clean environment, can confirm the bug. Please test the fix in https://github.com/snexus/llm-search/tree/fix-webapp-config-reloading, will merge it to the main if it works for you.

yep, all good now!  I spent extra time doing various tests.  Trying different prompts, loading different llms, and spent some time with it making sure I covered my normal use cases.
Can't find any issues.  Thanks for the quick fix!

Hi @snexus, I'd like to re-open this one, because I found an issue.  It's one that we didn't really anticipate, but I really think it would be helpful to be added.
Right now, with this feature, you can update existing embeddings.  But let's say you're running the app for the first time and you have no embeddings yet, or you want to create a new embeddings with an updated config file, then the app will crash on start-up if it doesn't detect existing embeddings.
Could you update the code so that it checks for existing embeddings on start-up, and if it doesn't exist, then you can use the "update embeddings" button to add new embeddings based on the config file?
Not sure how much complexity adding this embeddings check would add, because you'd obviously need to disallow queries until the embeddings exist.
But the whole point of adding this feature is that you can simply install the application and run it, choose a config file and go.  No need to do an initial update embeddings command before you run the streamlit UI.  You can instead do everything you need to do from within the UI right after installing the app.
Thanks!

Good suggestion, the current approach is indeed not optimal from the UX perspective. Will try to implement it this or next week.

Please check the implementation here - https://github.com/snexus/llm-search/tree/webui-embeddings-generation
The current implementation will expose the embeddings generation only if embeddings aren't detected - in order not to clutter the UI with functionality that is used only once, at the beginning. If the user needs to recreate the index - can simply delete the embedding folder

Excellent!  I will test it today.
I actually found another bug with this implementation yesterday.  See if you can recreate it.
What I did is I have multiple config files that point to files in different subfolders.
ie a 'config-hydrogen.yaml' that ingests docs in a folder called "c:\docs\hydrogen" and another config file 'config-protein.yaml' that is set up to ingest docs in a folder called 'c:\docs\protein'.
What I noticed is that even if I ingest all the documents from both folders, once I load a configuration on start-up, let's say 'config-hydrogen', which looks for files in 'c:\docs\hydrogen', then decide to switch my configuration to 'config-protien' and send a query, the application will fail to switch the source document folder to 'c:\docs\protein', and instead run my query using the docs from the previous configuration.
I know this is not so easy to explain so I hope I didn't confuse you.  But in summary, changing configuration files inside the UI, while it does change the llm correctly, it doesn't respect changes in document path.
Can you look into this?  Even though it was difficult to explain, I have a feeling this is probably an easy fix.
But in the meantime, I will also test the update you just made too.
Thanks for being open to my suggestions!  I am now trying to deploy this for a research project which is how I'm finding all these little issues.

What I noticed is that even if I ingest all the documents from both folders, once I load a configuration on start-up, let's say 'config-hydrogen', which looks for files in 'c:\docs\hydrogen', then decide to switch my configuration to 'config-protien' and send a query, the application will fail to switch the source document folder to 'c:\docs\protein', and instead run my query using the docs from the previous configuration.

Are you pressing "Load" when selecting the second ( 'c:\docs\protein') configuration? There is no way around it - just selecting it without pressing the button won't load it automatically (it was the initial approach, but quite fragile to implement in Streamlit). Configurations are considered independent, with own settings, model etc - so have to be reloaded completely, not just pointing to a new embedding folder.

Thanks for being open to my suggestions! I am now trying to deploy this for a research project which is how I'm finding all these little issues.

No worries at all. Thanks for finding and reporting bugs, and suggesting useful features.

Yes of course, I am actually loading the configuration.  As I said, it loads fine, and it will change llms correctly, but if I search for something that should be in the protein, per the configuration, it will give me a result with a negative score and all the sources point to files from the 'hydrogen' folder, which was loaded in the previous configuration.

I recreated the bug.
Here's what I did -

loaded the config-tech.yaml file.  It the doc_path contains a user manual for a iot device.  When I loaded it, I had to update embeddings, so I updated the embeddings so the files could be added to the db. I asked a question about the document after it loaded, and it answered it just fine.

I then loaded config-protein.yaml.  I had to update the embeddings for that as well, since those files hadn't been added yet.  I then asked a question about protein, and it gave me a good answer.
I then re-loaded config-tech.yaml.  I did NOT update the embeddings again, as the embeddings should already exist from when I added them in step 1.  BUT, the doc_path should have changed, since config_tech.yaml points to c:\docs\tech directory.
I asked a question about the iot manual, and I got a negative result, and you can see even though the application shows it properly loaded the config_tech configuration file, and acknowledges the correct doc_path, it used the doc_path from the previous configuration when I ran the query, giving me a negative result.

Hope this is clear now.
I will say however, if I do choose "update embeddings" after loading the config file, then ask the same question, it will answer it correctly.  But I shouldn't need to update my embeddings every time I change my doc_path, should I?  I would only expect it be necessary to update embeddings if I actually add or modify files within the doc_path.
Here's showing a correct result after I chose update embeddings.

`cache_folder: /home/hisma/rag/cache ## specify a cache folder for embeddings models, huggingface and sentence transformers
embeddings:
embeddings_path: /home/hisma/rag/embeddings ## specify a folder where embeddings will be saved.
embedding_model: # Optional embedding model specification, default is e5-large-v2. Swap to a smaller model if out of CUDA memory
type: sentence_transformer # other supported types - "huggingface" and "instruct"
model_name: "BAAI/bge-large-en-v1.5"
splade_config: # Optional batch size of sparse embeddings. Reduced if getting out-of-memory errors on CUDA.
n_batch: 5
chunk_sizes: # Specify one more chunk size to split (querying multi-chunk results will be slower)
- 1024
document_settings:

doc_path: /mnt/c/docs/tech ## specify the docs folder
#exclude_paths: # Optional paths to exclude
#- /path/to/documents/subfolder1
#- /path/to/documents/subfolder2
scan_extensions: # specifies files extensions to scan recursively in doc_path.

pdf
#- md
#additional_parser_settings: # Optional section, don't have to include

md:
skip_first: True  # Skip first section which often contains metadata
merge_sections: False # Merge # headings if possible, can be turned on and off depending on document stucture
remove_images: True # Remove image links
passage_prefix: "passage: " # Often, specific prefix needs to be included in the source text, for embedding models to work properly
label: "tech" # Add a label to the current collection

semantic_search:
search_type: similarity # Currently, only similarity is supported
replace_output_path: # Can specify list of search/replace settings
- substring_search: "/mnt/c/" ## Specifies substring to replace  in the output path of the document
substring_replace: "C:/" ## Replaces with this string
append_suffix: # Specifies additional template to append to an output path, useful for deep linking
append_template: "#page={page}" # For example will append a page from metadata of the document parser
Will ensure that context provided to LLM is less than max_char_size. Useful for locally hosted models and limited hardware.
Reduce if out of CUDA memory.
max_char_size: 4096
query_prefix: "query: " # Often queries have to be prefixed for embedding models, such as e5
persist_response_db_path:  "/home/hisma/rag/responsedb/response.db" # optional sqlite database filename. Allows to save responses offlien to sqlite, for future analysis.
############ An example how to use OpenAI model, requires .env file with the OpenAI key
llm:
type: openai
params:
prompt_template: |
Context information is provided below. Given the context information and not prior knowledge, provide detailed answer to the question.
     ### Context:
     ---------------------
     {context}
     ---------------------

     ### Question: {question}
 model_kwargs:
   temperature: 0.2
   model_name: gpt-3.5-turbo-0301`

thats my standard config when using chatgpt.  Yes embeddings_path is consistent across both config files.
Are you suggesting that we should be creating multiple dbs?

Yes, the embedding path should be unique per config file. That's where the vector database embeddings are generated for the specific document collection. Using the same embedding_path and clicking "update" would overwrite the embeddings, which explains the behaviour.
Perhaps worth mentioning in the readme...

tested.  It worked as you suggested.  And it makes total sense that you'd want different embeddings paths for different sub-topics.
I didn't want to mix different "domains" of information, for worry of making the searches less accurate, especially as the amount of files begins to grow.
Please close this and you can merge this change.

Thanks for confirming.
By the way - in case you do need to have multiple sub-topics in the same config file (and same embeddings path) - it is already supported. You can specify multiple document paths in the config, pointing to different source folders and scan settings, as shown below:

wow I did not know about that either!  And that would make the "document collection" tag actually useful since you can filter by tag!  I always just had one per document so I didn't think the feature had any practical use.  Now it makes sense.


Melody posts blog

Just out of curiosity, did you use https://github.com/benbalter/wordpress-to-jekyll-exporter or the command line tool (or something else)? If the plugin, would :heart: any feedback you might have.


Handle unknown commands in command system

I think it should be handle by exception.
May call it UnknownCommandException


Warn user to disable Microsoft C/C++ extension if they have it enabled

Warn user to disable Microsoft C/C++ extension if they have it enabled via a notification in vscode or similar.
When both are enabled there are confusing errors, ie, goto definition gets very slow. Native code debug and clang format are available in separate extensions outside of the Microsoft C/C++ one.

What is good to bring along with this change is a clear description of how this project is different to MS C/C++ extension so that a user knows each extension's strong and weak points and could have a better idea which of two could be a better match to her needs. Could you please add something along the lines to the README? I'm not sure my request could be labeled good first issue because I think the author should know better about the differences.

I'm totally pro such a "warning" if this causes problems. But most important, the documentation should explain how to replace the Microsoft extension with something equivalent, e.g. what do I need to install to debug just as with cpptools?

You can use https://github.com/WebFreak001/code-debug. I'm not sure how well it works in comparison to cpptools.

I just did a quick test, and no, this extension is no real alternative to cpptools.
Also code formatting doesn't work anymore when disabling cpptools :-(

We should probably send a PR to cpptools then to add a setting to disable indexing.


Compress signature_or_message (iota_ransaction) in DB

signature_or_message  that is 9999999....99 should be represented as an empty string,
Also SOMETHING9...999 ->  SOMETHING
In general:
^([A-Z9][A-Z])?9  ---> capture group 1

Maybe we can omit some ending 9s in tx hashes as well ?

Not sure how much it will save, how many 9 are in average in a transaction end..

MWM / 3 so it's about 6% of the hash field


feat: improved chipper elements mapping and new title_depth metadata

Two changes:

Improved mapping of chipper element types Headline (to Title), Subheadline(to Title)  and Abstract( to NarrativeText.
New element metadata title_depth: None unless is Title (title_depth=0), Headline (title_depth=1), or Subheadline (title_depth=2). The update of title_depth happens during  the transform normalize_layout_element.

maybe a test please? 😬

The ingest-test result could be useful, I created a this PR to execute it with this PR and chipper model as default (Just for getting the results, Chipper still in beta)


Add S3 bucket sync action

One more for now — made a simple action to sync/upload a directory to an S3 bucket for deploying my own static site. Might be useful to others. 😊
Repo: https://github.com/jakejarvis/s3-sync-action
Marketplace: https://github.com/marketplace/actions/s3-sync
Thanks again!

@jakejarvis your changes have been merged, thanks for your contribution 👍


feat: notebook login

Ref #78
This PR improves the login experience in notebook-like environments (jupyter, google colab).
There are some images of the new design, attached below.
Login prompt

Authenticate in browser prompt

Success

Error

Like it! Great work!

Thanks @bwanglzu, that worked :D

Before merging, let's also modify readme here

Good catch, the Readme has been updated.


enhance and clarify secrets management

There are different possibilities and recommendations how to manage and access secrets (e.g. database passwords) inside Lambda functions (see e.g here and here).
Currently this module supports reading (optionally encrypted) parameters from AWS Systems Manager Parameter Store at runtime by creating IAM policies allowing access to and decryption of parameters by setting ssm_parameter_names and kms_key_arn. This is the recommended way for Lambda functions if the Parameter Store API limits are no concern in case of horizontal scaling.
Unfortunately kms_key_arn conflicts with the parameter specified in the Terraform Lambda ressource to specify a key that is used to encrypt environment variables.
Proposal:

create a new configuration option (e.g. ssm { parameters: [], kms_key_arn: ""}) to configure IAM policies for runtime SSM access (with custom key)
switch (optional) variable kms_key_arn to it's default meaning an pass it down to lambda submodule
(optionally) support configuration option for using AWS Secrets Manager

this is fixed with https://github.com/moritzzimmer/terraform-aws-lambda/releases/tag/v5.4.0


Could not find module ember-data imported from active-model-adapter/active-model-adapter

Im using ember-cli 2.2.0-beta.2 with active-model-adapter, but I got this error:
Uncaught Error: Could not find module `ember-data` imported from `active-model-adapter/active-model-adapter`

I've removed node_modules and bower_components and caches then reinstall again, also ember install active-model-adapter again, but still get same error, Is anyone has same issue?
using:
ActiveModelAdapter: 2.0.3
ember Data: 2.2.1
ember: 2.2.0
ember-cli: 2.2.0-beta.2
ember-cli-shims: 0.1.0
loader.js: 3.5.0
Thanks

If I am not mistaken, ember-cli-shims v0.1.0 requires ember-data v2.3.0-beta ...

@pangratz is correct. Please feel free to reopen if you are still having issues after switching ember-cli-shims to 0.1.0


Default profile list scrolls infinitely when activated via touch

Windows Terminal version
1.17.12191.0, 1.18.1462.0, 1.20.2683.0, fresh build off of main (74748394c17c168843b511dd837268445e5dfd6c)
Windows build number
10.0.23545.1000
Other Software
No response
Steps to reproduce

Load up any of the reported versions of terminal on a machine with a touch screen
Open settings any way
Tap on the Default profile dropdown with touch
Scroll with touch or mouse/keyboard

Expected Behavior
It only scrolls to end of lists
Actual Behavior
It scrolls forever looping through the list.
Repro failed on release Windows 22621, with both Terminal 1.12.10983.0 and 1.19, so this appears to be some interaction between Windows ~23545 and Terminal. It's also just this menu; haven't seen this in other WinUI dropdowns. I wasn't sure if this would be a bug on Windows or you, so erring on the side of caution.
This in action: https://www.dropbox.com/scl/fi/6hj4jcwo9d4rsrlul3x7d/ScrollMeToTheMoon.mp4?rlkey=23yd7umpgphdp9yjxa992ta9k&dl=0

Hi @reynoldsa. Thanks for the bug report. We think this is by design. In the WIP beta channel, this repros in the settings app in the display resolutions dropdown. You may want to bring this up in the OS bug tracker though.


rkt v0.7.0 doesn't work with rancher-os v0.3.3

I know that the fault here lies squarely with coreos/rkt, but there might be some workaround that would increase overall compatibility.
https://github.com/coreos/rkt/issues/1076
AFAIK Rancher OS doesn't mount cgroups at all, I used this script, but no dice. Apparently it works fine on Ubuntu 14.04 LTS, even though it doesn't have systemd.
I'd like to move to Rancher OS from CoreOS, but I'd like to keep rkt around too just in case.

@xaduha We are releasing v0.4 very soon and this should be fixed.  What is the rkt command you were trying so I can reproduce?

@xaduha I just tried and got the following error on a beta build of v0.4
sudo ./rkt --insecure-skip-verify run coreos.com/etcd:v2.0.4
rkt: searching for app image coreos.com/etcd:v2.0.4
rkt: found image in local store, skipping fetching from https://github.com/coreos/etcd/releases/download/v2.0.4/etcd-v2.0.4-linux-amd64.aci
2015/08/13 22:27:03 Preparing stage1
2015/08/13 22:27:03 Loading image sha512-1eba37d9b344b33d272181e176da111ef2fdd4958b88ba4071e56db9ac07cf62
2015/08/13 22:27:03 Writing pod manifest
2015/08/13 22:27:03 Setting up stage1
2015/08/13 22:27:03 Writing image manifest
2015/08/13 22:27:03 Wrote filesystem to /var/lib/rkt/pods/run/f515fbe7-6167-450d-86d5-8ad932f49e33
2015/08/13 22:27:03 Writing image manifest
2015/08/13 22:27:03 Pivoting to filesystem /var/lib/rkt/pods/run/f515fbe7-6167-450d-86d5-8ad932f49e33
2015/08/13 22:27:03 Execing /init
2015/08/13 22:27:03 Put http://unixsock/pods/f515fbe7-6167-450d-86d5-8ad932f49e33?token=a79eb36f22ae53a0580f8d1256be3134: dial unix /run/rkt/metadata-svc.sock: no such file or directory
2015/08/13 22:27:04 Put http://unixsock/pods/f515fbe7-6167-450d-86d5-8ad932f49e33?token=a79eb36f22ae53a0580f8d1256be3134: dial unix /run/rkt/metadata-svc.sock: no such file or directory
2015/08/13 22:27:05 Put http://unixsock/pods/f515fbe7-6167-450d-86d5-8ad932f49e33?token=a79eb36f22ae53a0580f8d1256be3134: dial unix /run/rkt/metadata-svc.sock: no such file or directory
2015/08/13 22:27:06 failed to register the pod: failed to register pod with metadata svc: could not reach the metadata service.
Make sure metadata service is currently running.
For more information on running metadata service,
see https://github.com/coreos/rkt/blob/master/Documentation/metadata-service.md

I forgot to run the metadata service so after starting that I get the following
sudo ./rkt --insecure-skip-verify run coreos.com/etcd:v2.0.4
rkt: searching for app image coreos.com/etcd:v2.0.4
rkt: found image in local store, skipping fetching from https://github.com/coreos/etcd/releases/download/v2.0.4/etcd-v2.0.4-linux-amd64.aci
2015/08/13 22:37:58 Preparing stage1
2015/08/13 22:37:58 Loading image sha512-1eba37d9b344b33d272181e176da111ef2fdd4958b88ba4071e56db9ac07cf62
2015/08/13 22:37:58 Writing pod manifest
2015/08/13 22:37:58 Setting up stage1
2015/08/13 22:37:58 Writing image manifest
2015/08/13 22:37:58 Wrote filesystem to /var/lib/rkt/pods/run/e7b7c92b-780c-4db5-bf1f-ef302b4050f1
2015/08/13 22:37:58 Writing image manifest
2015/08/13 22:37:58 Pivoting to filesystem /var/lib/rkt/pods/run/e7b7c92b-780c-4db5-bf1f-ef302b4050f1
2015/08/13 22:37:58 Execing /init
2015/08/13 22:37:58 PUT /pods/e7b7c92b-780c-4db5-bf1f-ef302b4050f1?token=7749763cda49da0fcdb9a4d8dbc5b2d4 - 200
2015/08/13 22:37:58 PUT /pods/e7b7c92b-780c-4db5-bf1f-ef302b4050f1/etcd - 200
Continuing with per-app isolators disabled: could not get own cgroup path: controller "name=systemd" not found

Okay, I got a bit further.  Still no dice, but fun none the less.  (Not all of this is done on a beta build of RancherOS, so probably will be different on 0.3.3)
rkt binaries are not fully static so they required glibc.  So you need to switch to the ubuntu/debian console.  Our default console doesn't have glibc.
sudo ros service enable ubuntu-console; sudo reboot
After reboot setup the name=systemd cgroup.
sudo mkdir /sys/fs/cgroup/systemd
sudo mount -t cgroup -o none,name=systemd cgroup /sys/fs/cgroup/systemd

Now run rkt
sudo ./rkt --insecure-skip-verify run coreos.com/etcd:v2.0.4
rkt: searching for app image coreos.com/etcd:v2.0.4
rkt: found image in local store, skipping fetching from https://github.com/coreos/etcd/releases/download/v2.0.4/etcd-v2.0.4-linux-amd64.aci
2015/08/14 03:19:21 Preparing stage1
2015/08/14 03:19:21 Loading image sha512-1eba37d9b344b33d272181e176da111ef2fdd4958b88ba4071e56db9ac07cf62
2015/08/14 03:19:21 Writing pod manifest
2015/08/14 03:19:21 Setting up stage1
2015/08/14 03:19:21 Writing image manifest
2015/08/14 03:19:21 Wrote filesystem to /var/lib/rkt/pods/run/2d8ad055-588c-4fc3-85a4-ca47c331b6a2
2015/08/14 03:19:21 Writing image manifest
2015/08/14 03:19:21 Pivoting to filesystem /var/lib/rkt/pods/run/2d8ad055-588c-4fc3-85a4-ca47c331b6a2
2015/08/14 03:19:21 Execing /init
[!!!!!!] Failed to allocate manager object, freezing.

I got it working.  So first you probably need to be running v0.4, not totally sure, but if you have ubuntu console running the following should get you going.
sudo mkdir /sys/fs/cgroup/systemd
sudo mount -t cgroup -o none,name=systemd cgroup /sys/fs/cgroup/systemd
sudo mkdir /sys/fs/cgroup/systemd/user
sudo echo $$ | sudo tee /sys/fs/cgroup/systemd/user/cgroup.procs

sudo ./rkt metadata-service &
sudo ./rkt --insecure-skip-verify run coreos.com/etcd:v2.0.4

Sounds ironic, but I'll probably create a docker run rkt if it doesn't exist :smile:  Just too hard to pass up that inception.

v0.4 will most likely have out of the box support for rkt.  I'll put in a PR today.  I can't say that we will actively test this going forward, but the blocking issues I see now I can fix in RancherOS.

Looking forward to it!
I tried it on rancher-os v0.4.0-rc1, I guess it sort of works, but not quite. Both rkt v0.7.0 and v0.8.0-rc1.
For that etcd image I have "Failed to allocate manager object, freezing" error, but
sudo ./rkt list

shows it as running and
sudo ./rkt enter <id> /etcd

launches etcd just fine.

Adding --debug=true using rkt v0.8.0-rc1 yeilds
Failed to install release agent, ignoring: Read-only file system
Failed to create root cgroup hierarchy: Read-only file system
Failed to allocate manager object: Read-only file system

I guess I have a Read-only filesystem. I'm booting rancher-os using gummiboot, but I have RANCHER_STATE disk though. I tried installing using v0.4.0-rc1 rancheros-install script, but even though is reports success, it doesn't work for me. I'll try installing v0.3.3 and then switching vmlinuz and initrd for v0.4.0-rc1.

Some more info: https://github.com/coreos/rkt/issues/1076#issuecomment-134170218

@ibuildthecloud
rkt v0.8.0 works with rancher-os v0.4.0-rc1 with that workaround, but not with rc2 and rc3. "error rendering overlay filesystem", empty and not accessible manifest file.
$ cat manifest
cat: manifest: No such device or address

@xaduha each RC we've been changing a huge amount.  By the time we release expect rkt to work unmodified in an Ubuntu/Debian console.

Thanks @ibuildthecloud for the workaround you provided, that fixed it for me on Ubuntu 14.04.03 LTS

Fixed upstream.

@xaduha if you run the latest v0.4 RC rkt 0.8 works out of the box too.  But I'm glad this was fixed upstream too.


Update pip to 24.1.2

Close #207, attempting to reproduce it

Hello @damnever! Thanks for opening this PR. We checked the lines you've touched for PEP 8 issues, and found:

In the file pigar/_vendor/pip/_vendor/requests/packages.py:

Line 16:80: E501 line too long (107 > 79 characters)


Subclassing API model doesn't work when calling first then fitting

System information

Have I written custom code (as opposed to using example directory):  yes
OS Platform and Distribution (e.g., Linux Ubuntu 16.04):  Ubuntu 16.04
TensorFlow backend (yes / no):  yes
TensorFlow version:  1.14.0 (gpu)
Keras version:  2.2.4
Python version:  3.6.8
CUDA/cuDNN version:  V10.0.130
GPU model and memory:  Quadro P5000 (16GB)

Describe the current behavior
So the problem when calling the model first, is that it builds it (using Layer's build), but doesn't set the outputs. Therefore, when assigning the loss function, the model thinks it's already built, but doesn't have outputs.
In most cases it works, because when the model is not built during a call to fit, which in turns call _standardize_user_data, _set_inputs is called which assigns the outputs..
Describe the expected behavior
I think the inputs should be set regardless of whether the model was built before. But I am not familiar at all with the overall complex behaviours of models, so I don't know if it makes sense or not, and why _set_inputs is only called if the model is not built.
Code to reproduce the issue
Using the vanilla subclassing example from the docs:
import keras

class SimpleMLP(keras.Model):

    def __init__(self, use_bn=False, use_dp=False, num_classes=10):
        super(SimpleMLP, self).__init__(name='mlp')
        self.use_bn = use_bn
        self.use_dp = use_dp
        self.num_classes = num_classes

        self.dense1 = keras.layers.Dense(32, activation='relu')
        self.dense2 = keras.layers.Dense(num_classes, activation='softmax')
        if self.use_dp:
            self.dp = keras.layers.Dropout(0.5)
        if self.use_bn:
            self.bn = keras.layers.BatchNormalization(axis=-1)

    def compute_output_shape(self, input_shape):
        return [input_shape[0], self.num_classes]

    def call(self, inputs):
        x = self.dense1(inputs)
        if self.use_dp:
            x = self.dp(x)
        if self.use_bn:
            x = self.bn(x)
        return self.dense2(x)

model = SimpleMLP()
model.compile(optimizer='adam', loss='mean_absolute_error',)
model(tf.convert_to_tensor(np.random.rand(36, 512).astype('float32')))
model.fit(x=np.random.rand(36, 512), y=np.random.rand(36, 10))

Other info / logs
---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
<ipython-input-5-7886f253e840> in <module>
     30 model.compile(optimizer='adam', loss='mean_absolute_error',)
     31 model(tf.convert_to_tensor(np.random.rand(36, 512).astype('float32')))
---> 32 model.fit(x=np.random.rand(36, 512), y=np.random.rand(36, 10))

~/workspace/keras/keras/engine/training.py in fit(self, x, y, batch_size, epochs, verbose, callbacks, validation_split, validation_data, shuffle, class_weight, sample_weight, initial_epoch, steps_per_epoch, validation_steps, validation_freq, max_queue_size, workers, use_multiprocessing, **kwargs)
   1090             sample_weight=sample_weight,
   1091             class_weight=class_weight,
-> 1092             batch_size=batch_size)
   1093
   1094         # Prepare validation data.

~/workspace/keras/keras/engine/training.py in _standardize_user_data(self, x, y, sample_weight, class_weight, check_array_lengths, batch_size)
    728                              metrics=self.metrics,
    729                              loss_weights=self.loss_weights,
--> 730                              target_tensors=target_tensors)
    731
    732         # If `x` and `y` were all symbolic,

~/workspace/keras/keras/engine/training.py in compile(self, optimizer, loss, metrics, loss_weights, sample_weight_mode, weighted_metrics, target_tensors, **kwargs)
    141         else:
    142             import pdb; pdb.set_trace()
--> 143             loss_function = losses.get(loss)
    144             loss_functions = [loss_function for _ in range(len(self.outputs))]
    145         self.loss_functions = loss_functions

TypeError: object of type 'NoneType' has no len()

I suggest to rebuild the model with
Keras Sequential model
or
Keras functional API.


cherry-pick fix encryption_function return wrong result at const column (#40201)

Proposed changes
cherry-pick from master #40201
the string object have error of order, should be src, key,iv,mode

run buildall