Invitations for Facebook and GMail provider - also includes Firefox updates for jpm

Invitations for Facebook and GMail provider - also includes Firefox updates for jpm.
Invitation changes should only affect the dev build of uProxy.  Note that I've updated package.json to use freedom-social-firebase - in order to do the dist build of uProxy, this should be changed back to ^1.0.4, only for the next week, to get the non-invite version of the Facebook social provider.
Design doc: https://docs.google.com/document/d/1zNQwknYvgmu_139avo3CHd-9_7Xfzw5S-LkjOxAqGcE/edit#
I'm hoping to get this merged today so we can start merging GitHub as well.  There are a number of unfinished items here, which I am entering separate issues for, these will be fixed in the upcoming week:
#1901 - Move NETWORK_OPTIONS into file shared by core + UI
#1902 - Network select dropdown in invitation screen should not include networks which don't support invitations
#1903 - Translate new invite screens and webpages
#1907 - Cleanup "social2" API, merge into freedom
#1908 - Restyle invite screens

a few small changes! yay!

Reviewed 3 of 37 files at r2, 2 of 16 files at r3, 8 of 22 files at r4.
Review status: 13 of 34 files reviewed at latest revision, 10 unresolved discussions, some commit checks pending.

src/chrome/extension/invite-received.html, line 5 [r4] (raw file):
typo: successful

src/firefox/package.json, line 4 [r4] (raw file):
also for jpm change?

src/generic_core/uproxy_core.ts, line 305 [r4] (raw file):
can we change this to always being the token if we edit addUserWithConfirmation_ inside ui.ts to pass it's local "token" variable instead of the "url" parameter?n

src/generic_ui/polymer/invite-user.ts, line 10 [r4] (raw file):
was this resolved?

src/generic_ui/polymer/invite-user.ts, line 59 [r4] (raw file):
did we want to keep this log and todo?

src/generic_ui/polymer/invite-user.ts, line 67 [r4] (raw file):
commented code can be removed?

src/generic_ui/polymer/root.html, line 312 [r4] (raw file):
could you move the styling with the CSS at the top of the file?

src/generic_ui/polymer/root.html, line 369 [r4] (raw file):
I think we wan't to keep this as uproxy-button

src/interfaces/social2.ts, line 101 [r4] (raw file):
why is the ignored param needed?

Comments from the review on Reviewable.io

Review status: 13 of 34 files reviewed at latest revision, 6 unresolved discussions, all commit checks successful.

src/firefox/package.json, line 4 [r4] (raw file):
Yup, I copied these changes from  the uproxy-lib ones, https://github.com/uProxy/uproxy-lib/pull/254, but we might need to revisit this next Monday if there are issues publishing to the FF store

src/generic_core/uproxy_core.ts, line 305 [r4] (raw file):
this isn't just invoked from addUserWithConfirmation, it's also called from the addUser method in accept-user-invite.ts.  That file just passes in the user input, without checking to see if it has the URL prefix.  I think it's best to support both URLs and tokens here, that way it can be called from multiple places and we don't have to worry as much whether it's being passed the URL or just the token.

src/generic_ui/polymer/invite-user.ts, line 10 [r4] (raw file):
Yup, removing

src/generic_ui/polymer/invite-user.ts, line 59 [r4] (raw file):
Nope, just removed

src/generic_ui/polymer/invite-user.ts, line 67 [r4] (raw file):
Yup

src/interfaces/social2.ts, line 101 [r4] (raw file):
The parameter is used by GitHub (where it should be the GitHub user id), but is ignored for Facebook+GMail providers.  I'll rename it to optionalUserId.
There is more discussion on this in https://docs.google.com/document/d/1ZUZ5RweM8HuWkfbVaR095YVolKnx8E1zqxNJwWDq8lQ/edit#

Comments from the review on Reviewable.io

:+1:

Review status: 12 of 34 files reviewed at latest revision, 1 unresolved discussion, all commit checks successful.

src/generic_core/uproxy_core.ts, line 305 [r4] (raw file):
agreed sounds good!

Comments from the review on Reviewable.io


Load pdf file failed with version 3.1.0-beta.1

When I update to 3.1.0-beta.1 from 3.0.0-beta.5, I cannot open pdf file.
And OnErrorListener called:
java.lang.UnsatisfiedLinkError: No implementation found for long com.shockwave.pdfium.PdfiumCore.nativeOpenDocument(int, java.lang.String) (tried Java_com_shockwave_pdfium_PdfiumCore_nativeOpenDocument and Java_com_shockwave_pdfium_PdfiumCore_nativeOpenDocument__ILjava_lang_String_2)

i get this crash too ,how to fix it??

Rollback the version to 3.0.0-beta.5

tks ,find you   local library pdfium-android-1.9.0.arr,copy armeabi-v7a dir and rename to armeabi,you can have a try,also thank you

@chengww5217  have you fixed the issue? I'm facing the same issue

I've tried again. It works!!!  Wow, (≧▽≦)/ amazing.
There is a little bit different. I got the .so files from the local disk already downloaded by gradle.
@zzzykf
You can get the local path from the Project tree in the window left from the Android Studio.
Then open the External Libraries card.

Right click on Gradle: com.github.barteksc:pdfium-android-1.9.0 , and choose Library Properties. That is the local path of the .aar file.

Thank you for your advice.
Unfortunately, it doesn't work. I download the .arr file here. And unzip it, copy the .so files in folder
armeabi-v7a to the armeabi folder whose parent is jniLibs of my project.
Run on Mi 6(armeabi device), not display, same exception occurd.
Maybe I should take some time to read the origin codes to fix it myself.

@chengww5217 谢啦，不过要注意是 复制aar文件下面的jni文件夹下面的armeabi文件夹，外面的文件夹不行。。。
and thanks @Krystal1220

@chengww5217 谢啦，不过要注意是 复制aar文件下面的jni文件夹下面的armeabi文件夹，外面的文件夹不行。。。 and thanks @Krystal1220

为什么是这个原因？改了下这样确实好了


Fix Engine container permissions to work w/ master

This gets the Engine pod past "Read only fs" failure on master commits
equal to and after 0919214bf5595bd735583cdd60234c9613663e35.
Signed-off-by: Daniel Farrell<EMAIL_ADDRESS>

I verified this deploys submariner-pod successfully with latest master as the base. There is still a failure on Routeagent pod, but that's related to /host mount and a different issue.


Add Terraform Template language

Description

Closes #6562
I added Terraform Template as a new markup language.  Terraform template files are used to automatically add syntax when given a set of arguments in Terraform.  See the Terraform documentation page for more information.
Checklist:

[x] I am adding a new language.

[x] The extension of the new language is used in hundreds of repositories on GitHub.com.

Search results for each extension:

~1.8k search results for the single extension: .tftpl

[x] I have included a real-world usage sample for all extensions added in this PR:

Sample source(s):

donors.tftpl
os_alpine_3_17_userdata.tftpl (removed in 7ce7db667ca41f60d02e6fa97c6b4ac46d7495bc)
policy.tftpl

Sample license(s):

Apache 2.0
Apache 2.0
MIT

[x] I have included a syntax highlighting grammar (uses MPL 2.0)

[x] I have added a color

Hex value: #7B42BB
Rationale: It is one of the purples Hashicorp, the developers of Terraform, officially use for it. The purple in use for the Terraform (AKA "HCL") language is the other purple.  It is similar, but noticeably brighter.  They have these two official purples listed on in their brand page for Terraform.

[ ] I have updated the heuristics to distinguish my language from others using the same extension.

No other languages use .tftpl, so there is no need.

Misc. Note:
I did list the Terraform Template Language in the HCL group. (HCL is the primary alias for Terraform).  This will count it as HCL instead of its own language.  I think this is appropriate, but I'm  not 100% sure.  I'm also not sure if that dismisses the need for a color choice.

Please address the test failed. My comment inline will deal with the interpreter/shell failures.

I removed the sample, ran the tests locally (they passed), and pushed. Sorry, I am kind of new to this, but should I resolve the conflicts in .gitmodules or will that be addressed when you merge?

It's best if you do it

Sorry about the noise. Something really went awry with the submodules and cached licenses which took a while to get right, but we should be good to go now. CI should pass now 🤞

Sorry about the noise. Something really went awry with the submodules and cached licenses which took a while to get right, but we should be good to go now. CI should pass now 🤞

All good.  Very nice to see.


VSCode does not open from command line on Linux

Issue Type: Bug
I have VSCode installed on Debian Stretch, but when I try to open from the command line via code, it silently fails. I get a new prompt, and nothing happens. I've installed the most recent version from your website.
VS Code version: Code 1.24.1 (24f62626b222e9a8313213fb64b10d741a326288, 2018-06-13T17:47:35.732Z)
OS version: Linux x64 4.14.43-05062-g1048e72698de

System Info

Item
Value

CPUs
06/8e (4 x 1607)

GPU Status
2d_canvas: unavailable_softwareflash_3d: unavailable_softwareflash_stage3d: unavailable_softwareflash_stage3d_baseline: unavailable_softwaregpu_compositing: unavailable_softwaremultiple_raster_threads: unavailable_offnative_gpu_memory_buffers: disabled_softwarerasterization: unavailable_softwarevideo_decode: unavailable_softwarevideo_encode: unavailable_softwarevpx_decode: unavailable_softwarewebgl: unavailable_offwebgl2: unavailable_off

Load (avg)
0, 0, 0

Memory (System)
4.84GB (3.97GB free)

Process Argv
/usr/share/code/code --unity-launch

Screen Reader
no

VM
100%

Extensions (6)

Extension
Author (truncated)
Version

gitlens
eam
8.3.5

vsc-material-theme
Equ
2.1.0

nbpreviewer
jit
1.0.0

python
ms-
2018.5.0

material-icon-theme
PKi
3.5.0

sas
Vac
0.1.2

(1 theme extensions excluded)

This appears to be a zsh issue, not vscode. Closing.


Expose ptrace-related hardening of containers in LinuxContainerSecurityContext

One mechanism to harden a container from its neighbors is to set PR_SET_DUMPABLE to 0. This makes it so that even if the yama scope is setup to be widely accessible, it is not possible to ptrace it (or poke at it's /proc too much) from other sibling processes.
It is difficult to "get this right" in container code, as there's a race between the time the container starts and you call the prctl. In the interim period, ptrace could have been called, and parasitic code could be injected. Therefore, this needs the assistance of the container runtime.

cc @justincormack @thaJeztah

To get this exposed in CRI it would have to be defined in OCI first I would think.

@justincormack what would be the closest equivalent field in the OCI (runtime spec?)

No new privileges, which is another prctl flag is set in Linux specific process flags https://github.com/opencontainers/runtime-spec/blob/39c287c415bf86fb5b7506528d471db5405f8ca8/config.md#linux-process which makes some sense, so adding another boolean for dumpable here seems reasonable (although perhaps inverted for compat, so it is "undumpable" so empty does not change behaviour?)

Got it. looks like we pass that through to runc here:
https://github.com/containerd/cri/blob/9d37687a9569775b0bf38fe478ba1a3557b9496c/pkg/server/container_create_unix.go#L190-L192
and runc actually calls Prctl:
https://github.com/opencontainers/runc/blob/master/libcontainer/setns_init_linux.go#L61


Untitled buffers don't save language state

This is a pretty common usage scenario for me as I open a temporary tab in language repos to test out changes that I make:

Open a new untitled buffer
Set the language to anything other than Plain Text (eg Java)
write some text
Reload Atom

Expected: Language is still Java
Actual: Language is reset to Plain Text
Atom 1.4.0-dev-77a5409 non safe-mode, Windows 10 x64
/cc @as-cii

Thanks, @50Wliu!
@atom/feedback: thoughts?

I agree, untitled buffers should save the language state.

Yup, I agree too :+1:

Yup, definitely on board with this :+1:


(Re) Support the feature to move next on click outside the element

Hello,
I found this closed issue from 2018 that allows the developer using driver.js to allow clicks outside of the current highlighted element to go to the next step, and was used in my project. However, I've noticed that this option is not available anymore, or I cannot find how to get the same behavious. Would it be possible to re add it ?

Here is my current workaround:
const driverObj = driver({
  steps: [
    {
      element: '#my_elem',
      popover: {
        title: 'Step 1',
        description: 'This is the first step',
        onCloseClick: () => {
          driverObj.destroy();
        },
      },
    },
    {
      element: '#my_elem',
      popover: {
        title: 'Step 2',
        description: 'This is the second step',
        onCloseClick: () => {
          driverObj.destroy();
        },
      },
    },
  ],
  onDestroyStarted: () => {
    if (driverObj.hasNextStep()) driverObj.moveNext();
    else driverObj.destroy();
  },
});


update_topic does not work?

python 3.11
pydiscourse latest 1.6.1
from pydiscourse import DiscourseClient

client = DiscourseClient(
  'https://www.mydomain.com',
  api_username='admin',
  api_key='alsdjfaldjfajdfajds;fjalsdf')

# update a post, it works
post_id = 23232
new_content = "something to change"
client.update_post(post_id, new_content, edit_reason="")

# exception here
topic_url = "https://www.mydomain.com/t/2427.json"
client.update_topic(topic_url, "new title")

exception as below.
>>> client.update_topic(topic_url, "title")
Traceback (most recent call last):
  File "/opt/homebrew/lib/python3.11/site-packages/urllib3/connection.py", line 203, in _new_conn
    sock = connection.create_connection(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/urllib3/util/connection.py", line 60, in create_connection
    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File<EMAIL_ADDRESS>line 962, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
socket.gaierror: [Errno 8] nodename nor servname provided, or not known

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/opt/homebrew/lib/python3.11/site-packages/urllib3/connectionpool.py", line 790, in urlopen
    response = self._make_request(
               ^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/urllib3/connectionpool.py", line 491, in _make_request
    raise new_e
  File "/opt/homebrew/lib/python3.11/site-packages/urllib3/connectionpool.py", line 467, in _make_request
    self._validate_conn(conn)
  File "/opt/homebrew/lib/python3.11/site-packages/urllib3/connectionpool.py", line 1092, in _validate_conn
    conn.connect()
  File "/opt/homebrew/lib/python3.11/site-packages/urllib3/connection.py", line 611, in connect
    self.sock = sock = self._new_conn()
                       ^^^^^^^^^^^^^^^^
  File "/opt/homebrew/lib/python3.11/site-packages/urllib3/connection.py", line 210, in _new_conn
    raise NameResolutionError(self.host, self, e) from e
urllib3.exceptions.NameResolutionError: <urllib3.connection.HTTPSConnection object at 0x101c527d0>: Failed to resolve 'www.mydomain.comhttps' ([Errno 8] nodename nor servname provided, or not known)

seems, it complains about the server name, but the url is correct.  it works fine if call it with request directly as below.
# update the topic title with requests, it works
topic_url = "https://www.mydomain.com/t/2427.json"
headers = {
    'Api-Key': 'asdfasdfasdfasdfadfa',
    'Api-Username': 'admin'
}
payload = {
    'title': "new title"
}
# Send the PUT request to update the topic title
response = requests.put(topic_url, headers=headers, json=payload)
if response.status_code == 200:
    print('Topic title updated successfully.')

I don't have time to debug in detail right now but this line looks like it might hold a clue
urllib3.exceptions.NameResolutionError: <urllib3.connection.HTTPSConnection object at 0x101c527d0>: Failed to resolve 'www.mydomain.comhttps' ([Errno 8] nodename nor servname provided, or not known)

Specifically 'www.mydomain.comhttps'  appears to have https in the wrong place. I'm not sure how that could happen :|


Add support for Swift 5.6 package description format

Starting with Swift 5.6 swift package dump-package outputs JSON in format that's incompatible with Swift 5.5 declarations. Ideally, we should be able to support both Swift 5.5 and 5.6 package description formats in carton.

Is this something I can help with? It sounds like it is just a matter of adapting the decoding of DumpedManifest here for changes to the encoding of Manifest here. Or am I missing something? (I am also not very familiar with your testing arrangement.)

That's largely correct, but I personally would like 5.5 and earlier Swift versions to be supported as well. One possible approach would be to keep these as separate model types, say DumpedManifest_v5_5 and DumpedManifest_v5_6 and decode into these conditionally, based on the detected toolchain version.

I will give it a shot. I am new to your code base though, and probably not as fast as someone more familiar with it. So if it is already on someone’s to‐do list, then feel free to race ahead and not wait for me.

This is not as easy as I thought. For one, SwiftPM needs to be updated, because the Manifest type you are using is unable to represent everything dumped by 5.6. But some of its new component types are neither Decodable nor have public initializers. I think you need to roll you own Manifest type, but if you need it to interact with other SwiftPM APIs, then...


Unable to add local drives on a remote ubuntu server

Hi @negative0
I'm running your webui in a docker container with an rclone mount on Ubuntu.
It's works perfectly, apart from the fact I can't work out how to add a local drive in explorer. When I've used it on Windows machines it was as simple as adding the drive letter, however I have no idea how to do the same on Ubuntu.
I have volumes mounted in the container, so they should be accessible, but I'm just not sure how to find them.
This is my docker script:
docker run --restart=always --name rclone -p 5572:5572  -e UMASK_SET=002 -e PUID=1001 -e PGID=1001  -v /home/craftyclown/.config/Docker/Rclone/config:/config/rclone -v /home/craftyclown/.config/Docker/Rclone/logs:/logs -v /mnt/crafty:/mnt/crafty:shared -v /etc/passwd:/etc/passwd:ro -v /etc/group:/etc/group:ro --device /dev/fuse --cap-add SYS_ADMIN --security-opt apparmor:unconfined rclone/rclone:latest mount "RichFlixCrypt:/Encrypted/" /mnt/crafty/Skull --allow-other --dir-cache-time 1000h --log-level INFO --log-file /logs/Plex_Mount.log --poll-interval 15s --timeout 1h --umask 002 --cache-dir=/mnt/crafty/rclone_cache --vfs-cache-mode full --vfs-cache-max-size 500G --vfs-cache-max-age 336h --uid 1001 --gid 1001 --tpslimit 3  --bwlimit-file 20M --rc --rc-addr :5572 --rc-web-gui --rc-user craftyclown --rc-pass ????
any help would be greatly appreciated

In the file explorer, it hard to access local files in linux. On ubuntu, you can add a configuration and SSH yourself as a quick fix.  At least I don't know any other solution.


Lamar Integration

I'm trying to convert MassTransit.StructureMapIntegration to use Lamar (https://jasperfx.github.io/lamar) - I've got it all done, but the StateMachineSaga_Specs fails on a stackoverflow trying to resolve the TestStateMachineSaga using SagaStateMachine - just wondered if anyone had any insight to this.
Lamar is the new StructureMap - and doesn't have a .Forward anymore so I guess I'm trying to replicate that behaviour?!

Posting the code would help, otherwise it's a random shot in the dark. Are you going to make it a separate package (Lamar) for MassTransit?

Yeah exactly, so a new MassTransit.LamarIntegration package. I've narrowed it down to the injection of the ConsumeContext - Lamar doesn't have the concept of configuring nested containers, so I'm using the _.Injectable methods - but that doesn't work with generics...
Head - Wall
`public static void AddMasstransit(this ServiceRegistry serviceRegistry)
{
serviceRegistry.Injectable();
serviceRegistry.Injectable();
}
    internal static IContainer GetNestedContainer(this IContainer container, ConsumeContext context)
    {
        var nestedContainer = container.GetNestedContainer();
        nestedContainer.Inject(new LamarActivityFactory());
        nestedContainer.Inject(context);

        return nestedContainer;
    }

    internal static IContainer GetNestedContainer<T>(this IContainer container, ConsumeContext<T> context) where T : class
    {
        var nestedContainer = container.GetNestedContainer();
        nestedContainer.Inject(new LamarActivityFactory());
        nestedContainer.Inject(context);

        return nestedContainer;
    }`

Perhaps inject consumeContext with all supported interfaces? That way the proper resolution is there? ConsumeContext, IPublishEndpoint, ISendEndpointProvider, etc.?

Ok I've got it working using a technique Jeremy expressly asked me not to use, however it works, so I'll talk to him once he's back from his vacation on how he'd rather we go about it.
I've raised an issue on Lamar surrounding it here: https://github.com/JasperFx/lamar/issues/55
Code I've used is:
public static void AddMasstransit(this ServiceRegistry serviceRegistry)
{
    serviceRegistry.Injectable<LamarActivityFactory>();
    serviceRegistry.Injectable<ConsumeContext>();
}

internal static IContainer GetNestedContainer(this IContainer container, ConsumeContext context)
{
    var nestedContainer = container.GetNestedContainer();
    nestedContainer.Inject(LamarActivityFactory.Instance);
    nestedContainer.Inject(context);

    return nestedContainer;
}

internal static IContainer GetNestedContainer<T>(this IContainer container, ConsumeContext<T> context) where T : class
{
    var nestedContainer = container.GetNestedContainer();
    nestedContainer.Inject(LamarActivityFactory.Instance);

    nestedContainer.Configure(cfg =>
    {
        cfg.AddScoped(typeof(ConsumeContext), provider => context);
        cfg.AddScoped(typeof(ConsumeContext<T>), provider => context);
    });

    return nestedContainer;
}

PR!!
https://github.com/MassTransit/MassTransit/pull/1146

Replacement PR!!!
https://github.com/MassTransit/MassTransit/pull/1147

Right on. Will pull in shortly.


That's all Bard can answer right now. It's experimental. Try back later.

Hi, there:
I encountered the response error using bardapi to ask_about_image:
"Response Error: b')]}\\'\\n\\n38\\n[[\"wrb.fr\",null,null,null,null,[8]]]\\n54\\n[[\"di\",59],[\"af.httprm\",59,\"4239016509367430469\",0]]\\n25\\n[[\"e\",4,null,null,129]]\\n'. \nTemporarily unavailable due to traffic or an error in cookie values. Please double-check the cookie values and verify your network environment."
Then I tried again the Bard UI, and got this warning message.
Is anyone seeing this warning message? And what can we do about it?

upgrade package to the dev version, it's been fixed #125

Use dev version until update pypi version.
$ pip install git+https://github.com/dsdanielpark/Bard-API.git

pip install -U git+https://github.com/dsdanielpark/Bard-API.git

Successfully upade at 23.07.22
Release note: https://github.com/dsdanielpark/Bard-API/releases/edit/0.1.28
0.1.28
$ pip install bardapi==0.1.28

It may not work as it is only available for certain accounts, regions, and other restrictions.

Contributor: senseibence, yihong0618
PR Index: #121 #125 #130
Build Git Hash: 1284b5c6ac6afc7efccff632f1f6c72f1d348b9c

Forced header to "start" to allow multiple image uploads to URL #121
API changed related to Ask About Image method #125
Delete error message that can confuse users. #130

There could be various reasons for the recurring issue.
It is not a Bard-API package code error, I have conducted regular QA and CI for functionality.
This error is due to abnormal responses from Google's internal interfaces, such as regional/account/rate limiting policies. Therefore, it cannot be resolved within this package, and you may need to check the root cause in different environments.
You can try logging out or renewing cookies, bypassing other servers, or checking on platforms like Colab.

Update BardAPI package (ensure the previous version is deleted).
Refresh cookie values (log out, completely close the browser, then reopen and log in to use updated cookies).
There might be rate limiting, so wait a few hours before trying again.
Most users reported that the issue was resolved after following these steps.

Please share your user experience related to this error in issue #128. Thank you.

Hello,
It seems I have the same issue but in a different environment.
I have a simple code that works perfectly on my local machine but generates an error when deployed on Streamlit. I am using the bardapi from GitHub - dsdanielpark/Bard-API: The unofficial python package that returns response of Google Bard through cookie value. and using the latest version.
import streamlit as st
from dotenv.main import load_dotenv
import os
load_dotenv()
st.title("BardAPI for Python")

_BARD_API_KEY=os.environ['_BARD_API_KEY']
#import os
from bardapi import Bard

with st.container () :

    with st.spinner ( 'Wait till Bard gets the answers...' ) :
        input_text = "What is the largest state in the USA?"

        try :
            bard = Bard ( token = _BARD_API_KEY, timeout = 20 )
            response = (bard.get_answer ( input_text ) [ 'content' ])
            st.write ( response )
        except :
            st.error ( 'Please check if you have set the Cookie ' )

on the local machine, I get:
BardAPI for Python

The largest state in the USA is Alaska. It has a total area of 586,412 square miles, which is more than two and a half times the size of Texas, the second largest state. Alaska is also the least densely populated state in the USA, with a population of only about 733,000 people.
Here is a list of the 10 largest states in the USA, ranked by total area:
Alaska (586,412 square miles)
Texas (268,596 square miles)
California (163,695 square miles)
Montana (147,046 square miles)
New Mexico (121,590 square miles)
Arizona (113,990 square miles)
Nevada (110,572 square miles)
Colorado (104,094 square miles)
Oregon (98,379 square miles)
Wyoming (97,813 square miles)
I hope this helps! Let me know if you have any other questions.

on Streamlit Hub I get:

BardAPI for Python
Response Error: b’)]}‘\n\n38\n[[“wrb.fr”,null,null,null,null,[9]]]\n56\n[[“di”,163],[“af.httprm”,163,“7269046257447756350”,0]]\n25\n[[“e”,4,null,null,131]]\n’. Unable to get response. Please double-check the cookie values and verify your network environment or google account.

I am using the same cookie; nothing changed.
Any help is appreciated.
Thank you

hello, have you managed to resolve the problem?

Hello, It seems I have the same issue but in a different environment. I have a simple code that works perfectly on my local machine but generates an error when deployed on Streamlit. I am using the bardapi from GitHub - dsdanielpark/Bard-API: The unofficial python package that returns response of Google Bard through cookie value. and using the latest version. in requirements.txt I have bardapi==0.1.29
import streamlit as st
from dotenv.main import load_dotenv
import os
load_dotenv()
st.title("BardAPI for Python")

_BARD_API_KEY=os.environ['_BARD_API_KEY']
#import os
from bardapi import Bard

with st.container () :

    with st.spinner ( 'Wait till Bard gets the answers...' ) :
        input_text = "What is the largest state in the USA?"

        try :
            bard = Bard ( token = _BARD_API_KEY, timeout = 20 )
            response = (bard.get_answer ( input_text ) [ 'content' ])
            st.write ( response )
        except :
            st.error ( 'Please check if you have set the Cookie ' )

on the local machine, I get:
BardAPI for Python

The largest state in the USA is Alaska. It has a total area of 586,412 square miles, which is more than two and a half times the size of Texas, the second largest state. Alaska is also the least densely populated state in the USA, with a population of only about 733,000 people.
Here is a list of the 10 largest states in the USA, ranked by total area:
Alaska (586,412 square miles)
Texas (268,596 square miles)
California (163,695 square miles)
Montana (147,046 square miles)
New Mexico (121,590 square miles)
Arizona (113,990 square miles)
Nevada (110,572 square miles)
Colorado (104,094 square miles)
Oregon (98,379 square miles)
Wyoming (97,813 square miles)
I hope this helps! Let me know if you have any other questions.

on Streamlit Hub I get:

BardAPI for Python
Response Error: b’)]}‘\n\n38\n[[“wrb.fr”,null,null,null,null,[9]]]\n56\n[[“di”,163],[“af.httprm”,163,“7269046257447756350”,0]]\n25\n[[“e”,4,null,null,131]]\n’. Unable to get response. Please double-check the cookie values and verify your network environment or google account.

I am using the same cookie; nothing changed. Any help is appreciated. Thank you

hi, have you managed to resolve the problem?

No , I could not find a solution. Even after following the suggestions: logging out, clearing all cookies, logging in again, using the new value. It does not work.

No , I could not find a solution. Even after following the suggestions: logging out, clearing all cookies, logging in again, using the new value. It does not work.

This issue is also related to Google, where for reasons like region, account lock, public IP blocking, or response limits, responses are not being received.
The role of the Bard API package is to send requests and receive responses, which is working perfectly.
Therefore, there's nothing we can do to resolve it. If this is not a temporary issue, it would be difficult to use.

I keep getting the same error even by changing account IP etc.
Does it help to join the makersuite ?

Reopen the chrome solves the problem.

I have the same problem, when I want to extract the code and convert it to a link, it tells me:
{'content': 'Response Error: b\')]}\\\'\\n\\n39\\n[["wrb.fr",null,null,null,null,[13]]]\\n54\\n[["di",82],["af.httprm",82,"6645275065783071985",2]]\\n25\\n[["e",4,null,null,130]]\\n\'. \nUnable to get response.\nPlease double-check the cookie values and verify your network environment or google account.'}


Image received has an ad on it

The screenshot included the ad underneath the code snippet.

This happened more than once:

Could you please add code snippet as text? I will try reproduce bug with same code

I changed the files slightly, but here they are:
1st: https://github.com/danieljbk/carbonate/blob/main/code/creating.py
2nd: https://github.com/danieljbk/carbonate/blob/main/code/getting_folder_paths.py

I can't reproduce it. Maybe you have specific params?
These bug could also was fixed after this 4ef0bd1 changes

I didn't have specific parameters. I can't reproduce the bug either. Maybe it was fixed as you said. I think we can close this issue.


Posting malformed JSON throws an error

Hi, Im building a server-side API and when I POST a malformed JSON payload the app crashes:
SyntaxError: Unexpected token l
    at Object.parse (native)
    at parse (/home/islam/dist/app/programs/server/npm/node_modules/meteor/simple_json-routes/node_modules/connect/node_modules/body-parser/lib/types/json.js:88:17)
    at /home/islam/dist/app/programs/server/npm/node_modules/meteor/simple_json-routes/node_modules/connect/node_modules/body-parser/lib/read.js:108:18
    at invokeCallback (/home/islam/dist/app/programs/server/npm/node_modules/meteor/simple_json-routes/node_modules/connect/node_modules/body-parser/node_modules/raw-body/index.js:262:16)
    at done (/home/islam/dist/app/programs/server/npm/node_modules/meteor/simple_json-routes/node_modules/connect/node_modules/body-parser/node_modules/raw-body/index.js:251:7)
    at IncomingMessage.onEnd (/home/islam/dist/app/programs/server/npm/node_modules/meteor/simple_json-routes/node_modules/connect/node_modules/body-parser/node_modules/raw-body/index.js:308:7)
    at emitNone (events.js:67:13)
    at IncomingMessage.emit (events.js:166:7)
    at endReadableNT (_stream_readable.js:921:12)
    at nextTickCallbackWith2Args (node.js:442:9)

Did I miss something in the configuration ?

This should be able to be handled in implementation by passing optional parameters. It seems this has not been built though.

Yeah, it's been an issue for over a year now, first reply coming after a year.
I believe there should be some sort of a decent validation engine built into any API framework. That's maybe something to contribute.


reduce neutron agent check alerts

reduce keepalive threshold
only execute on controllers, not on computes

Can one of the admins verify this patch?

"ok to test" to accept this pull request for testing
"test this please" for a one time test run
"add to whitelist" to add the author to the whitelist

@paulczar @scoop206 please review again.

add keepalive threshold as configurable parameter
move all neutron-data related monitoring to neutron-control, since they are controller level check. Although operation team only mentioned check-neutron-agent alert flooding.

retest

retest

retest

retest


Enable fp8 inference for Llava-Next and add Fused_SDPA

What does this PR do?

Add fp8 support for llava_next models llava-v1.6-mistral-7b-hf and llava-v1.6-vicuna-13b-hf.
Add FusedSDPA support for Llava-1.5-7b, Llava-1.5-13b models

Here is an example to measure the tensor quantization statistics on llava-v1.6-mistral-7b-hf:
QUANT_CONFIG=./quantization_config/maxabs_measure.json python run_pipeline.py \
--model_name_or_path llava-hf/llava-v1.6-mistral-7b-hf \
--image_path "https://llava-vl.github.io/static/images/view.jpg" \
--use_hpu_graphs \
--bf16

07/02/2024 18:20:09 - INFO - main - result = [[{'generated_text': '[INST]  \nWhat is shown in this image? [/INST] The image shows a wooden dock extending into a calm body of water, likely a lake. In the background, there are mountains with snow-capped peaks, suggesting a high-altitude location. The sky is partly cloudy, and the overall scene is serene and picturesque, possibly indicating a location that is popular for outdoor activities such as hiking, fishing, or boating. '}]], time = 2605.2694872021675ms, Throughput (including tokenization) = 29.939321203874847 tokens/second
Here is an example to quantize the model based on previous measurements for llava-v1.6-mistral-7b-hf:
QUANT_CONFIG=./quantization_config/maxabs_quant.json python run_pipeline.py \
--model_name_or_path llava-hf/llava-v1.6-mistral-7b-hf \
--image_path "https://llava-vl.github.io/static/images/view.jpg" \
--use_hpu_graphs \
--bf16

07/02/2024 18:21:45 - INFO - main - result = [[{'generated_text': '[INST]  \nWhat is shown in this image? [/INST] The image shows a wooden dock extending into a calm body of water, likely a lake. The dock is surrounded by a forested area with coniferous trees, and in the background, there are mountains with snow-capped peaks, suggesting a high-altitude location. The sky is partly cloudy, and the overall scene is serene and natural. '}]], time =<PHONE_NUMBER>127853ms, Throughput (including tokenization) = 96.96232213786507 tokens/second
Here is an example to measure the tensor quantization statistics on llava-v1.6-vicuna-13b-hf:
QUANT_CONFIG=./quantization_config/maxabs_measure.json python run_pipeline.py \
--model_name_or_path llava-hf/llava-v1.6-vicuna-13b-hf \
--image_path "https://llava-vl.github.io/static/images/view.jpg" \
--use_hpu_graphs \
--bf16

07/02/2024 18:26:26 - INFO - main - result = [[{'generated_text': "A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions. USER:  \nWhat is shown in this image? ASSISTANT: The image shows a serene lakeside scene. There is a wooden dock extending into a calm body of water, which appears to be a lake. The lake is surrounded by a forested area with tall trees, and in the background, there are mountains with snow on their peaks, suggesting a cooler climate or altitude. The sky is partly cloudy, and the overall atmosphere is peaceful and natural."}]], time = 8267.195312678814ms, Throughput (including tokenization) = 10.03968055196528 tokens/second
Here is an example to quantize the model based on previous measurements for llava-v1.6-vicuna-13b-hf:
QUANT_CONFIG=./quantization_config/maxabs_quant.json python run_pipeline.py \
--model_name_or_path llava-hf/llava-v1.6-vicuna-13b-hf \
--image_path "https://llava-vl.github.io/static/images/view.jpg" \
--use_hpu_graphs \
--bf16

07/02/2024 18:28:30 - INFO - main - result = [[{'generated_text': "A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions. USER:  \nWhat is shown in this image? ASSISTANT: The image shows a serene and picturesque scene of a lake with a wooden dock or pier extending into the water. The lake is surrounded by a forested area with tall trees, and in the background, there are mountains with snow-capped peaks, suggesting it might be a colder season or the mountains are high enough to retain snow. The sky is overcast with clouds, giving the scene a calm and tranquil atmosphere."}]], time = 1261.9115926325321ms, Throughput (including tokenization) = 69.73547157643519 tokens/second
Inference with FusedSDPA
More information on Using Fused Scaled Dot Product Attention (FusedSDPA) here:
https://docs.habana.ai/en/latest/PyTorch/Model_Optimization_PyTorch/Optimization_in_PyTorch_Models.html?highlight=fusedsdpa#using-fused-scaled-dot-product-attention-fusedsdpa
Currently FusedSDPA only works for Llava-1.5-7b, Llava-1.5-13b models
Use the following commands to run Llava-1.5-7b inference with FusedSDPA
BF16:
python3 run_pipeline.py \
    --model_name_or_path llava-hf/llava-1.5-7b-hf \
    --use_hpu_graphs \
    --bf16 \
    --use_flash_attention

FP8:
Here is an example to measure the tensor quantization statistics on Llava-1.5-7b:
QUANT_CONFIG=./quantization_config/maxabs_measure.json python run_pipeline.py \
--model_name_or_path llava-hf/llava-1.5-7b-hf \
--image_path "https://llava-vl.github.io/static/images/view.jpg" \
--use_hpu_graphs \
--bf16 \
--use_flash_attention

Here is an example to quantize the model based on previous measurements for Llava-1.5-7b:
QUANT_CONFIG=./quantization_config/maxabs_quant.json python run_pipeline.py \
--model_name_or_path llava-hf/llava-1.5-7b-hf \
--image_path "https://llava-vl.github.io/static/images/view.jpg" \
--use_hpu_graphs \
--bf16 \
--use_flash_attention

Fixes # (issue)
Before submitting

[ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
[ ] Did you make sure to update the documentation with your changes?
[ ] Did you write any new necessary tests?

@regisss , please review and merge if it is ok for you. thanks

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.


Suggest use of a bypass block (skip to main content link)

Describe the bug
Suggest a bypass block on this page, because…

Interactive UI owned by OpenFL adds a minimum half dozen tab stops in default sidebar (assuming access to bottom collapsible section is fixed)
“Ethical ads” ad plugin in sidebar adds 4 tab stops to overall focus order
Use of previous/next buttons in a given page of content will reload entire page, returning user to top of page and making them tab a lot to get to newly presented main content

Therefore, to enable a keyboard user to reach the main content within a couple of keypresses instead of over 10, suggest a 'skip to main content' link in the header of the page, as the first interactive element on the page.
The skip navigation link can be coded so that it is not visible unless it has keyboard focus, so as not to change the default appearance / layout of the page. Doing this will enable the keyboard user to press TAB to get to the skip link and ENTER to move focus to the first interactive element in the main content.
Desktop:
This issue is not OS or browser specific, but for tracking purposes, testing was done on Win11, in Edge Version 114.0.1823.58 (Official build) (64-bit).
Smartphone:
This issue is not device, OS, or browser specific.
Additional context
This is an accessibility issue, please annotate this bug with the 'accessibility' label.

This is an issue with the Read The Docs platform.

Closing. As mentioned by @fstrr, this is an issue with Read The Docs platform.


SRV data fields 'service', 'proto' and 'name' are no longer supported

Confirmation

[X] This is a bug with an existing resource and is not a feature request or enhancement. Feature requests should be submitted with Cloudflare Support or your account team.
[X] I have searched the issue tracker and my issue isn't already found.
[X] I have replicated my issue using the latest version of the provider and it is still present.

Terraform and Cloudflare provider version
Terraform v1.7.0
on linux_arm64
+ provider registry.terraform.io/cloudflare/cloudflare v4.38.0
+ provider registry.terraform.io/hashicorp/aws v5.59.0

Affected resource(s)

cloudflare_record

Terraform configuration files
resource "cloudflare_record" "cloudflare_record" {
  name            = "record_01"
  comment         = "<comment>"
  zone_id         = "<zone_id>"
  allow_overwrite = false

  data {
    service  = "_https"
    proto    = "_tcp"
    name     = "somename.domain.com"
    priority = 5
    weight   = 0
    port     = 8443
    target   = "somename.domain.com"
  }
}

Link to debug output
cannot-include
Panic output
na
Expected output
Resource created
Actual output
Error: failed to create DNS record: SRV data fields 'service', 'proto' and 'name' are no longer supported. Please see <https://developers.cloudflare.com/fundamentals/api/reference/deprecations/#name-related-data-fields-on-srv-dns-records> for more information. (9000)
│
│   with cloudflare_record.cloudflare_record["record_01"],
│   on main.tf line 5, in resource "cloudflare_record" "cloudflare_record":
│    5: resource "cloudflare_record" "cloudflare_record" {

Steps to reproduce

Use service, name, and proto in the data block

Additional factoids
According to documentation here, these are deprecated in the API however have not been updated in the provider.
References
No response

this is already under way via #3286


Fixing SetShardTabletControl blacklisted_tables.

It was wrong and confusing. Hopefully better now.

@michael-berlin PTAL you're right it's better that way.


Return non-exchanged components in ExchangeIssuance

Pull Request Test Coverage Report for Build 5170

7 of 7 (100.0%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build 5155:
0.0%

Covered Lines:
997

Relevant Lines:
997

💛  - Coveralls


Incompatible with<EMAIL_ADDRESS>

What happened?

<EMAIL_ADDRESS>is incompatible with<EMAIL_ADDRESS>even though it's tracking its rc. I had assumed they would be compatible.
It would be nice to be able to use the latest releases of of both, rather than depending on prereleases. This also presents a constraint when mitigating potential CVEs.
How can we reproduce it?

go.mod:
module github.com/mamachanko/crossplane-compatibility

go 1.20

require (
	github.com/crossplane-contrib/provider-kubernetes v0.9.0
	github.com/crossplane/crossplane v1.13.1
	github.com/crossplane/crossplane-runtime v0.20.0
)

# ...

main.go:
package main

import (
	"log"

	xpv1 "github.com/crossplane/crossplane-runtime/apis/common/v1"
	xpxv1 "github.com/crossplane/crossplane/apis/apiextensions/v1"
	xpk8sv1alpha1 "github.com/crossplane-contrib/provider-kubernetes/apis/object/v1alpha1"
)

func main() {
  log.Printf("%+v", xpv1.SecretReference{})
  log.Printf("%+v", xpxv1.Composition{})
  log.Printf("%+v", xpk8sv1alpha1.Object{})
}

Build:
❯ go run .
# github.com/crossplane-contrib/provider-kubernetes/apis/object/v1alpha1
../../../go/pkg/mod/github.com/crossplane-contrib/provider-kubernetes@v0.9.0/apis/object/v1alpha1/management_policy_hack.go:72:46: undefined: xpv1.ManagementPolicy
../../../go/pkg/mod/github.com/crossplane-contrib/provider-kubernetes@v0.9.0/apis/object/v1alpha1/management_policy_hack.go:77:14: undefined: xpv1.ManagementFullControl
../../../go/pkg/mod/github.com/crossplane-contrib/provider-kubernetes@v0.9.0/apis/object/v1alpha1/management_policy_hack.go:81:46: undefined: xpv1.ManagementPolicy
../../../go/pkg/mod/github.com/crossplane-contrib/provider-kubernetes@v0.9.0/apis/object/v1alpha1/zz_generated.managedlist.go:26:14: cannot use &l.Items[i] (value of type *Object) as "github.com/crossplane/crossplane-runtime/pkg/resource".Managed value in assignment: *Object does not implement "github.com/crossplane/crossplane-runtime/pkg/resource".Managed (missing method GetManagementPolicies)

What environment did it happen in?
Crossplane version: see go.mod ⬆

Fixed with https://github.com/crossplane-contrib/provider-kubernetes/pull/128


HKSV not working

Hello!
I've tried to search all of the issues, and solutions in this project, but i've not found the root of the problem.
I have two type of TP-Link cameras (C520WS and C220) what i wanted to add to Homekit.
I've sucsessfully configured the plugin. The stream is working well, but Homekit not record anything and so sound.
What i've done:
-Low stream configured
-H264 and AAC audio configured
-Tried with default configuration for video settings and with original camera maximums.
-Video analysis configured
-Motion sensor configured
-Homekit settings fine (Stream&Record) ICloud 200GB okay.
-Movement test and so on tried.
-Not wanted to had local storage, only in HKSV.
The logs show nothing special, not have any errors, or issues (only slow snapshot maximum). Movement triggered etc. etc.
But Homekit always show LIVE status.
Einvorment is freshest all of them (stable not beta).
If needed anything special i could add.
Thx for the help, because now i tried evreything during days, and i can't do anything more with my knowledge to work.
Some logs:
[13/11/2024, 23:14:38] [CameraUI] Bejárat: Skip motion trigger. At Home is active and Bejárat is not excluded!
[13/11/2024, 23:14:40] [CameraUI] VIDEOANALYSIS: New message: Data: [{"zone":"region0","percent":16.27474021911621,"sensitivity":85,"dwell":60,"forceClose":3}] - Motion: detected - Camera: Bejárat
[13/11/2024, 23:14:40] [CameraUI] Bejárat: Skip motion trigger. At Home is active and Bejárat is not excluded!
[13/11/2024, 23:16:14] [Jakuzzi] getDeviceData-start
[13/11/2024, 23:16:17] [Jakuzzi] getDeviceData-Feedback not reachable
[13/11/2024, 23:16:17] [Jakuzzi] Triggered SET CurrentTemperature:  -1
[13/11/2024, 23:16:17] [Jakuzzi] UpdateUI:  No Data 1
[13/11/2024, 23:17:40] [CameraUI] VIDEOANALYSIS: New message: Data: {"time":"2024-11-13T22:17:40.578Z","event":"forceClose (3m)"} - Motion: resetted - Camera: Bejárat
[13/11/2024, 23:17:40] [CameraUI] Bejárat: Skip motion trigger. At Home is active and Bejárat is not excluded!
[13/11/2024, 23:17:41] [CameraUI] VIDEOANALYSIS: New message: Data: [{"zone":"region0","percent":15.073784828186035,"sensitivity":86,"dwell":60,"forceClose":3}] - Motion: detected - Camera: Bejárat
[13/11/2024, 23:17:41] [CameraUI] Bejárat: Skip motion trigger. At Home is active and Bejárat is not excluded!
JSON:
"name": "CameraUI",
"port": 8081,
"atHomeSwitch": true,
"logLevel": "info",
"mqtt": {
"active": false,
"tls": false,
"port": 1883
},
"http": {
"active": false,
"port": 7272,
"localhttp": false
},
"smtp": {
"active": false,
"port": 2727,
"space_replace": "+"
},
"ftp": {
"active": false,
"useFile": false,
"port": 5050
},
"ssl": {
"active": false
},
"options": {
"videoProcessor": "ffmpeg"
},
"cameras": [
{
"name": "Boni",
"manufacturer": "TP-Link",
"model": "C220",
"serialNumber": "XXX@IP",
"privacySwitch": true,
"motion": true,
"motionTimeout": 15,
"unbridge": true,
"hsv": true,
"prebuffering": true,
"forcePrebuffering": true,
"prebufferLength": 4,
"hksvConfig": {
"source": "-i rtsp://XXX@IP/stream1",
"vcodec": "libx264",
"acodec": "libfdk_aac",
"audio": true
},
"videoConfig": {
"source": "-i rtsp://XXX@IP/stream1",
"subSource": "-i rtsp://XXX@IP/stream2",
"stillImageSource": "-i rtsp://XXX@IP/stream1",
"rtspTransport": "tcp",
"maxStreams": 8,
"vcodec": "copy",
"acodec": "libfdk_aac",
"audio": true
},
"smtp": {
"email": "Boni"
},
"videoanalysis": {
"active": true
},
"mqtt": {}
},
{
"name": "Bejárat",
"manufacturer": "TP-Link",
"model": "C520WS",
"serialNumber": "XXX@IP",
"privacySwitch": true,
"motion": true,
"switches": false,
"motionTimeout": 15,
"unbridge": true,
"hsv": true,
"prebuffering": true,
"forcePrebuffering": true,
"prebufferLength": 4,
"hksvConfig": {
"source": "-i rtsp://XXX@IP/stream1",
"vcodec": "libx264",
"acodec": "libfdk_aac",
"audio": true
},
"videoConfig": {
"source": "-i rtsp://XXX@IP/stream1",
"subSource": "-i rtsp://XXX@IP/stream2",
"stillImageSource": "-i rtsp://XXX@IP/stream1",
"readRate": true,
"rtspTransport": "tcp",
"maxStreams": 8,
"vcodec": "copy",
"acodec": "libfdk_aac",
"audio": true,
"debug": false
},
"smtp": {
"email": "Bejárat"
},
"videoanalysis": {
"active": true
},
"mqtt": {}
},
{
"name": "Terasz",
"manufacturer": "TP-Link",
"model": "C520WS",
"serialNumber": "XXX@IP",
"privacySwitch": true,
"motion": true,
"motionTimeout": 15,
"unbridge": true,
"hsv": true,
"prebuffering": true,
"forcePrebuffering": true,
"prebufferLength": 4,
"hksvConfig": {
"source": "-i rtsp://XXX@IP/stream1",
"vcodec": "libx264",
"acodec": "libfdk_aac",
"audio": true
},
"videoConfig": {
"source": "-i rtsp://XXX@IP/stream1",
"subSource": "-i rtsp://XXX@IP/stream2",
"stillImageSource": "-i rtsp://XXX@IP/stream1",
"rtspTransport": "tcp",
"maxStreams": 8,
"vcodec": "libx264",
"acodec": "libfdk_aac",
"audio": true
},
"smtp": {
"email": "Terasz"
},
"videoanalysis": {
"active": true
},
"mqtt": {}
},
{
"name": "Boni 2",
"manufacturer": "TP-Link",
"model": "C220",
"serialNumber": "XXX@IP,
"privacySwitch": true,
"motion": true,
"motionTimeout": 15,
"unbridge": true,
"hsv": true,
"prebuffering": true,
"forcePrebuffering": true,
"prebufferLength": 4,
"hksvConfig": {
"source": "-i rtsp://XXX@IPstream1",
"vcodec": "libx264",
"acodec": "libfdk_aac",
"audio": true
},
"videoConfig": {
"source": "-i rtsp://XXX@IP/stream1",
"subSource": "-i rtsp://XXX@IP/stream2",
"stillImageSource": "-i rtsp://XXX@IP/stream1",
"rtspTransport": "tcp",
"maxStreams": 8,
"vcodec": "libx264",
"acodec": "libfdk_aac",
"audio": true
},
"smtp": {
"email": "Boni 2"
},
"videoanalysis": {
"active": true
},
"mqtt": {}
}
],
"_bridge": {
"username": "XXX@IP",
"port": 50611
},
"platform": "CameraUI"
}

Log+JSON added

Any advice? @seydx


Update expressroute-locations.md

Cleaned up the EXP Locations table: the formatting of the last row, Zayo Group. It was not included in the table due to an extra line.

Hi @fmigacz, I'm your friendly neighborhood Azure Pull Request Bot (You can call me AZPRBOT). Thanks for your contribution!

This seems like a small (but important) contribution, so no contribution license agreement is required at this point. Real humans will now evaluate your PR.

TTYL, AZPRBOT;

@fmigacz Thanks for the contribution!  I've forwarded the change to the author.

Looks great! Thanks for catching that. Let's publish this change.


KeyError: 'getpwnam(): name not found: minidns'

Trying to test out the latest development version:
#!python
(minidns)
XXXXXXXX@031986
Wed Feb 05 14:42:46
~/minidns
$ minidns -c example.conf start
Unhandled Error
Traceback (most recent call last):
  File "/Users/XXXXXXXX/.virtualenvs/minidns/lib/python2.7/site-packages/twisted/application/app.py", line 642, in run
    runApp(config)
  File "/Users/XXXXXXXX/.virtualenvs/minidns/lib/python2.7/site-packages/twisted/scripts/twistd.py", line 23, in runApp
    _SomeApplicationRunner(config).run()
  File "/Users/XXXXXXXX/.virtualenvs/minidns/lib/python2.7/site-packages/twisted/application/app.py", line 376, in run
    self.application = self.createOrGetApplication()
  File "/Users/XXXXXXXX/.virtualenvs/minidns/lib/python2.7/site-packages/twisted/application/app.py", line 441, in createOrGetApplication
    application = getApplication(self.config, passphrase)
--- <exception caught here> ---
  File "/Users/XXXXXXXX/.virtualenvs/minidns/lib/python2.7/site-packages/twisted/application/app.py", line 452, in getApplication
    application = service.loadApplication(filename, style, passphrase)
  File "/Users/XXXXXXXX/.virtualenvs/minidns/lib/python2.7/site-packages/twisted/application/service.py", line 405, in loadApplication
    application = sob.loadValueFromFile(filename, 'application', passphrase)
  File "/Users/XXXXXXXX/.virtualenvs/minidns/lib/python2.7/site-packages/twisted/persisted/sob.py", line 210, in loadValueFromFile
    exec fileObj in d, d
  File "/Users/XXXXXXXX/work/minidns/minidns/scripts/minidns.tac", line 26, in <module>
    OrchestrationService(conf).setServiceParent(application)
  File "/Users/XXXXXXXX/work/minidns/minidns/orchestra.py", line 17, in __init__
    self.dnsserver = DNSService(conf)
  File "/Users/XXXXXXXX/work/minidns/minidns/dns.py", line 297, in __init__
    self.factory = MiniDNSServerFactory(forwarders, savedir, self.get_ent())
  File "/Users/XXXXXXXX/work/minidns/minidns/dns.py", line 325, in get_ent
    ent = pwd.getpwnam(self.conf['user'])
exceptions.KeyError: 'getpwnam(): name not found: minidns'

Failed to load application: 'getpwnam(): name not found: minidns'

now listens on 53 by default, and the minidns user is created as part of packaging. must be run as root, but should definitely drop privs.


Failed to create parent directories doing diff

Environment
Liquibase Version: > 4.16.1
Liquibase Integration & Version: gradle plugin 2.1.1
Liquibase Extension(s) & Version: hibernate 6
Database Vendor & Version: PostgreSQL
Operating System Type & Version: MacBook Pro (13-inch, M1, 2020)
Infrastructure Type/Provider: Local
Description
Migrating the spring boot version to version 3, we have detected that the execution of diffChangeLog is broken because the file cannot be created.
The exception that occurs in the logs is:
[2023-02-01 11:38:07] INFORMACIÓN [liquibase.diff] changeSets count: 2
[2023-02-01 11:38:07] INFORMACIÓN [liquibase.diff] src/main/resources/db/migrations/changelog/20230201113757.master.postgresql.sql does not exist, creating and adding 2 changesets.
[2023-02-01 11:38:07] ADVERTENCIA [liquibase.resource] Failed to create parent directories for file src/main/resources/db/migrations/changelog/20230201113757.master.postgresql.sql
[2023-02-01 11:38:07] GRAVE [liquibase.integration] src/main/resources/db/migrations/changelog/20230201113757.master.postgresql.sql
liquibase.exception.CommandExecutionException: liquibase.exception.LiquibaseException: liquibase.exception.CommandExecutionException: java.nio.file.NoSuchFileException: src/main/resources/db/migrations/changelog/20230201113757.master.postgresql.sql
        at liquibase.command.CommandScope.execute(CommandScope.java:179)
        at liquibase.integration.commandline.CommandRunner.call(CommandRunner.java:54)
        at liquibase.integration.commandline.CommandRunner.call(CommandRunner.java:23)
        at picocli.CommandLine.executeUserObject(CommandLine.java:2041)
        at picocli.CommandLine.access$1500(CommandLine.java:148)
        at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2461)
        at picocli.CommandLine$RunLast.handle(CommandLine.java:2453)
        at picocli.CommandLine$RunLast.handle(CommandLine.java:2415)
        at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2273)
        at picocli.CommandLine$RunLast.execute(CommandLine.java:2417)
        at picocli.CommandLine.execute(CommandLine.java:2170)
        at liquibase.integration.commandline.LiquibaseCommandLine.lambda$execute$1(LiquibaseCommandLine.java:353)
        at liquibase.Scope.child(Scope.java:189)
        at liquibase.Scope.child(Scope.java:165)
        at liquibase.integration.commandline.LiquibaseCommandLine.execute(LiquibaseCommandLine.java:318)
        at liquibase.integration.commandline.LiquibaseCommandLine.main(LiquibaseCommandLine.java:84)
Caused by: liquibase.exception.LiquibaseException: liquibase.exception.CommandExecutionException: java.nio.file.NoSuchFileException: src/main/resources/db/migrations/changelog/20230201113757.master.postgresql.sql
        at liquibase.integration.commandline.CommandLineUtils.doDiffToChangeLog(CommandLineUtils.java:221)
        at liquibase.integration.commandline.Main.doMigration(Main.java:1565)
        at liquibase.integration.commandline.Main$1.lambda$run$0(Main.java:394)
        at liquibase.Scope.lambda$child$0(Scope.java:180)
        at liquibase.Scope.child(Scope.java:189)
        at liquibase.Scope.child(Scope.java:179)
        at liquibase.Scope.child(Scope.java:158)
        at liquibase.integration.commandline.Main$1.run(Main.java:393)
        at liquibase.integration.commandline.Main$1.run(Main.java:215)
        at liquibase.Scope.child(Scope.java:189)
        at liquibase.Scope.child(Scope.java:165)
        at liquibase.integration.commandline.Main.run(Main.java:215)
        at liquibase.command.AbstractCliWrapperCommandStep.run(AbstractCliWrapperCommandStep.java:33)
        at liquibase.command.CommandScope.execute(CommandScope.java:173)
        ... 15 more
Caused by: liquibase.exception.CommandExecutionException: java.nio.file.NoSuchFileException: src/main/resources/db/migrations/changelog/20230201113757.master.postgresql.sql
        at liquibase.command.CommandScope.execute(CommandScope.java:179)
        at liquibase.integration.commandline.CommandLineUtils.doDiffToChangeLog(CommandLineUtils.java:219)
        ... 28 more
Caused by: java.nio.file.NoSuchFileException: src/main/resources/db/migrations/changelog/20230201113757.master.postgresql.sql
        at java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:92)
        at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:106)
        at java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111)
        at java.base/sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:218)
        at java.base/java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:484)
        at java.base/java.nio.file.Files.newOutputStream(Files.java:228)
        at liquibase.resource.PathResource.openOutputStream(PathResource.java:76)
        at liquibase.diff.output.changelog.DiffToChangeLog.printNew(DiffToChangeLog.java:214)
        at liquibase.diff.output.changelog.DiffToChangeLog$1.run(DiffToChangeLog.java:135)
        at liquibase.Scope.lambda$child$0(Scope.java:180)
        at liquibase.Scope.child(Scope.java:189)
        at liquibase.Scope.child(Scope.java:179)
        at liquibase.Scope.child(Scope.java:158)
        at liquibase.diff.output.changelog.DiffToChangeLog.print(DiffToChangeLog.java:129)
        at liquibase.diff.output.changelog.DiffToChangeLog.print(DiffToChangeLog.java:86)
        at liquibase.command.core.InternalDiffChangelogCommandStep.run(InternalDiffChangelogCommandStep.java:63)
        at liquibase.command.CommandScope.execute(CommandScope.java:173)
        ... 29 more

Steps To Reproduce
Run this command using a Liquibase version greater than 4.16.1
./gradlew diffChangeLog -PrunList=diff
Actual Behavior
The task fails because the file with the changesets cannot be created.
Expected/Desired Behavior
It is expected to work as in 4.16.1 version, creating the file with the changesets
Screenshots (if appropriate)
Additional Context
I think it is not necessary to provide more information, the code already existed with certain configurations and works correctly in version 4.16.1. No paths are changed, only versions of the libraries (hibernate 5 to 6 for example) and H2 is added because it was used in the tests and it seems that it is no longer available as transitive dependency.

Hi! Im adding this bug to our queue of bugs to fix. If you can submit a pr with a fix, it could speed up the process. Thanks!

@nvoxland says this change could impact things beyond gradle - namely, springboot. We could also test the function directly - a unit test.


release 0.5.0

Codecov Report

Merging #845 into develop will increase coverage by 0.01%.
The diff coverage is n/a.

@@              Coverage Diff              @@
##             develop     #845      +/-   ##
=============================================
+ Coverage      38.02%   38.04%   +0.01%
  Complexity      1006     1006
=============================================
  Files            220      220
  Lines           8446     8446
  Branches        1016     1016
=============================================
+ Hits            3212     3213       +1
- Misses          4848     4850       +2
+ Partials         386      383       -3

Impacted Files
Coverage Δ
Complexity Δ

...eata/core/rpc/netty/AbstractRpcRemotingClient.java
17.22% <0%> (-0.48%)
7% <0%> (ø)

...eata/server/store/FileTransactionStoreManager.java
54% <0%> (+1%)
15% <0%> (ø)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 761e3ae...5e65c02. Read the comment docs.


Mutexes aren't used consistently in the polytracker runtime implementation in dfsan.cc

In particular, look for the uses of function_to_bytes and union_table within polytracker/dfsan/dfsan_rt/dfsan/dfsan.cc. Each of these variables has an accompanying std::mutex, but the mutex is not taken everywhere the variables are touched.
Additionally, it would be more robust to use std::lock_guard<std::mutex> or std::unique_lock<std::mutex> instead of manually calling .lock() and .unlock() on the mutex variables.

Can you explain what lock_guard and unique_lock do? Note that i have refactored everything so that we have a single mono lock, which while not performant it does the job

std::lock_guard<std::mutex> is an RAII-style class.  You allocate a named one of those objects on the stack, passing the lock you want to hold to its constructor.  That acquires the lock.  When the named std::lock_guard object goes out of scope, its destructor releases the lock.  This kind of pattern ensures that the lock always gets released, even in the case of an early return, a thrown exception, etc.
std::unique_lock<std::mutex> is a newer API (?) that does more or less the same thing, but seems more complicated.

P.S. the single lock design you mention sounds very reasonable if you want to actually have a hope of getting multithreaded code right :)

Hey thats a very clean design (might refactor to that)! Threaded code seems to have been working for awhile now, so I'm closing this!


documentation missing pages on mir.ion.deser, mir.ion.ser

on http://mir-ion.libmir.org/index.html in the sidebar it shows links like to mir.ion.deser.* and mir.ion.ser.* which are all missing in the deploy.
As those are deprecated I think it would be better to hide them in the sidebar on all the pages.

I don't remember how to do it :/


[Bug]: DeepSeek-V2-Lite quantized model raise model shape Error

Your current environment
PyTorch version: 2.3.1+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A

OS: Ubuntu 22.04.3 LTS (x86_64)
GCC version: (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0
Clang version: Could not collect
CMake version: version 3.27.6
Libc version: glibc-2.35

Python version: 3.10.12 (main, Jun 11 2023, 05:26:28) [GCC 11.4.0] (64-bit runtime)
Python platform: Linux-5.15.0-113-generic-x86_64-with-glibc2.35
Is CUDA available: True
CUDA runtime version: 12.2.140
CUDA_MODULE_LOADING set to: LAZY
GPU models and configuration:
GPU 0: NVIDIA H100 PCIe
  MIG 2g.20gb     Device  0:

Nvidia driver version: 535.183.01
cuDNN version: Probably one of the following:
/usr/lib/x86_64-linux-gnu/libcudnn.so.8.9.5
/usr/lib/x86_64-linux-gnu/libcudnn_adv_infer.so.8.9.5
/usr/lib/x86_64-linux-gnu/libcudnn_adv_train.so.8.9.5
/usr/lib/x86_64-linux-gnu/libcudnn_cnn_infer.so.8.9.5
/usr/lib/x86_64-linux-gnu/libcudnn_cnn_train.so.8.9.5
/usr/lib/x86_64-linux-gnu/libcudnn_ops_infer.so.8.9.5
/usr/lib/x86_64-linux-gnu/libcudnn_ops_train.so.8.9.5
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: True

CPU:
Architecture:                       x86_64
CPU op-mode(s):                     32-bit, 64-bit
Address sizes:                      46 bits physical, 57 bits virtual
Byte Order:                         Little Endian
CPU(s):                             64
On-line CPU(s) list:                0-63
Vendor ID:                          GenuineIntel
Model name:                         Intel(R) Xeon(R) Gold 6448Y
CPU family:                         6
Model:                              143
Thread(s) per core:                 1
Core(s) per socket:                 32
Socket(s):                          2
Stepping:                           8
Frequency boost:                    enabled
CPU max MHz:                        2101.0000
CPU min MHz:                        800.0000
BogoMIPS:                           4200.00
Flags:                              fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cat_l2 cdp_l3 invpcid_single intel_ppin cdp_l2 ssbd mba ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm rdt_a avx512f avx512dq rdseed adx smap avx512ifma clflushopt clwb intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local split_lock_detect avx_vnni avx512_bf16 wbnoinvd dtherm ida arat pln pts avx512vbmi umip pku ospke waitpkg avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg tme avx512_vpopcntdq la57 rdpid bus_lock_detect cldemote movdiri movdir64b enqcmd fsrm md_clear serialize tsxldtrk pconfig arch_lbr amx_bf16 avx512_fp16 amx_tile amx_int8 flush_l1d arch_capabilities
Virtualization:                     VT-x
L1d cache:                          3 MiB (64 instances)
L1i cache:                          2 MiB (64 instances)
L2 cache:                           128 MiB (64 instances)
L3 cache:                           120 MiB (2 instances)
NUMA node(s):                       2
NUMA node0 CPU(s):                  0-31
NUMA node1 CPU(s):                  32-63
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit:        Not affected
Vulnerability L1tf:                 Not affected
Vulnerability Mds:                  Not affected
Vulnerability Meltdown:             Not affected
Vulnerability Mmio stale data:      Not affected
Vulnerability Retbleed:             Not affected
Vulnerability Spec rstack overflow: Not affected
Vulnerability Spec store bypass:    Mitigation; Speculative Store Bypass disabled via prctl and seccomp
Vulnerability Spectre v1:           Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:           Mitigation; Enhanced IBRS; IBPB conditional; RSB filling; PBRSB-eIBRS SW sequence; BHI BHI_DIS_S
Vulnerability Srbds:                Not affected
Vulnerability Tsx async abort:      Not affected

Versions of relevant libraries:
[pip3] flashinfer==0.0.8+cu121torch2.3
[pip3] mypy-extensions==1.0.0
[pip3] numpy==1.24.4
[pip3] nvidia-nccl-cu12==2.20.5
[pip3] onnx==1.14.0
[pip3] onnxruntime==1.18.1
[pip3] pytorch-quantization==2.1.2
[pip3] sentence-transformers==3.0.1
[pip3] torch==2.3.1
[pip3] torch-tensorrt==0.0.0
[pip3] torchdata==0.7.0a0
[pip3] torchtext==0.16.0a0
[pip3] torchvision==0.18.1
[pip3] transformers==4.43.0
[pip3] triton==2.3.1
[conda] Could not collect
ROCM Version: Could not collect
Neuron SDK Version: N/A
vLLM Version: 0.5.3.post1
vLLM Build Flags:
CUDA Archs: 5.2 6.0 6.1 7.0 7.2 7.5 8.0 8.6 8.7 9.0+PTX; ROCm: Disabled; Neuron: Disabled
GPU Topology:
GPU0    CPU Affinity    NUMA Affinity   GPU NUMA ID
GPU0     X      0-31    0               N/A

Legend:

  X    = Self
  SYS  = Connection traversing PCIe as well as the SMP interconnect between NUMA nodes (e.g., QPI/UPI)
  NODE = Connection traversing PCIe as well as the interconnect between PCIe Host Bridges within a NUMA node
  PHB  = Connection traversing PCIe as well as a PCIe Host Bridge (typically the CPU)
  PXB  = Connection traversing multiple PCIe bridges (without traversing the PCIe Host Bridge)
  PIX  = Connection traversing at most a single PCIe bridge
  NV#  = Connection traversing a bonded set of # NVLinks

🐛 Describe the bug
DeepSeek-V2-Lite-gptq-4bit and DeepSeek-Coder-V2-Lite-Instruct-AWQ raise model shape Error.
Repro
from vllm.engine.arg_utils import AsyncEngineArgs
from vllm.engine.async_llm_engine import AsyncLLMEngine

engine_args = AsyncEngineArgs(
            model="ModelCloud/DeepSeek-V2-Lite-gptq-4bit",
            # model="TechxGenus/DeepSeek-Coder-V2-Lite-Instruct-AWQ",
            tensor_parallel_size=1,
            dtype=torch.float16,
            gpu_memory_utilization=0.9,
            swap_space=16,
            disable_log_requests=True,
            quantization=quantization,
            max_model_len=163840,
            tokenizer_mode="auto",
            trust_remote_code=True,
            enforce_eager=True,
        )
engine = AsyncLLMEngine.from_engine_args(engine_args)

Error(gptq)
INFO 08-02 08:40:49 llm_engine.py:176] Initializing an LLM engine (v0.5.3.post1) with config: model='/usr/local/models/llm', speculative_config=None, tokenizer='/usr/local/models/llm', skip_tokenizer_init=False, tokenizer_mode=auto, revision=None, rope_scaling=None, rope_theta=None, tokenizer_revision=None, trust_remote_code=True, dtype=torch.float16, max_seq_len=32768, download_dir=None, load_format=LoadFormat.AUTO, tensor_parallel_size=1, pipeline_parallel_size=1, disable_custom_all_reduce=False, quantization=gptq, enforce_eager=True, kv_cache_dtype=auto, quantization_param_path=None, device_config=cuda, decoding_config=DecodingConfig(guided_decoding_backend='outlines'), observability_config=ObservabilityConfig(otlp_traces_endpoint=None), seed=0, served_model_name=/usr/local/models/llm, use_v2_block_manager=False, enable_prefix_caching=False)
INFO 08-02 08:40:49 model_runner.py:680] Starting to load model /usr/local/models/llm...
Cache shape torch.Size([163840, 64])
[2024-08-02 08:40:50,110] [WARN] /usr/local/api/chat_router.py(115):__init__: The input size is not aligned with the quantized weight shape. This can be caused by too large tensor parallel size.
[2024-08-02 08:40:50,111] [WARN] /usr/local/api/chat_router.py(116):__init__: Traceback (most recent call last):
  File "/usr/local/api/chat_router.py", line 107, in __init__
    self.chat_client = ChatLocalVLLM.from_pretraind(model_path=llm_dir, NL="\n"
  File "/usr/local/api/chat_models/chat_local_vllm.py", line 73, in from_pretraind
    engine = cls._prepare_vllm(model_path, tensor_parallel_size
  File "/usr/local/api/chat_models/chat_local_vllm.py", line 123, in _prepare_vllm
    engine = AsyncLLMEngine.from_engine_args(engine_args)
  File "/usr/local/lib/python3.10/dist-packages/vllm/engine/async_llm_engine.py", line 466, in from_engine_args
    engine = cls(
  File "/usr/local/lib/python3.10/dist-packages/vllm/engine/async_llm_engine.py", line 380, in __init__
    self.engine = self._init_engine(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/vllm/engine/async_llm_engine.py", line 547, in _init_engine
    return engine_class(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/vllm/engine/llm_engine.py", line 251, in __init__
    self.model_executor = executor_class(
  File "/usr/local/lib/python3.10/dist-packages/vllm/executor/executor_base.py", line 47, in __init__
    self._init_executor()
  File "/usr/local/lib/python3.10/dist-packages/vllm/executor/gpu_executor.py", line 36, in _init_executor
    self.driver_worker.load_model()
  File "/usr/local/lib/python3.10/dist-packages/vllm/worker/worker.py", line 139, in load_model
    self.model_runner.load_model()
  File "/usr/local/lib/python3.10/dist-packages/vllm/worker/model_runner.py", line 682, in load_model
    self.model = get_model(model_config=self.model_config,
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/model_loader/__init__.py", line 21, in get_model
    return loader.load_model(model_config=model_config,
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/model_loader/loader.py", line 280, in load_model
    model = _initialize_model(model_config, self.load_config,
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/model_loader/loader.py", line 111, in _initialize_model
    return model_class(config=model_config.hf_config,
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/models/deepseek_v2.py", line 439, in __init__
    self.model = DeepseekV2Model(config, cache_config, quant_config)
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/models/deepseek_v2.py", line 401, in __init__
    self.layers = nn.ModuleList([
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/models/deepseek_v2.py", line 402, in <listcomp>
    DeepseekV2DecoderLayer(config,
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/models/deepseek_v2.py", line 343, in __init__
    self.mlp = DeepseekV2MLP(
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/models/deepseek_v2.py", line 68, in __init__
    self.down_proj = RowParallelLinear(intermediate_size,
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/layers/linear.py", line 728, in __init__
    self.quant_method.create_weights(
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/layers/quantization/gptq.py", line 112, in create_weights
    raise ValueError(
ValueError: The input size is not aligned with the quantized weight shape. This can be caused by too large tensor parallel size.

Error(awq)
INFO 08-02 08:16:01 llm_engine.py:176] Initializing an LLM engine (v0.5.3.post1) with config: model='/usr/local/models/llm', speculative_config=None, tokenizer='/usr/local/models/llm', skip_tokenizer_init=False, tokenizer_mode=auto, revision=None, rope_scaling=None, rope_theta=None, tokenizer_revision=None, trust_remote_code=True, dtype=torch.float16, max_seq_len=32768, download_dir=None, load_format=LoadFormat.AUTO, tensor_parallel_size=1, pipeline_parallel_size=1, disable_custom_all_reduce=False, quantization=awq_marlin, enforce_eager=True, kv_cache_dtype=auto, quantization_param_path=None, device_config=cuda, decoding_config=DecodingConfig(guided_decoding_backend='outlines'), observability_config=ObservabilityConfig(otlp_traces_endpoint=None), seed=0, served_model_name=/usr/local/models/llm, use_v2_block_manager=False, enable_prefix_caching=False)
INFO 08-02 08:16:01 model_runner.py:680] Starting to load model /usr/local/models/llm...
Cache shape torch.Size([163840, 64])
[2024-08-02 08:16:02,424] [WARN] /usr/local/api/chat_router.py(114):__init__: ERROR ChatModel not working
[2024-08-02 08:16:02,424] [WARN] /usr/local/api/chat_router.py(115):__init__: Weight input_size_per_partition = 10944 is not divisible by min_thread_k = 128. Consider reducing tensor_parallel_size or running with --quantization gptq.
[2024-08-02 08:16:02,426] [WARN] /usr/local/api/chat_router.py(116):__init__: Traceback (most recent call last):
  File "/usr/local/api/chat_router.py", line 107, in __init__
    self.chat_client = ChatLocalVLLM.from_pretraind(model_path=llm_dir, NL="\n"
  File "/usr/local/api/chat_models/chat_local_vllm.py", line 73, in from_pretraind
    engine = cls._prepare_vllm(model_path, tensor_parallel_size
  File "/usr/local/api/chat_models/chat_local_vllm.py", line 123, in _prepare_vllm
    engine = AsyncLLMEngine.from_engine_args(engine_args)
  File "/usr/local/lib/python3.10/dist-packages/vllm/engine/async_llm_engine.py", line 466, in from_engine_args
    engine = cls(
  File "/usr/local/lib/python3.10/dist-packages/vllm/engine/async_llm_engine.py", line 380, in __init__
    self.engine = self._init_engine(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/vllm/engine/async_llm_engine.py", line 547, in _init_engine
    return engine_class(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/vllm/engine/llm_engine.py", line 251, in __init__
    self.model_executor = executor_class(
  File "/usr/local/lib/python3.10/dist-packages/vllm/executor/executor_base.py", line 47, in __init__
    self._init_executor()
  File "/usr/local/lib/python3.10/dist-packages/vllm/executor/gpu_executor.py", line 36, in _init_executor
    self.driver_worker.load_model()
  File "/usr/local/lib/python3.10/dist-packages/vllm/worker/worker.py", line 139, in load_model
    self.model_runner.load_model()
  File "/usr/local/lib/python3.10/dist-packages/vllm/worker/model_runner.py", line 682, in load_model
    self.model = get_model(model_config=self.model_config,
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/model_loader/__init__.py", line 21, in get_model
    return loader.load_model(model_config=model_config,
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/model_loader/loader.py", line 280, in load_model
    model = _initialize_model(model_config, self.load_config,
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/model_loader/loader.py", line 111, in _initialize_model
    return model_class(config=model_config.hf_config,
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/models/deepseek_v2.py", line 439, in __init__
    self.model = DeepseekV2Model(config, cache_config, quant_config)
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/models/deepseek_v2.py", line 401, in __init__
    self.layers = nn.ModuleList([
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/models/deepseek_v2.py", line 402, in <listcomp>
    DeepseekV2DecoderLayer(config,
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/models/deepseek_v2.py", line 343, in __init__
    self.mlp = DeepseekV2MLP(
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/models/deepseek_v2.py", line 68, in __init__
    self.down_proj = RowParallelLinear(intermediate_size,
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/layers/linear.py", line 728, in __init__
    self.quant_method.create_weights(
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/layers/quantization/awq_marlin.py", line 148, in create_weights
    verify_marlin_supports_shape(
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/layers/quantization/utils/marlin_utils.py", line 106, in verify_marlin_supports_shape
    raise ValueError(f"Weight input_size_per_partition = "
ValueError: Weight input_size_per_partition = 10944 is not divisible by min_thread_k = 128. Consider reducing tensor_parallel_size or running with --quantization gptq.

Same problem, don't know how to fix it.

+1.

same error with vllm-0.6.4

I ran into this issue trying to run a deepseek-v2 awq quant on sglang, was able to fix it by changing GPTQ_MARLIN_MIN_THREAD_K to 64 in vllm/model_executor/layers/quantization/utils/marlin_utils.py, the file where the error is thrown (in the case of OP it would be at /usr/local/lib/python3.10/dist-packages/vllm/model_executor/layers/quantization/utils/marlin_utils.py).
https://github.com/vllm-project/vllm/blob/b689ada91e381ac8a1b197b5a52d7f1fa32fac05/vllm/model_executor/layers/quantization/utils/marlin_utils.py#L14
However, trying to actually run inference with the model on an A40 resulted in a OutOfResources error, I wasn't able to fix it. Not sure if that's related to sglang or vllm or triton, but leaving a note here for anyone who might face the same problem/know how to fix that.


Provide filter in jobs page

As there may be a lot of jobs in job list, a filter is helpful to find interested one. Currently, there is a search box, and can search in any column. But it's not so intuitive, and friendly. It's better to provide some filters, like My jobs, Running, Failed as so on. So that user can get them with one click.

https://github.com/Microsoft/pai/issues/302


Issues on page "Runtime Executables for Backend Services"

Page doesn't need to describe what a "backend service" is
Lots of missing / outdated content
I think a "Runtime Internals" index page with sub-pages may be more useful. Here are the sub-pages which we should cover:

marlowe-chain-indexer service
marlowe-chain-sync service
marlowe-indexer service
marlowe-sync service
marlowe-tx service
marlowe-proxy service

Comments have been addressed.


⚠ ClamAV has degraded performance

In 9448965, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 67 ms

Resolved: ClamAV performance has improved in c43d732.


The errors are like this:
[ 13%] Built target securec
[ 18%] Built target proto_input
Scanning dependencies of target _mindspore_transform_onnx_obj
Scanning dependencies of target _mindspore_backend_kernel_compiler_obj
Scanning dependencies of target _mindspore_frontend_optimizer_obj
Scanning dependencies of target _mindspore_backend_session_obj
Scanning dependencies of target _mindspore_backend_optimizer_obj
Scanning dependencies of target _mindspore_runtime_device_obj
Scanning dependencies of target _mindspore_frontend_parallel_obj
[ 18%] Building CXX object mindspore/ccsrc/backend/kernel_compiler/CMakeFiles/_mindspore_backend_kernel_compiler_obj.dir/common_utils.cc.o
[ 18%] Building CXX object mindspore/core/CMakeFiles/mindspore_core.dir/abstract/abstract_function.cc.o
[ 19%] Building CXX object mindspore/ccsrc/runtime/device/CMakeFiles/_mindspore_runtime_device_obj.dir/convert_tensor_utils.cc.o
[ 20%] Building CXX object mindspore/ccsrc/transform/onnx/CMakeFiles/_mindspore_transform_onnx_obj.dir/ir_exporter.cc.o
[ 20%] Building CXX object mindspore/ccsrc/backend/session/CMakeFiles/_mindspore_backend_session_obj.dir/anf_runtime_algorithm.cc.o
In file included from /data/chengzi/mindspore/mindspore/mindspore/core/abstract/abstract_value.h:28:0,
                 from /data/chengzi/mindspore/mindspore/mindspore/core/abstract/abstract_function.h:25,
                 from /data/chengzi/mindspore/mindspore/mindspore/core/abstract/abstract_function.cc:17:
/data/chengzi/mindspore/mindspore/mindspore/core/utils/log_adapter.h:32:10: fatal error: toolchain/slog.h: No such file or directory
 #include "toolchain/slog.h"
          ^~~~~~~~~~~~~~~~~~
compilation terminated.
mindspore/core/CMakeFiles/mindspore_core.dir/build.make:62: recipe for target 'mindspore/core/CMakeFiles/mindspore_core.dir/abstract/abstract_function.cc.o' failed
make[2]: *** [mindspore/core/CMakeFiles/mindspore_core.dir/abstract/abstract_function.cc.o] Error 1
CMakeFiles/Makefile2:1248: recipe for target 'mindspore/core/CMakeFiles/mindspore_core.dir/all' failed
make[1]: *** [mindspore/core/CMakeFiles/mindspore_core.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
[ 21%] Building CXX object mindspore/ccsrc/backend/session/CMakeFiles/_mindspore_backend_session_obj.dir/kernel_build_client.cc.o
In file included from /data/chengzi/mindspore/mindspore/mindspore/core/base/base.h:30:0,
                 from /data/chengzi/mindspore/mindspore/mindspore/core/ir/anf.h:29,
                 from /data/chengzi/mindspore/mindspore/mindspore/ccsrc/backend/kernel_compiler/kernel.h:22,
                 from /data/chengzi/mindspore/mindspore/mindspore/ccsrc/backend/kernel_compiler/common_utils.h:29,
                 from /data/chengzi/mindspore/mindspore/mindspore/ccsrc/backend/kernel_compiler/common_utils.cc:17:
/data/chengzi/mindspore/mindspore/mindspore/core/utils/log_adapter.h:32:10: fatal error: toolchain/slog.h: No such file or directory
 #include "toolchain/slog.h"
          ^~~~~~~~~~~~~~~~~~
compilation terminated.
mindspore/ccsrc/backend/kernel_compiler/CMakeFiles/_mindspore_backend_kernel_compiler_obj.dir/build.make:62: recipe for target 'mindspore/ccsrc/backend/kernel_compiler/CMakeFiles/_mindspore_backend_kernel_compiler_obj.dir/common_utils.cc.o' failed
make[2]: *** [mindspore/ccsrc/backend/kernel_compiler/CMakeFiles/_mindspore_backend_kernel_compiler_obj.dir/common_utils.cc.o] Error 1
CMakeFiles/Makefile2:533: recipe for target 'mindspore/ccsrc/backend/kernel_compiler/CMakeFiles/_mindspore_backend_kernel_compiler_obj.dir/all' failed
make[1]: *** [mindspore/ccsrc/backend/kernel_compiler/CMakeFiles/_mindspore_backend_kernel_compiler_obj.dir/all] Error 2
[ 21%] Building CXX object mindspore/ccsrc/runtime/device/CMakeFiles/_mindspore_runtime_device_obj.dir/kernel_info.cc.o
In file included from /data/chengzi/mindspore/mindspore/mindspore/core/base/base.h:30:0,
                 from /data/chengzi/mindspore/mindspore/mindspore/core/ir/anf.h:29,
                 from /data/chengzi/mindspore/mindspore/mindspore/ccsrc/backend/session/anf_runtime_algorithm.h:26,
                 from /data/chengzi/mindspore/mindspore/mindspore/ccsrc/backend/session/anf_runtime_algorithm.cc:16:
/data/chengzi/mindspore/mindspore/mindspore/core/utils/log_adapter.h:32:10: fatal error: toolchain/slog.h: No such file or directory
 #include "toolchain/slog.h"
          ^~~~~~~~~~~~~~~~~~

Note: The code can build successfully for CPU version, i.e. run zsh build.sh -e cpu.
Task Goal
Success to build master code.

I found that ENABLE_GE in CMakeLists.txt is OFF, so the following codes didn't run:

if (ENABLE_GE)
    link_directories(${CMAKE_SOURCE_DIR}/third_party/ge/lib)
elseif(ENABLE_D OR ENABLE_TESTCASES)
    include(${CMAKE_SOURCE_DIR}/cmake/dependency_graphengine.cmake)
endif()

if (ENABLE_GE OR ENABLE_D OR ENABLE_TESTCASES)
    include_directories(${CMAKE_CURRENT_SOURCE_DIR}/graphengine/inc)
    include_directories(${CMAKE_CURRENT_SOURCE_DIR}/graphengine/inc/external)
    include_directories(${CMAKE_CURRENT_SOURCE_DIR}/graphengine/inc/framework)
    include_directories(${CMAKE_CURRENT_SOURCE_DIR}/graphengine/third_party/fwkacllib/inc)
    include_directories(${CMAKE_CURRENT_SOURCE_DIR}/graphengine/third_party/fwkacllib/inc/toolchain)
endif()

However, there are some c++ files using ENABLE_GE, so simply modify CMakeLists.txt can't work. I can't figure out why ENABLE_GE is OFF.

I found that in mindspore/cmake/dependency_graphengine.cmake, for CPU/GPU mode we didn't build ge and use a prebuild version:
# for CPU/GPU mode, find slog from local prebuild
if (NOT ENABLE_D)
    set(GE_PREBUILD_PATH ${GE_SOURCE_DIR}/third_party/prebuild/${CMAKE_HOST_SYSTEM_PROCESSOR})
    find_library(slog libslog.so ${GE_PREBUILD_PATH})
    find_library(error_manager liberror_manager.so ${GE_PREBUILD_PATH})

So I guess ENABLE_GE should be OFF for CPU/GPU mode. But why does mindspore/core/utils/log_adapter.h include toolchain/slog.h?

Hi @LuChengTHU,
The master branch could be compiled successfully in our environment(ubuntu 18.04, cuda 10.1), it's the variable USE_GLOG to decide whether to use glog or slog, and In the GPU version, glog will be used by default, and could you retry to compile with the command below:
bash build.sh -e gpu -g on
the option -g decide whether to use glog(by default) or slog.

Hi @yuyicg , I've tried zsh build.sh -e gpu -g on and it reported the same error: mindspore/mindspore/mindspore/core/utils/log_adapter.h:32:10: fatal error: toolchain/slog.h: No such file or directory

Could you try bash instead of zsh?  or add #pragma message statement in the code https://gitee.com/mindspore/mindspore/blob/master/mindspore/core/utils/log_adapter.h#L29 to check if the USE_GLOG variable is set properly in your environment.

Hi @yuyicg , I've tried bash and it reported
---------------- MindSpore: build start ----------------
start build mindspore project.
-DDEBUG_MODE=off -DBUILD_PATH=/data/chengzi/mindspore/mindspore/build/ -DENABLE_LOAD_ANF_IR=off -DENABLE_INFER=ON -DENABLE_DUMP_PROTO=ON -DENABLE_DUMP_IR=on -DENABLE_PYTHON=on -DENABLE_MPI=ON -DENABLE_GPU=ON -DUSE_CUDA=ON -DCUDA_PATH= -DCUDNN_PATH= -DMS_REQUIRE_CUDA_VERSION=10.1 -DENABLE_CPU=ON -DENABLE_MINDDATA=ON -DUSE_GLOG=ON -DENABLE_AKG=ON
PATCH_EXECUTABLE=/usr/bin/patch
CMake Error at akg/CMakeLists.txt:32 (message):
  Please export CMAKE_INCLUDE_PATH to directory where gmp.h locates at.

Hi @yuyicg , I've tried bash and it reported
CMake Error at akg/CMakeLists.txt:32 (message):
  Please export CMAKE_INCLUDE_PATH to directory where gmp.h locates at.

Also, I've added #pragma message like this:
#pragma message
#ifdef USE_GLOG
#include "glog/logging.h"

and nothing happened. I still got fatal error: toolchain/slog.h: No such file or directory.

for the error: Please export CMAKE_INCLUDE_PATH to directory where gmp.h locates at,
gmp(6.1.2) is added as a mandatory dependency in the master branch. so please install it in advance.

@yuyicg The documentation here doesn't say the dependency for gmp. Anyway, I'll install it.

@LuChengTHU Sorry to confuse you. The doc you see is for the latest release version r0.6, and gmp dependency will be added with the next release.

@yuyicg OK thanks! I've built the master version successfully after installing gmp and using bash instead of zsh. Thank you for your patient help!


Made ToTraversable for List serializable

This PR makes ToTraversable / ToSized for List serializable.
For this, it puts a custom CanBuildFrom instance for List into scope (under shapeless.syntax), which implements Serializable, and which is found instead of the one provided by the standard library. The caveat is that this replaces some CanBuildFrom from the standard library by some from shapeless, as soon as one imports shapeless.syntax._.
Other serializable CanBuildFrom like these could be implemented, like in https://github.com/datastax/spark-cassandra-connector/blob/master/spark-cassandra-connector/src/main/scala/com/datastax/spark/connector/types/CanBuildFrom.scala

This is great ... thanks! :-)
I'm not so sure about adding that CanBuildFrom instance directly to shapeless though, and definitely not in a package shapeless.syntax.
There's nothing specific to shapeless in there, and it seems likely that many other projects might benefit from a collection of Java-serializable CanBuildFrom instances ... so why not split this out as a completely independent project?
I think for now I'd be happy to merge this (ASAP, for RC5) but without shapeless.syntax or the instance defined in it. Maybe move that to an example?

The new CanBuildFrom can be moved elsewhere yes... (But then, there are Serialization everywhere in shapeless, so why not an additional CanBuildFrom?)
It could be put it in an external library yes. I'll update the PR.

Thanks :-)

Just updated the PR. I simply moved the additional CanBuildFrom to the tests. (I could have added an example too, but it would just have been some cut-n-paste from the tests... We can tell to look at the added definition in the tests.)

Many thanks! Merged :-)


Fix for Cursive 0.9

Simple update for a very neat library. Thanks.

I'm using this branch and I would love to see it merged!

Thanks for your work!
This lib has been updated for cursive 0.10.
Moving the file viewer from the examples to the lib itself is interesting, but may come in its own PR.
Thanks again!


Default schema exceeds mysql row limits

Describe the bug
The default schema included with this exceeds the physical limits set by mysql (65,535 bytes) when using a utf8 character set. This issue is further compounded if you are using a clustered storage engine (NDB) which has an even lower row size limit (30K bytes).
To Reproduce

Build mysql-cluster docker image: https://hub.docker.com/r/mysql/mysql-cluster/
create an empty database
attempt to import the oauth2_authorization schema.

Expected behavior
Database tables are imported successfully
What actually happens
mysql> CREATE TABLE oauth2_authorization (
    ->     id varchar(100) NOT NULL,
    ->     registered_client_id varchar(100) NOT NULL,
    ->     principal_name varchar(200) NOT NULL,
    ->     authorization_grant_type varchar(100) NOT NULL,
    ->     attributes varchar(15000) DEFAULT NULL,
    ->     state varchar(500) DEFAULT NULL,
    ->     authorization_code_value blob DEFAULT NULL,
    ->     authorization_code_issued_at timestamp DEFAULT NULL,
    ->     authorization_code_expires_at timestamp DEFAULT NULL,
    ->     authorization_code_metadata varchar(2000) DEFAULT NULL,
    ->     access_token_value blob DEFAULT NULL,
    ->     access_token_issued_at timestamp DEFAULT NULL,
    ->     access_token_expires_at timestamp DEFAULT NULL,
    ->     access_token_metadata varchar(2000) DEFAULT NULL,
    ->     access_token_type varchar(100) DEFAULT NULL,
    ->     access_token_scopes varchar(1000) DEFAULT NULL,
    ->     oidc_id_token_value blob DEFAULT NULL,
    ->     oidc_id_token_issued_at timestamp DEFAULT NULL,
    ->     oidc_id_token_expires_at timestamp DEFAULT NULL,
    ->     oidc_id_token_metadata varchar(2000) DEFAULT NULL,
    ->     refresh_token_value blob DEFAULT NULL,
    ->     refresh_token_issued_at timestamp DEFAULT NULL,
    ->     refresh_token_expires_at timestamp DEFAULT NULL,
    ->     refresh_token_metadata varchar(2000) DEFAULT NULL,
    ->     PRIMARY KEY (id)
    -> ) Engine=InnoDB;
ERROR 1118 (42000): Row size too large. The maximum row size for the used table type, not counting BLOBs, is 65535. This includes storage overhead, check the manual. You have to change some columns to TEXT or BLOBs

Suggested fix
The simplest fix here is to convert those large VARCHAR columns over to TEXT. VARCHAR will allocate their entire size in the row size calculation, where as TEXT/BLOB type columns will not, as they are stored by reference.
This issue is even more compounded when you factor in that most databases default to some utf8 type of encoding. UTF8 is going to make each of those VARCHAR sizes be n*4 + 1. that single 15K character VARCHAR for attributes is consuming > 60K bytes.

@laszlof thanks for the report. It seems possible that this began happening in mysql with 14cb58df2b334126d5ee0c69e4ddfb81edaa5011.
As mentioned in this comment:

It is very difficult to provide an implementation that works out of the box for all databases. This implementation strives to use standard sql datatypes and is a simplified JDBC implementation. However, it is designed to be customizable so user's can provide customizations for database vendors that deviate from the standard sql types.

In this case, I don't think mysql is non-standard. But it still applies that it is difficult to make a simplified JDBC implementation work across the board out of the box. This schema is really intended as a starting point, and the entire schema and implementation of JdbcOAuth2AuthorizationService is intended to be customized to meet your needs. You can start by customizing the sql to see if it can be adjusted for your case. I'm unsure, but you could possibly change to TEXT columns without code changes.
If that doesn't work, take a look at JdbcOAuth2AuthorizationServiceTests.tableDefinitionWhenCustomThenAbleToOverride(), which provides a test on how to override the table definition altogether. There are tests in that class that demonstrate how to customize further.
You may also be interested in implementing this using Spring Data. See this gist if you're interested in trying that approach: JpaOAuth2AuthorizationService. Note that we will hopefully be able to provide a concrete example of some of this in our upcoming reference documentation and how-to guides. Please upvote #545 if this is of interest to you.
I'm going to leave this issue open for now, so we can review it relative to the change to increase attributes to 15,000. However, I recommend you pursue customizing the schema and/or implementation and see how far you can get, as it really is our intention to provide a starting point more than an out of the box solution for all databases.

@sjohnr Thanks for the reply. We've already customized the schema on our end. I just wanted to bring awareness to the fact that the recent change in https://github.com/spring-projects/spring-authorization-server/commit/14cb58df2b334126d5ee0c69e4ddfb81edaa5011 effectively breaks its out of the box usage for all mysql databases.
I agree its difficult to provide an implementation that will work out of the box with all database. But perhaps building the schema in a way that works with at least the 2 most common, mysql, and postgres, would be worthwhile.
For our personal implementation, we're using an NDB cluster, so the issue is even more compounded as we're faced with a 30K byte row limitation rather than the typical 65535 byte's. I realize this is a bit more of an edge-case, so I dont expect it to be supported out of the box.

@laszlof The original commit that caused this issue has been reverted via e175f4fda384521f202be000457fdf9ddeca7c68.
As well, see gh-604 that provides an improvement to large data column support.

is it possible to provide separate script for different databases, rather than try to initialize all with a single script?


Fix crash on exit with shader editor

Editor plugins never get removed, so active_plugins had a null reference when the inspector is deleted when the editor is closed.
I wanted to remove them instead, but that caused issues with some plugins so I just clear active_plugins instead.

Does this solve:

https://github.com/godotengine/godot/issues/93529

Forgot to add the link, thanks.

Thanks!


Period is an invalid configuration Id character but it is not called out in the list in this document.

When creating ADM Configurations through the portal, the portal gives a visual error when you try to use a "." character.

The documentation currently does not indicate that "." is an invalid character for configuration Id.  This should be listed with the other invalid characters.  The portal UX also doesn't show the "." character in that screenshot in the list of invalid characters.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 6f635b47-2f9b-b55c-6dc8-3e680bb62b92
Version Independent ID: ee5ed6ae-b5dd-f218-21ec-b9fb5e087dbd
Content: Automatic device management at scale with Azure IoT Hub
Content Source: articles/iot-hub/iot-hub-automatic-device-management.md
Service: iot-hub
GitHub Login: @kgremban
Microsoft Alias: kgremban

@josephmsft Thanks for the feedback!
Our SME will review this soon.

besides '.',    ':',  '; ', ',' and '@' are also invalid characters per the azure portal.

#reassign JimacoMS4

Thanks @josephmsft! I updated the docs to reflect this in the PR referenced above (https://github.com/MicrosoftDocs/azure-docs-pr/pull/189403). I also updated the CLI topic. Please check out the PR for details.

#please-close