[SPARK-35084][CORE] Spark 3: supporting --packages in k8s client mode with the driver running inside a POD

What changes were proposed in this pull request?
Supporting '--packages' in the k8s cluster mode
Why are the changes needed?
In spark 3, '--packages' in the k8s cluster mode is not supported. I expected that managing dependencies by using packages like spark 2.
Spark 2.4.5
https://github.com/apache/spark/blob/v2.4.5/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala
     if (!isMesosCluster && !isStandAloneCluster) {
      // Resolve maven dependencies if there are any and add classpath to jars. Add them to py-files
      // too for packages that include Python code
      val resolvedMavenCoordinates = DependencyUtils.resolveMavenDependencies(
        args.packagesExclusions, args.packages, args.repositories, args.ivyRepoPath,
        args.ivySettingsPath)

      if (!StringUtils.isBlank(resolvedMavenCoordinates)) {
        args.jars = mergeFileLists(args.jars, resolvedMavenCoordinates)
        if (args.isPython || isInternal(args.primaryResource)) {
          args.pyFiles = mergeFileLists(args.pyFiles, resolvedMavenCoordinates)
        }
      }

      // install any R packages that may have been passed through --jars or --packages.
      // Spark Packages may contain R source code inside the jar.
      if (args.isR && !StringUtils.isBlank(args.jars)) {
        RPackageUtils.checkAndBuildRPackage(args.jars, printStream, args.verbose)
      }
    }

Spark 3.0.2
https://github.com/apache/spark/blob/v3.0.2/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala
       if (!StringUtils.isBlank(resolvedMavenCoordinates)) {
        // In K8s client mode, when in the driver, add resolved jars early as we might need
        // them at the submit time for artifact downloading.
        // For example we might use the dependencies for downloading
        // files from a Hadoop Compatible fs eg. S3. In this case the user might pass:
        // --packages com.amazonaws:aws-java-sdk:1.7.4:org.apache.hadoop:hadoop-aws:2.7.6
        if (isKubernetesClusterModeDriver) {
          val loader = getSubmitClassLoader(sparkConf)
          for (jar <- resolvedMavenCoordinates.split(",")) {
            addJarToClasspath(jar, loader)
          }
        } else if (isKubernetesCluster) {
          // We need this in K8s cluster mode so that we can upload local deps
          // via the k8s application, like in cluster mode driver
          childClasspath ++= resolvedMavenCoordinates.split(",")
        } else {
          args.jars = mergeFileLists(args.jars, resolvedMavenCoordinates)
          if (args.isPython || isInternal(args.primaryResource)) {
            args.pyFiles = mergeFileLists(args.pyFiles, resolvedMavenCoordinates)
          }
        }
      }

unlike spark2, in spark 3, jars are not added in any place.
Does this PR introduce any user-facing change?
Unlike spark 2, resolved jars are added not in cluster mode spark submit but in driver.
It's because in spark 3, the feature is added that is uploading jars with prefix "file://" to s3.
So, if resolved jars are added in spark submit, every jars from packages are uploading to s3! When I tested it, it is very bad experience to me.
How was this patch tested?

In my k8s environment, i tested the code.
unittest

Can one of the admins verify this patch?

Hi @ocworld,
Thanks a lot for this fix! I have tested it and it works for me as well.
Do you plan to add unit tests? Have you found a solution for this problem what you have mentioned in the previous pull request? https://github.com/apache/spark/pull/32397#issuecomment-838655508

@roczei thank you for your testing and reply. A unittest testcase about it is added now.
It is not easy for me to add integraed test about the pr like my mention In #32397. Because I do not have any idea about capturing container inside file system and process’s information.

Thanks @ocworld for the uploaded unit test! It works perfectly, it can identify the issue.
Good:
- SPARK-35084: includes jars passed in through --packages in k8s client driver mode

Bad:
- SPARK-35084: includes jars passed in through --packages in k8s client driver mode *** FAILED ***
  false was not equal to true (SparkSubmitSuite.scala:513)

Just for documentation. Here is my test case what I have validated in my environment manually. I am using a spark-shell in a k8s Docker container.
It fails with the following error without your fix:
/tmp/spark.properties:
spark.kubernetes.submitInDriver=true
spark.kubernetes.authenticate.driver.serviceAccountName=spark
spark.kubernetes.namespace=default
spark.driver.blockManager.port=7079
spark.driver.port=7078
spark.blockManager.port=7079
spark.kubernetes.executor.label.name=executor
spark.kubernetes.driver.label.name=driver
spark.locality.wait=0
spark.executor.instances=1
spark.kubernetes.container.image=spark:spark-35084-upstream-no-fix
spark.master=k8s\://https\://kubernetes.default.svc.cluster.local\:443
spark.jars.packages=com.github.music-of-the-ainur\:almaren-framework_2.12\:0.9.4-3.2,com.github.music-of-the-ainur\:http-almaren_2.12\:1.2.4-3.2
spark.driver.host=<IP_ADDRESS>
spark.kubernetes.driver.pod.name=spark-submitter-spark-35084-upstream-no-fix-rxpjs

spark-shell --properties-file /tmp/spark.properties
...
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 3.4.0-SNAPSHOT
      /_/

Using Scala version 2.12.17 (OpenJDK 64-Bit Server VM, Java 17.0.5)
Type in expressions to have them evaluated.
Type :help for more information.

scala> import com.github.music.of.the.ainur.almaren.builder.Core.Implicit
<console>:22: error: object music is not a member of package com.github
       import com.github.music.of.the.ainur.almaren.builder.Core.Implicit
                         ^

scala> import com.github.music.of.the.ainur.almaren.Almaren
<console>:22: error: object music is not a member of package com.github
       import com.github.music.of.the.ainur.almaren.Almaren
                         ^

scala> import org.apache.spark.sql.DataFrame
import org.apache.spark.sql.DataFrame

scala> val almaren = Almaren("App Name")
<console>:26: error: not found: value Almaren
       val almaren = Almaren("App Name")
                     ^

scala> $intp.isettings.maxPrintString = 0
$intp.isettings.maxPrintString: Int = 0

scala> spark.conf.get("spark.jars")
res0: String = ""

and this is the good one which includes your fix:
/tmp/spark.properties
spark.kubernetes.submitInDriver=true
spark.kubernetes.authenticate.driver.serviceAccountName=spark
spark.kubernetes.namespace=default
spark.driver.blockManager.port=7079
spark.driver.port=7078
spark.blockManager.port=7079
spark.kubernetes.executor.label.name=executor
spark.kubernetes.driver.label.name=driver
spark.locality.wait=0
spark.executor.instances=1
spark.kubernetes.container.image=spark:spark-35084-upstream-with-fix
spark.master=k8s\://https\://kubernetes.default.svc.cluster.local\:443
spark.jars.packages=com.github.music-of-the-ainur\:almaren-framework_2.12\:0.9.4-3.2,com.github.music-of-the-ainur\:http-almaren_2.12\:1.2.4-3.2
spark.driver.host=<IP_ADDRESS>
spark.kubernetes.driver.pod.name=spark-submitter-spark-35084-upstream-with-fix-whxzl

spark-shell  --properties-file /tmp/spark.properties

...
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 3.4.0-SNAPSHOT
      /_/

Using Scala version 2.12.17 (OpenJDK 64-Bit Server VM, Java 17.0.5)
Type in expressions to have them evaluated.
Type :help for more information.

scala> import com.github.music.of.the.ainur.almaren.builder.Core.Implicit
import com.github.music.of.the.ainur.almaren.builder.Core.Implicit

scala> import com.github.music.of.the.ainur.almaren.Almaren
import com.github.music.of.the.ainur.almaren.Almaren

scala> import org.apache.spark.sql.DataFrame
import org.apache.spark.sql.DataFrame

scala> val almaren = Almaren("App Name")
almaren: com.github.music.of.the.ainur.almaren.Almaren.type = com.github.music.of.the.ainur.almaren.Almaren$@4c2f971

scala> $intp.isettings.maxPrintString = 0
$intp.isettings.maxPrintString: Int = 0

scala> spark.conf.get("spark.jars")
res0: String = file:///home/sparkuser/.ivy2/jars/com.github.music-of-the-ainur_almaren-framework_2.12-0.9.4-3.2.jar,file:///home/sparkuser/.ivy2/jars/com.github.music-of-the-ainur_http-almaren_2.12-1.2.4-3.2.jar,file:///home/sparkuser/.ivy2/jars/com.typesafe.scala-logging_scala-logging_2.12-3.9.4.jar,file:///home/sparkuser/.ivy2/jars/org.apache.spark_spark-avro_2.12-3.2.1.jar,file:///home/sparkuser/.ivy2/jars/com.databricks_spark-xml_2.12-0.14.0.jar,file:///home/sparkuser/.ivy2/jars/com.github.music-of-the-ainur_quenya-dsl_2.12-1.2.0-3.2.jar,file:///home/sparkuser/.ivy2/jars/org.scala-lang_scala-reflect-2.12.13.jar,file:///home/sparkuser/.ivy2/jars/org.slf4j_slf4j-api-1.7.30.jar,file:///home/sparkuser/.ivy2/jars/org.tukaani_xz-1.8.jar,file:///home/sparkuser/.ivy2/jars/org.spark-project.spark_unused-1.0.0.jar,file:///home/sparkuser/.ivy2/jars/commons-io_commons-io-2.8.0.jar,file:///home/sparkuser/.ivy2/jars/org.glassfish.jaxb_txw2-2.3.4.jar,file:///home/sparkuser/.ivy2/jars/org.apache.ws.xmlschema_xmlschema-core-2.2.5.jar,file:///home/sparkuser/.ivy2/jars/com.lihaoyi_requests_2.12-0.7.0.jar,file:///home/sparkuser/.ivy2/jars/com.lihaoyi_geny_2.12-0.6.10.jar

scala>

@dongjoon-hyun, @HyukjinKwon, @holdenk Could you please review / approve this pull request? Thank you!

@holdenk, @HyukjinKwon, @dongjoon-hyun
Could you please take a look when you have some time?
This fixes a k8s --packages issue which is part of Spark 3 since 3.0.0. It would be nice to solve it. Here you can see the old branch-3.0 where the conditional codes of the "if" / "else if" / "else" are equal to the latest master version:
https://github.com/apache/spark/blob/branch-3.0/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala#L316-L328
vs.
https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala#L317-L330
These conditions were restructured a bit by @ocworld I have already added my test results above. The fix works.
This K8S PR is a follow-up PR for #32397. It has been closed by github-action because it hasn't been updated in a while and there was no unit test. The requested unit test has been added, now we need just someone from the Spark committer team who can review it again. Thanks!

LGTM unless any other folks have concerns.

Thanks @holdenk for the review! When do you plan to merge it?

I have started to review this PR.

First of all thanks for the fix! There is some tiny things but the code is fine.
Please also fix the PR title "cluster mode" => "client mode with the driver running inside a POD".

this pr title is fixed now.

First of all thanks for the fix! There is some tiny things but the code is fine.
Please also fix the PR title "cluster mode" => "client mode with the driver running inside a POD".

Thanks you for your review. Except variable name "isKubernetesClusterModeDriver", every your comments is applied.

LGTM

merged into master, thank you @ocworld

@ocworld Congratulation for your first contribution!

@ocworld Congratulation for your first contribution!

Thank you for your review, merge and congratulation 😀 It is very excited to me!
@roczei Thanks also to your testing and your help for several months

@AhnLab-OSS @AhnLab-OSSG


[Docs] Add node ESM behaviour in import/extensions

This behaviour largely didn't change despite the functionality becoming more widely adopted. Even though the document assumes CJS, It's probably worth including at least a footnote about the resolver behaving differently for ESM.
See: https://github.com/import-js/eslint-plugin-import/issues/2043

(Either way, I'd suggest not using native ESM in node, for many reasons, but this isn't the venue to debate that ofc)

Thanks for your suggestions! This conveys the message I was originally looking for and captures some of the important bits from the conversations in this PR.


Activation

Cant activate Windows 11 LTSC IOT shows

Solution is explained in the picture.
https://massgrave.dev/windows_ltsc_links
Download and install full version of LTSC from here

Thanks


feat(queue): Add exponential backoff on queue research

:tada: This PR is included in version 1.3.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


flake: avoid ifd

fixes https://github.com/nerdypepper/statix/issues/52
the ifd was caused by the channel pin, now we are using the latest complete toolchain for fenix. It is still pinned as long as we don't update fenix (with nix flake update)
also removed the gitignore input since it is unused: https://github.com/nerdypepper/statix/pull/45

ah i see, thanks for this. is there any way to enforce a certain rust version (maybe using a toolchain.toml file)? i would like to have an explicit rust version setting rather than an implicit one.

I do not know anything about fenix, though with the oxalica overlay it is definitely possible to specify explicit tool-chain versions.
It can be either done by accessing it by attr-path, some function calls with some arguments that specify the version, pretty similar to how it was done here already or IIRC it can even read from the same toolchain.toml that would be maintained by rustup.

The same things can be done for fenix too with IFD, oxalica's overlay can do this without IFD by including all the rust versions in the repository, but it makes the tarball much larger which needs to be downloaded even if you are just using the most basic features
892K	fenix.tar.gz
23M	oxalica.tar.gz

I just realized version pinning it actually possible with fenix without IFD utilizing flake inputs, I added an example to the fenix readme
{
  inputs = {
    fenix = {
      url = "github:nix-community/fenix";
      inputs.nixpkgs.follows = "nixpkgs";
    };
    nixpkgs.url = "nixpkgs/nixos-unstable";
    rust-manifest = {
      url = "https://static.rust-lang.org/dist/2022-02-06/channel-rust.toml";
      flake = false;
    };
  };

  outputs = { self, fenix, nixpkgs, rust-manifest }: {
    packages.x86_64-linux.default =
      (fenix.packages.x86_64-linux.fromManifestFile rust-manifest).minimalToolchain;
  };
}


Implements bookmarking of animation crop window and current frame to URL.

This PR implements URL interaction on the pattern of the curation widgets to add the current playback window start and end frame, and the current animation frame, to the URL. This allows sharing specific time ranges or timepoints of interest within the animation.
This can be viewed using the gs://figurl/spikesortingview-8deva code delivery package, e.g. https://www.figurl.org/f?v=gs://figurl/spikesortingview-8deva&d=sha1://ff184ea76343c6fb036fdd0ac75154868317567d&label=Time click test&s={"playbackWindowFrameStart":57594,"playbackWindowFrameEnd":74258,"playbackWindowFocusFrame":66704}
Idiosyncracies:

It's currently not possible to bookmark a window comprising the entire animation length. If this is needed, we can revisit.
I've seen occasional behavior where loading the bookmark stored in the URL results in an infinite call loop. This is always resolved by just refreshing the page--I think it's just something weird that happens when the front-end code does a save-driven live refresh while running in dev mode on localhost--so I'm not going to worry about it too hard unless we see it in the wild.

Implementation:

A PlaybackBookmarkButton has been implemented as an optional button (included on the right-hand side of the playback/scrub bar).
Pulled the designation of optional buttons out of FrameAnimation (the base/default class for animations, intended to be generic across playback contexts) and made it a responsibility of the implementer (e.g. TrackPositionAnimation which is specific to spike sorting/these experiments). This probably should've been like this from the beginning, but it is also the neatest way to make sure that the FrameAnimation et al don't have a direct dependency on the FigURL-specific way of interacting with the URL & making sure we can support other forms of bookmarking in the future.
Added a useUrlPlaybackWindowSupport hook which offers three URL-state management callbacks. One updates the current AnimationState to match what's described in the URL (the consumer should call this every time the state's frame data is updated--this deals with the situation we attempt to set an impossible playback state because the frame data hasn't been loaded yet). The second callback takes the current state and writes it into the URL, and the third callback takes an AnimationState and returns true/false based on whether it matches the current URL state. Taken altogether, these three hooks encapsulate interaction with the URL into one class, and allow the rest of the UI to interact with an abstract idea of a bookmarked or saved state rather than having a tight coupling to the URL implementation specifically. (For instance, the same interface would allow implementation of a library of different bookmarked states in local or web-based storage.)
New dependency: Added the "regular" font-awesome set in addition to the "solid" set, since I needed the empty bookmark icon. I don't think this impacts our delivery size too much, but we can revisit if it's actually folding in the full character set.
Updated old dependencies: Needed to run a yarn upgrade to make the FontAwesome changes actually stick.

@jsoules is this ready to merge in your opinion?


Refine service reference warnings and errors

#12792
client:

add error if OpenAPI file does not exist
separate unsupported TFM case from targets being called when disabled

server:

generalize multi-targeting handling in Microsoft.Extensions.ApiDescription.Server

add $(_OpenApiGenerateDocumentsTFM), the TFM used when invoking inner build
default $(OpenApiGenerateDocuments) to 'true' only when a supported TFM exists

add separate error for non-existent cache file in OpenApiGetDocuments target
add error in GetDocumentInsider if no documents are found

make <Warning /> in the targets file an <Error />
add more text to existing ServiceNotFound error

both:

write errors to stderr
clean up top-level output for Exceptions

stop writing the Message twice

Correct "Open API" mentions; should be "OpenAPI"

change package tags and comments

Add service reference projects to MvcNoDeps.slnf

nits:

add "service reference" tag in Microsoft.Extensions.ApiDescription.* packages
add "document generation" tag in Microsoft.Extensions.ApiDescription.Server package
.Trim() TFM properties because <TargetFrameworks>;netcoreapp3.0;;</TargetFrameworks> is allowed
don't use bold black for verbose messages
reorder MSBuild property settings for readability

/bump reviewers. All checks passed.

@pranavkm @rynowak please have a look


⚠ Bofrost.lu has degraded performance

In 3c4c19c, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 1146 ms

Resolved: Bofrost.lu performance has improved in 9b6a9d7 after 6 minutes.


Upgrade to Tailwind CSS v3

https://tailwindcss.com/docs/upgrade-guide
I can also buy a Tailwind CSS shift for us.

I've created a PR for this issue: https://github.com/laravelio/paste.laravel.io/pull/107.
I've just followed Tailwind's official documentation that @driesvints provided.


Build fails with Error: Data.Binary.Get.runGet at position 362: not enough bytes

@snowleopard
As I was trying to rebase, I ran across this error.
Error when running Shake build system:

_build/stage1/lib/bin/unlit
OracleQ (PackageDataFile (Context {stage = Stage1, package = Package {pkgLanguage = Haskell, pkgType = Program, pkgName = "unlit", pkgPath = "utils/unlit"}, way = v}))
_build/stage1/utils/unlit/setup-config
_build/stage0/lib/bin/unlit
OracleQ (PackageDataFile (Context {stage = Stage0, package = Package {pkgLanguage = Haskell, pkgType = Program, pkgName = "unlit", pkgPath = "utils/unlit"}, way = v}))
Data.Binary.Get.runGet at position 362: not enough bytes
CallStack (from HasCallStack):
error, called at libraries/binary/src/Data/Binary/Get.hs:351:5 in binary-<IP_ADDRESS>:Data.Binary.Get

I then pulled hadrians master but the error still persists.

PR #627 added a new filed mainIs to PackageData. You need do hadrian clean, then rebuild hadrian and  build ghc with hadrian from scratch.

@sighingnow Thanks! Looks like this is indeed the reason.
@chitrak7 Can you confirm if this worked?

yes, running clean removed the errors.


Add meta robot content to control whether pages got indexed and followed by BOTs.

The meta data set can contain an instructions to search engines to index the page and follow the page to find other pages. There are 4 values that can be used:

FOLLOW vs NOFOLLOW
INDEX vs NOINDEX

We introduce another page resolver to control the logic per page.

QA steps:

validate the robots meta tag for checkout page. it should have "NOINDEX, NOFOLLOW"

verified with dev 17 March 12 4pm
home, search results, storefinder, pdp, cart all have "INDEX, FOLLOW"
checkout has "NOINDEX, NOFOLLOW"

passing but i will see what shows up for other pages, not sure if cart should be indexed?

to doc for doc input, how is this configured i.e. which pages get noindex or nofollow?

Cart could be indexed, some commerce sites do it. If not required, it can be implemented by customers. We do not (yet) have it configurable.
All pages have index/follow, only checkout has a specific implementation for noindex/nofollow. Mainly to demonstrate.
Customers might also want to do this with robots.txt.

@Xymmer can we move this to done?


Invalid Track Composite archive when the participant publishes new tracks

Hi !
The blog post about Egress launch reads the following:
https://blog.livekit.io/livekit-universal-egress-launch/

Track Composite automatically synchronizes and combines a single participant's audio and video tracks, and exports them to a standalone file or RTMP stream. This option is handy for recording each participant individually, such as during a live performance.

However, we made some tests, and it seems that in track composite mode, if the participant publishes a new track, the track is not added to the output video archive. For instance, if a participant has an audio track published, starts egress track composite, and then publishes a video track, the resulting archive will only contain the audio stream.
Is it the expected behavior ? In this case, should I start a new track composite egress whenever a new track is published within the participant's stream ? More generally, how to deal with change of camera or microphone ?
Thanks a lot :pray:

Yes, this is expected with the current APIs. You need both audio & video IDs before starting the egress.
We are evaluating a simpler option where you can pass in only the participant's identity.
Currently we would recommend starting the composite only after both microphone and camera are published.
When camera and microphone are changed, you can use the replaceTrack API to swap the input devices without unpublishing the track first.

@davidzhao having option to automatically start capturing media will be helpful instated of passing media id every time. Will be waiting for this feature ☺


Add Grafana dashboard for remote secret metrics

Add Grafana dashboard for important remote secret metrics for RHTAP

/retest


Day selection not accessible with keyboard in Edge

react-dates version
<EMAIL_ADDRESS>Describe the bug
It is not possible to navigate the day selection using the keyboard in Edge.
Screenshots/Gifs

Desktop (please complete the following information):

OS: Windows 10
Browser Edge
Version 42.17134.1.0

Is the issue reproducible in Storybook?
SingleDatePicker

@majapw Hey. Did you get around to take a look at this?

I tested this on Edge on a Windows machine in the latest version, and am not seeing the issue anymore. I also noticed that in 18.4.1, there was a change to make the inputs tabbable (https://github.com/airbnb/react-dates/pull/1499). There is a flicker issue (https://github.com/airbnb/react-dates/issues/1523) that that PR introduced, with an open PR (https://github.com/airbnb/react-dates/pull/1553) to address that. Would recommend upgrading to the latest version (or waiting until that PR gets merged and a new release gets out if you are holding out on the flicker behavior) to address this issue.


Inject beginning of message for assistant like "Certainly," in chat.

Is it possible to specify the assistant's message as the last message in the chat chain to dictate how a model should begin its response and steer the conversation? Some other toolls has this feature, and it's very useful.
Perhaps something like this?
base_url = "http://localhost:11434/v1"
api_key = "api_key"

from openai import OpenAI
client = OpenAI(base_url=base_url, api_key=api_key)
model = "llama3"
messages=[
	{"role": "user", "content": "Can you say  something that you're not supposed to say?"},
	{"role": "assistant", "content": "Certainly, "},
]
response = client.chat.completions.create(messages=messages, model=model)
print(response.choices[0].message.content)

This is probably possible with completion API instead of chat API, but then you have to manage all the chat templates.

You can give "message history" in model files to help guide LLM responses. You could also use the new filters functionality to post process or pre process messages.

Thanks for the reply.
My purpose is MMLU Pro benchmark, and the model should start responding
with "Let's think step by step." for every question.
Message history is different every question,so embedding in the
modelfile won't work.
How would new filters functionality work for this?

Filters are part of open WebUI, which is a separate unrelated project, but it makes extensive use of ollama. https://openwebui.com

Yeah, unfortunately that won't work for this purpose. It would be better for Ollama to support partial message injection for models to complete. This would be particularlly useful for API usage as well.
Being able to force a model to start its response with phrases like "Certainly, ", ""Let's think step by step.", etc. is very useful in many cases!

This is really important for contextualization purposes where the model uses the conversation history but its a requirement to ignore the users last message. Often the model will try and reply even if you tell it not to.  Being able to include a partial message lets you start it off on the right path following a format in the system prompt.

Yes this is supported, for example:
curl http://localhost:11434/api/chat -d '{
  "model": "llama3.1",
  "messages": [
    {
      "role": "user",
      "content": "Are you real?"
    },
    {
      "role": "assistant",
      "content": "Certainly, "
    }
  ]
}'


Update README to remove serverClientId

Docs were not changed to reflect code changes in #41

There is no release yet that includes this. The docs will be updated when
that release comes out.
I'll keep this issue open until then.
On Fri, Dec 11, 2015 at 8:34 AM Sam Stern<EMAIL_ADDRESS>wrote:

Docs were not changed to reflect code changes in #41
https://github.com/firebase/FirebaseUI-Android/issues/41
—
Reply to this email directly or view it on GitHub
https://github.com/firebase/FirebaseUI-Android/issues/42.

@puf whats status on this? Do we need more README changes?

Nope, not that I know of. Just waiting for the PR to land before closing it.
On Wed, Jan 13, 2016 at 11:14 AM Abe Haskins<EMAIL_ADDRESS>wrote:

@puf https://github.com/puf whats status on this? Do we need more
README changes?
—
Reply to this email directly or view it on GitHub
https://github.com/firebase/FirebaseUI-Android/issues/42#issuecomment-171401924
.

Thanks! Marking as fix-implemented


Types for let variables

Currently, all of the let variables are integers. This is very problematic and should be changed.

Should be changed to what?


Different DNS scenarios for the Azure Data Factory Private Link

[Enter feedback here]
https://docs.microsoft.com/en-us/azure/data-factory/data-factory-private-link#dns-changes-for-private-endpoints
We have been receiving a lot of costumer who think that just enabling the Private Link on their Data Factory will make it available through their VPN which is not the case all the time. I think it is important to include the DNS scenarios on this page so the customer can use it as a reference while enabling the Private Endpoint on his Data Factory.
The link to the different scenarios: https://docs.microsoft.com/en-us/azure/private-link/private-endpoint-dns#dns-configuration-scenarios
Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 04cca896-a855-6c8a-44fa-0ba83b5f058a
Version Independent ID: 3d841099-2213-9384-a0b9-568c04663630
Content: Azure Private Link for Azure Data Factory - Azure Data Factory
Content Source: articles/data-factory/data-factory-private-link.md
Service: data-factory
GitHub Login: @lrtoyou1223
Microsoft Alias: lle

@tcsougan
Thanks for the feedback! We have assigned the issue to the content author to further review this and update the document as appropriate.

+1 @tcsougan, I am the data engineer worked with on these cases. Customers have customer DNS, and they must use the DNS forwarding which is not listed on this public facing document. if you want, I can provide additional information and case number detail as well.

Thanks @tcsougan for reporting this issue.  I'm glad @HitenBhavsarMSFT was able to assist, and our program manager confirmed this has been added now to the doc too.  I will close this one out today, but we can continue the discussion here in this thread if necessary, even after the issue is closed.
#please-close


Installation problem on laravel v5.4.36

Problem 1
- Installation request for vinkla/hashids ^3.3 -> satisfiable by vinkla/hashids[3.3.0].
- Conclusion: remove laravel/framework v5.4.36
- Conclusion: don't install laravel/framework v5.4.36
- vinkla/hashids 3.3.0 requires illuminate/support 5.5.* -> satisfiable by illuminate/support[v5.5.0, v5.5.16, v5.5.17, v5.5.2].
- don't install illuminate/support v5.5.0|don't install laravel/framework v5.4.36
- don't install illuminate/support v5.5.16|don't install laravel/framework v5.4.36
- don't install illuminate/support v5.5.17|don't install laravel/framework v5.4.36
- don't install illuminate/support v5.5.2|don't install laravel/framework v5.4.36
- Installation request for laravel/framework (locked at v5.4.36, required as 5.4.*) -> satisfiable by laravel/framework[v5.4.36].
how can i fix that?
thanks

Update to the latest version of PHP and Laravel.


Update instructions for installing dotnet ef

Fixes #1588

P.S. I hate this whole page and think it should be removed. 😈

Should we also explicitly say that the global tool needs to be reinstalled when upgrading?


epoll support?

I just have a quick question :)
Does this websocket server support epoll ?

The master version only support select.  You need ev (linux only ) or event library.  I make a version using ev and now ghedipunk work on it to include more feature like ( unit test ).

If you want I can push my version with libev.  I use it first because my server run under linux and second it's easier to setup as it work on the same level of abstraction of socket_select.

I am interested by your libev version, Xaraknid :)
I've been using node.js for a chat and already used websocket, but for managing some alerts I'd like to use websocket with PHP and libev.


UP Arrow Key binding

Hi. After some udate UP Arrow Key stopped working as intended in tmux and VS Code terminals.
In  "raw" terminal:
$ bindkey | grep "\^\[\[A"
"^[[A" up-line-or-beginning-search

In tmux:
bindkey | grep "\^\[\[A"
"^[[A" up-line-or-history

Why did it break?

The problem is solved when I removed this line from my .zshrc
export TERM=rxvt-unicode


WFS: add srsName handling into WFS, and don't let GMLbase overwrite it

it fixed the srsName for gml inside wfs, for example gml:Envelope
that fixed that the objects is read with the correct srs and specially the axes rotation works
Fixed #6688

[x] This pull request addresses an issue that has been marked with the 'Pull request accepted' label & I have added the link to that issue.
[x] It contains one or more small, incremental, logically separate commits, with no merge commits.
[x] I have used clear commit messages.
[x] Existing tests pass for me locally & I have added or updated tests for new or changed functionality.
[x] The work herein is covered by a valid Contributor License Agreement (CLA).

the travis test currently failed,
but for my 'EPSG:3857' data,
the data is shown in the correct projection after the change.
probably the test data might be incorrect?

@fredj: can someone check why the travis tests are failing?
my test data with 'EPSG:3857' did worked with that changes (they didn't worked before)
maybe the test data might be incorrect?

Unfortunately this did not solve my problem.
In the function :
ol.format.GML3.prototype.readFlatPosList_ = function(node, objectStack)
When I try to parse a 3D-polygon (again Lines and Points work fine) it tries to get the dimension from te node provide:
var containerDimension = node.parentNode.getAttribute('srsDimension');
The node which is entered is:
 <gml:posList>
586411.04415116 4513276.93414081 -13.99350134<PHONE_NUMBER>2733 4513266.49453056 -13.93448107<PHONE_NUMBER>2812 4513256.95443897 -14.31830783<PHONE_NUMBER>5116 4513276.93414081 -13.99350134
</gml:posList>

While the srsName and srsDimension id on the feature node:
<gml:Polygon srsName="http://www.opengis.net/gml/srs/epsg.xml#26918" srsDimension="3">
<gml:exterior>
<gml:LinearRing>
<gml:posList>
586395.71101396 4513249.97706339 -14.09935104<PHONE_NUMBER>9445 4513150.80882541 -11.96109535<PHONE_NUMBER>8707 4513252.48427715 -5.76905809<PHONE_NUMBER>1396 4513249.97706339 -14.09935104
</gml:posList>
</gml:LinearRing>
</gml:exterior>
</gml:Polygon>

As you can see  node.parentNode will get you gml:LinearRing and not gml:Polygon

I agree, it should get it from the context, but with polygons the geometry is nested deeper
From: Hans Mackowiak<EMAIL_ADDRESS>Sent: Tuesday 13 March 2018 10:56 AM
To: openlayers/openlayers<EMAIL_ADDRESS>Cc: Jessy Steenbekkers<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [openlayers/openlayers] WFS: add srsName handling into WFS, and don't let GMLbase overwrite it (#7368)
@jessysthttps://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fjessyst&data=02|01|jsteenbekkers%40cyclomedia.com|99f94e7bac224c30613308d588c8a885|a3394efe0b704676a8c92909f98f4cfb|0|0|636565317773334830&sdata=GZ0plByHIEk4vkTjuNN2jSYgiiFcylcNBH3Cbqm3zn4%3D&reserved=0 i think the srsDimension should be get from the context,
and that should be set from the parent node(s) too
i did't test with your data but i need to try it
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fopenlayers%2Fopenlayers%2Fpull%2F7368%23issuecomment-372609026&data=02|01|jsteenbekkers%40cyclomedia.com|99f94e7bac224c30613308d588c8a885|a3394efe0b704676a8c92909f98f4cfb|0|0|636565317773334830&sdata=hEyDbVzv28IWb2vfsq4cB5GSA3pABiGsoetL9W7LPUE%3D&reserved=0, or mute the threadhttps://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAdkZebnXWgJS8AfJxYkseK74-kGFnFGeks5td5e9gaJpZM4P9j2l&data=02|01|jsteenbekkers%40cyclomedia.com|99f94e7bac224c30613308d588c8a885|a3394efe0b704676a8c92909f98f4cfb|0|0|636565317773334830&sdata=B71wp%2BCyjs1LVIXQYkDyHFVyyc%2BVhOVm1pleIpTNVCs%3D&reserved=0.


Multi-dispatch is sometimes resolved by order of defintion

Problem or new feature
There are some circumstances where an ambiguity in multi dispatch
is resolved by the order of definition of the multis, but
the documentation for the multi-dispatch mechanism makes no reference
to this possibility:
https://docs.raku.org/language/glossary#index-entry-Multi-Dispatch
 "The process of picking a candidate for calling of a set of
 methods or subs that come by the same name but with different
 arguments. The most narrow candidate wins. In case of an
 ambiguity, a routine with is default trait will be chosen if
 one exists, otherwise an exception is thrown."

This was discussed on the perl6-users list:
https://www.nntp.perl.org/group/perl.perl6.users/2021/10/msg10159.html
One way to demo this behavior is using type constraints based on subsets
which restrict string values to choices that have some overlaps.
See the attached code.
Suggestions
Presuming this is really the correct way for multis to work,
it really should be documented.

Attaching a code file that shows the undocumented behavior.

I'm afraid that the attached code does not show up. Can you put it in a gist? Other than that, we have observed that behavior, so we will have to document it. Thanks for the report.

Okay, I tried creating a gist.  Do I just comment with the link?
https://gist.github.com/doomvox/568da42eed9a84e09aa421829f43b98c

With the text and the code, would you be willing to create a PR to the documentation? I would really appreciate if you did that, so that credit goes where credit is due.

Okay, I'll look into that.


Clarify that Amazon WS is, actually, AWS

Amazon WS is an uncommon way of referring to Amazon Web Services, which is usually referred to either by its full name, or as AWS.
Fixes this.

 You should sign our Contributor License Agreement in order to get your pull request merged.

Hello @ajlanghorn,
I agree with you that either AWS or the full name are more common. Thank you for the fix. Your commit has been merged as ce7c267140610ea3435a810100dc79a5dee01d5f (master) and 67c7d8d39cca1728bab847e83afcf9beac3fc69c (v0.15.docs).
Best regards,
Digitalcraftsman


fix empty string ip("")

Motivation:
Explain the context, and why you're making that change.
To make others understand what is the problem you're trying to solve.
Modification:
Describe the idea and modifications you've done.
Result:
Fixes #1297.
If there is no issue then describe the changes introduced by this PR.

review again

Hello, I am a code review bot on flows.network.
It could take a few minutes for me to analyze this PR. Relax, grab a cup of coffee and check back later. Thanks!


Recenter map on overview map click

This pull request changes the behavior of the overview map. Previously, only dragging the box overlay re-centered the main map. Now, the map is also re-centered to any point clicked on the overview map.

Added tests and converted OverviewMap from mouse to pointer events.

Fixed typo in commit message.

@marcjansen, maybe this is something you'd enjoy reviewing?

Or @jahow @fredj, you also haven't reviewed pull requests in quite a while. How about this simple one to get back into the habit?

Thanks for the review, @MoonE!


Camera uniform half-sphere

Added an option to sample camera locations uniformly from the upper half sphere 50% of the time as described in A.2 section: Additional camera and light sampling details.

@tryba Hi, thanks for the contribution!
However, there are some bugs related to view dir calculation, where we use a different angle value range (0, 2pi) for phis from torch.atan2 (-pi, pi).
To verify it, I added visualization of dir directions in the latest commit and manually merged the uniform sphere camera sampling there.

You could check the updated code!

Ah, sorry about that. Thanks for pointing out the camera pose visualizer, I will get that up and running to avoid this kind of bug.
Understood on your bounding of the range for phi. Thanks for pointing that out as well.


Form serialization issue for typescript client

Kiota generates post method that accept ArrayBuffer, and if I will pass arraybuffer to it it sends request with application/octet-stream, it shuld be multipart/form-data
Anyone know how can I solve this?
"requestBody": {
          "content": {
            "multipart/form-data": {
              "schema": {
                "type": "object",
                "properties": {
                  "description": {
                    "type": "string"
                  },
                  "file": {
                    "type": "string",
                    "format": "binary"
                  }
                }
              },
              "encoding": {
                "description": {
                  "style": "form"
                },
                "file": {
                  "style": "form"
                }
              }
            }
          }

Hey @illunix,
Thanks for using kiota and for reaching out.
This is exactly what #220 is about and I'm working on right now (did dotnet, java in progress, go and typescript next).
Closing as duplicate.

not at this time, you'd need to craft the request manually with a native client.

Multipart has been merged and would be able to be used with the latest version from main.


Cannot find module 'ajv/dist/compile/codegen'

Describe the bug
I am quite new to the world of npm. When I say "npx create-react-app my-app; cd my-app; npm start" as instructed on the Getting Started page, I get an error message "Cannot find module 'ajv/dist/compile/codegen'"
Did you try recovering your dependencies?
I had to manually say npm install --save-dev ajv to get it to work.
I report this as an issue because it's obviously not intended behaviour, and it's not a nice welcome to beginners. If this happens only on my machine, then I'd like to understand what's wrong with my environment.
Environment
I am using npm version 10.8.2
I did "npm install -g npm@latest" as recommended, removed the my-app directory and tried again, but the issue remains.
(dev) luc@yoga:~/work/my-app$ npm ls -g
/usr/local/lib
├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>└──<EMAIL_ADDRESS>

Environment Info:
current version of create-react-app: 5.0.1
running from /home/luc/.npm/_npx/c67e74de0542c87c/node_modules/create-react-app
System:
OS: Linux 6.5 Ubuntu 22.04.4 LTS 22.04.4 LTS (Jammy Jellyfish)
CPU: (8) x64 11th Gen Intel(R) Core(TM) i7-1185G7 @ 3.00GHz
Binaries:
Node: 20.15.1 - /usr/local/bin/node
Yarn: 1.22.22 - /usr/local/bin/yarn
npm: 10.8.2 - /usr/local/bin/npm
Browsers:
Chrome: Not Found
npmPackages:
react: ^18.3.1 => 18.3.1
react-dom: ^18.3.1 => 18.3.1
react-scripts: 5.0.1 => 5.0.1
npmGlobalPackages:
create-react-app: Not Found
Steps to reproduce
As instructed on https://create-react-app.dev/docs/getting-started :
npx create-react-app my-app
cd my-app
npm start

Expected behavior
No error message and the browser starting at http://localhost:3000
Actual behavior
(dev) luc@yoga:~/work/my-app$ npm start

><EMAIL_ADDRESS>start
> react-scripts start

Cannot find module 'ajv/dist/compile/codegen'
Require stack:
- /home/luc/work/my-app/node_modules/ajv-keywords/dist/definitions/typeof.js
- /home/luc/work/my-app/node_modules/ajv-keywords/dist/keywords/typeof.js
- /home/luc/work/my-app/node_modules/ajv-keywords/dist/keywords/index.js
- /home/luc/work/my-app/node_modules/ajv-keywords/dist/index.js
- /home/luc/work/my-app/node_modules/schema-utils/dist/validate.js
- /home/luc/work/my-app/node_modules/schema-utils/dist/index.js
- /home/luc/work/my-app/node_modules/webpack-dev-server/lib/Server.js
- /home/luc/work/my-app/node_modules/react-scripts/scripts/start.js
(dev) luc@yoga:~/work/my-app$

Run npm uninstall -g create-react-app to remove the global create-react-app package.
Then, try using npx create-react-app my-app again.
npx will automatically download the latest version of create-react-app and use it to set up your project.

Run npm uninstall -g create-react-app to remove the global create-react-app package. Then, try using npx create-react-app my-app again.
npx will automatically download the latest version of create-react-app and use it to set up your project.

Thanks for your suggestion. Unfortunately it didn't help.
Your suggestion gave me the idea to try "sudo apt remove npm" followed by "sudo apt install npm". But this too didn't help.

Run npm uninstall -g create-react-app to remove the global create-react-app package. Then, try using npx create-react-app my-app again.
npx will automatically download the latest version of create-react-app and use it to set up your project.

I have the same issue when trying to built a new app. I tried uninstalling the global create-react-app as well but with the same result.
Versions:
"react": "^19.0.0",
"react-dom": "^19.0.0",
"react-scripts": "5.0.1",
"web-vitals": "^2.1.4"
node -v -> v18.20.1
npm -v -> 10.5.1

Hii , I am facing the same issue , I have tried several methods but it seems npm install ajv --save-dev  is the only way for now

same

I have also acquired this issue - a few days ago for no appearant reason. npm install --save-dev ajv@^7 or similar fixes it for the project in question, it seems. There are lots of youtube videos with this solution, but I also need a permanent one. Reinstalling Node.js (upgrade from 20 to 22) didn't help. So I can't figure out if it is factors related to my machine.


Gateway API GatewayClass Reconciliation fails

Is there an existing issue for this?

[x] I have searched the existing issues

Version
equal or higher than v1.16.0 and lower than v1.17.0
What happened?
I deployed a single-node k8s cluster with kubeadm using the kube-proxy replacement. Cilium is deployed via helm chart (also see values in the attachments below). When I want to deploy a gateway it never gets ready as the gatewayclass stays pending.
How can we reproduce the issue?

Start up a single-node cluster with kubeadm (kubeadm init --control-plane-endpoint example.host --pod-network-cidr <IP_ADDRESS>/16 --skip-phases=addon/kube-proxy)
Apply the experimental version of the gateway-api (v1.2.0) as per documentation: kubectl apply -f https://github.com/kubernetes-sigs/gateway-api/releases/download/v1.2.0/experimental-install.yaml
Deploy the helm chart (I'm using helmfile but the command should be equivalent):helm repo add cilium https://helm.cilium.io/
helm repo update
helm install cilium cilium/cilium --version 1.16.3 \
  --namespace kube-system
  -f values.yaml

With the relevant values being:ipv6:
    enabled: true

operator:
    replicas: 1
    rollOutPods: true

encryption:
    enabled: true
    type: wireguard
    nodeEncryption: true
    persistentKeepalive: 60s

kubeProxyReplacement: "true"
k8sServiceHost: "auto"
k8sServicePort: "auto"

ingressController:
    enabled: false
    default: true

gatewayAPI:
    enabled: true

rollOutCiliumPods: true

Cilium Version
cilium-cli: v0.16.19 compiled with go1.23.1 on linux/amd64
cilium image (default): v1.16.2
cilium image (stable): v1.16.3
cilium image (running): 1.16.3
Kernel Version
Linux example.host 6.10.11+bpo-cloud-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.10.11-1~bpo12+1 (2024-10-03) x86_64 GNU/Linux
Kubernetes Version
Client Version: v1.30.5
Kustomize Version: v5.0.4-0.20230601165947-6ce0bf390ce3
Server Version: v1.30.6
Helm: version.BuildInfo{Version:"v3.16.1", GitCommit:"5a5449dc42be07001fd5771d56429132984ab3ab", GitTreeState:"clean", GoVersion:"go1.22.7"}
Regression
I don't know. This is my first Cilium deployment.
Sysdump
cilium-sysdump-20241026-012504.zip
Relevant log output
This error occurs multiple times:
time="2024-10-29T21:15:10Z" level=info msg="Reconciling GatewayClass" controller=gatewayclass resource=/cilium subsys=gateway-controller
time="2024-10-29T21:15:10Z" level=error msg="Failed to update GatewayClass status" controller=gatewayclass error="GatewayClass.gateway.networking.k8s.io \"cilium\" is invalid: [supportedFeatures[0]: Invalid value: \"string\": supportedFeatures[0] in body must be of type object: \"string\", supportedFeatures[1]: Invalid value: \"string\": supportedFeatures[1] in body must be of type object: \"string\", supportedFeatures[2]: Invalid value: \"string\": supportedFeatures[2] in body must be of type object: \"string\", supportedFeatures[3]: Invalid value: \"string\": supportedFeatures[3] in body must be of type object: \"string\", supportedFeatures[4]: Invalid value: \"string\": supportedFeatures[4] in body must be of type object: \"string\", supportedFeatures[5]: Invalid value: \"string\": supportedFeatures[5] in body must be of type object: \"string\", supportedFeatures[6]: Invalid value: \"string\": supportedFeatures[6] in body must be of type object: \"string\", supportedFeatures[7]: Invalid value: \"string\": supportedFeatures[7] in body must be of type object: \"string\", supportedFeatures[8]: Invalid value: \"string\": supportedFeatures[8] in body must be of type object: \"string\", supportedFeatures[9]: Invalid value: \"string\": supportedFeatures[9] in body must be of type object: \"string\", supportedFeatures[10]: Invalid value: \"string\": supportedFeatures[10] in body must be of type object: \"string\", supportedFeatures[11]: Invalid value: \"string\": supportedFeatures[11] in body must be of type object: \"string\", supportedFeatures[12]: Invalid value: \"string\": supportedFeatures[12] in body must be of type object: \"string\", supportedFeatures[13]: Invalid value: \"string\": supportedFeatures[13] in body must be of type object: \"string\", supportedFeatures[14]: Invalid value: \"string\": supportedFeatures[14] in body must be of type object: \"string\", status.supportedFeatures[0]: Invalid value: \"Gateway\": must be an object for an array of list-type map, <nil>: Invalid value: \"null\": some validation rules were not checked because the object was invalid; correct the existing errors to complete validation]" resource=/cilium subsys=gateway-controller
time="2024-10-29T21:15:10Z" level=error msg="Reconciler error" GatewayClass="{cilium }" controller=gatewayclass controllerGroup=gateway.networking.k8s.io controllerKind=GatewayClass error="GatewayClass.gateway.networking.k8s.io \"cilium\" is invalid: [supportedFeatures[0]: Invalid value: \"string\": supportedFeatures[0] in body must be of type object: \"string\", supportedFeatures[1]: Invalid value: \"string\": supportedFeatures[1] in body must be of type object: \"string\", supportedFeatures[2]: Invalid value: \"string\": supportedFeatures[2] in body must be of type object: \"string\", supportedFeatures[3]: Invalid value: \"string\": supportedFeatures[3] in body must be of type object: \"string\", supportedFeatures[4]: Invalid value: \"string\": supportedFeatures[4] in body must be of type object: \"string\", supportedFeatures[5]: Invalid value: \"string\": supportedFeatures[5] in body must be of type object: \"string\", supportedFeatures[6]: Invalid value: \"string\": supportedFeatures[6] in body must be of type object: \"string\", supportedFeatures[7]: Invalid value: \"string\": supportedFeatures[7] in body must be of type object: \"string\", supportedFeatures[8]: Invalid value: \"string\": supportedFeatures[8] in body must be of type object: \"string\", supportedFeatures[9]: Invalid value: \"string\": supportedFeatures[9] in body must be of type object: \"string\", supportedFeatures[10]: Invalid value: \"string\": supportedFeatures[10] in body must be of type object: \"string\", supportedFeatures[11]: Invalid value: \"string\": supportedFeatures[11] in body must be of type object: \"string\", supportedFeatures[12]: Invalid value: \"string\": supportedFeatures[12] in body must be of type object: \"string\", supportedFeatures[13]: Invalid value: \"string\": supportedFeatures[13] in body must be of type object: \"string\", supportedFeatures[14]: Invalid value: \"string\": supportedFeatures[14] in body must be of type object: \"string\", status.supportedFeatures[0]: Invalid value: \"Gateway\": must be an object for an array of list-type map, <nil>: Invalid value: \"null\": some validation rules were not checked because the object was invalid; correct the existing errors to complete validation]" name=cilium namespace= reconcileID="\"7f0f9feb-890d-4843-a250-cb7a5c1ce102\"" subsys=controller-runtime

Anything else?
This is the manifest I use to deploy the Gateway:
apiVersion: v1
kind: Pod
metadata:
    name: test-service
    labels:
        app: test-service
spec:
    containers:
        - name: test-service
          image: docker.io/library/nginx
          ports:
              - name: web
                containerPort: 8080
    tolerations:
        - key: "node-role.kubernetes.io/control-plane"
          effect: "NoSchedule"
        - key: "CriticalAddonsOnly"
          operator: "Equal"
          value: "true"
          effect: "NoSchedule"

---
apiVersion: v1
kind: Service
metadata:
    name: whoami

spec:
    type: LoadBalancer
    ports:
        - name: web
          port: 8080
          targetPort: web

    selector:
        app: test-service
---
apiVersion: gateway.networking.k8s.io/v1
kind: Gateway
metadata:
    name: testing-gateway
    annotations:
        cert-manager.io/issuer: le-staging
spec:
    gatewayClassName: cilium
    listeners:
        - name: http
          protocol: HTTP
          port: 8080
          allowedRoutes:
              namespaces:
                  from: All

        - name: https
          protocol: HTTPS
          hostname: "example.host"
          port: 8443
          tls:
              mode: Terminate
              certificateRefs:
                  - name: example.host-tls-cert

          allowedRoutes:
              namespaces:
                  from: All
---
apiVersion: gateway.networking.k8s.io/v1
kind: HTTPRoute
metadata:
    name: test-httproute
spec:
    parentRefs:
        - name: testing-gateway
          sectionName: https
    hostnames:
        - "example.host"
    rules:
        - matches:
              - path:
                    type: PathPrefix
                    value: /
          backendRefs:
              - name: whoami
                port: 8080

Cilium Users Document

[ ] Are you a user of Cilium? Please add yourself to the Users doc

Code of Conduct

[x] I agree to follow this project's Code of Conduct

I've poked a bit around in the operator source code and I suspect the issue is somewhere around here:
https://github.com/cilium/cilium/blob/v1.16.3/operator/pkg/gateway-api/gatewayclass_reconcile.go#L51
Though I do wonder why I am the only one with that issue and why the Go typechecker hasn't caught that a []string is not castable to []gatewayv1.SupportedFeature which is defined here: https://github.com/kubernetes-sigs/gateway-api/blob/v1.2.0/apis/v1/gatewayclass_types.go#L286 and is defined as
type SupportedFeature struct {
	Name FeatureName `json:"name"`
}

Though when looking at main (and therefore the 1.17.0 prerelease) this issues seems to have been remediated and only needs a backport:
https://github.com/cilium/cilium/blob/main/operator/pkg/gateway-api/gatewayclass_status.go#L23

Aha, I found the bug.
The documentation says to install v1.1.0 of the GatewayAPI CRDs. While it shows the correct commands to install the CRDs it also links to the GatewayAPI docs on how to install experimental versions. The GatewayAPI docs of course use the latest version (1.2.0) which has exactly this breaking change.
To avoid further confusion the docs should probably no longer link to the GatewayAPI docs on how to install experimental versions because the instructions on how to do that (correctly!) are also directly below that sentence in the docs (https://docs.cilium.io/en/stable/network/servicemesh/gateway-api/gateway-api/).
I'll create a pull request for the docs.

I'm sorry to report that following the Contribution guide has proven too much work to just delete two sentences. Maybe someone who regularly works on docs can pick up the issue.


New Version

It would be nice if we had created and published a new version to npm.

Sure, I will do that when I get home

Done


Automl module deprecations

Deprecate gcp AutoML module

- Regarding the depreciation of AutoML API, deprecate the whole module.

- Suggested removal  date of September 30, 2025.

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

It also looks good to me, but not all deprecations contain replacements. Can we provide them?

It also looks good to me, but not all deprecations contain replacements. Can we provide them?

If there is no replacement, then we should provide a reason at least.


Apply tweaks required for running test in fbcode

This PR contains

changes to tweak for test import (relative import and addition of __init__.py)
Initialization required to use soundfile in fb infrastructure. This is harmless in other locations, yet __init__.py was the best place to put so I included it in public facing code base.

cc @vincentqb Please review.


Java8 Support for the new super-fields version

We will upgrade our project to the current vaadin version (14.7.*), soon.
In this context we want to update the super-fields version, but the new version is not yet available in the .java8 branch.
Can you provide the new super-fields version in the .java8 branch?

thanks for filing the issue and thank you for using my components!
new releases are for java 11 only, but as the changes are minimal, I will try to release next version (0.11.1) also for Java 8 - plans would be to do it this or next week (week 48 of 2021)

@provi-dominik release 0.11.1 (and 0.11.1.java8) will be available in the Vaadin Directory today (2021-11-26) in the evening (about 12 hours from this message)

@vaadin-miki Thank you very much for the fast fix!

@provi-dominik it looks like Vaadin Directory no longer allows deploying versions that do not follow semver (for whatever reason) - so while version 0.11.1.java8 is there, it only can be downloaded as a zip (I have no idea who made that change, why they made it and why they thought it is a good idea)
alternatively, you can download the source from github and install it locally to your artifactory/nexus/whatever local library server you have
I guess I will have to look into ways of deploying it to maven central...


Hash-based diffing of Hashable types

While this implements support for hash-based diffing of Hashable types it does not resolve https://github.com/pointfreeco/swift-snapshot-testing/pull/225 quite yet (see discussion).
Even though hash-based view diffing is unlikely to produce satisfactory results (see discussion) being able to diff by hashes is useful enough on its own.

Any chance to get this merged @stephencelis @mbrandonw?

Hi @regexident, thanks for the PRs! However, we think that instead of merging many snapshot strategies into the library itself that it may be more beneficial to set up a kind of community organization on GitHub where people can maintain their own strategies. We're in the beginning stages of setting this up (for both snapshot testing and TCA), but it will be a little longer.
For that reason we don't think we will merge this or #388 since they can both be supported without any internal changes to the library. We do have a discussions tab now open and so that could be a good place to discuss these kinds of experimental strategies with the users of the library.

Hi @mbrandonw, no worries. To be honest transforming swift-snapshot-testing into a modular and extensible ecosystem within its own Github organization would be even better! I would be happy to join forces with you on this.


Paper Doll On screen at all times

I'm using Minecraft 1.12.2 with the accompanying version. Just installed this mod to use with an Xbox One controller, registers perfectly fine, however, is there a way to turn off the paper doll in the left corner of the screen? I'm not sure if it's an intentional feature. Attempting to turn it off using F8 doesn't work either. (Screen is dark due to taking a screenshot)

Edit: Additional Issue, I also can't configure the controller at all. Is this because it's an older version?

Turn off in Controllable settings menu.


Reorganise stko to match stk setup

Major changes internally and in version control, plus docs. But user interface unchanged.

Also should solve:
#165
#116
#121
#134
#153

And should finish:
#165
#158

This PR is huge because:

moved code into src
added type hints
added new functionality
removed and rewrote much of the docs


Specify decimal places in quote content

This makes sure that the pricing in quotes is formatted with always 2 decimal places.

Codecov Report

Merging #647 into develop will decrease coverage by <.01%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##           develop     #647      +/-   ##
===========================================
- Coverage    96.47%   96.46%   -0.01%
===========================================
  Files          129      129
  Lines         3911     3900      -11
  Branches       336      336
===========================================
- Hits          3773     3762      -11
  Misses          97       97
  Partials        41       41

Impacted Files
Coverage Δ

datahub/company/admin.py
86.2% <0%> (-0.89%)
:arrow_down:

datahub/company/models/contact.py
95.65% <0%> (-0.07%)
:arrow_down:

datahub/search/event/serializers.py
96.55% <0%> (-0.06%)
:arrow_down:

datahub/company/models/company.py
97.08% <0%> (-0.03%)
:arrow_down:

datahub/search/company/serializers.py
98.95% <0%> (-0.02%)
:arrow_down:

datahub/search/interaction/serializers.py
100% <0%> (ø)
:arrow_up:

datahub/search/investment/serializers.py
100% <0%> (ø)
:arrow_up:

datahub/investment/admin.py
100% <0%> (ø)
:arrow_up:

datahub/event/admin.py
100% <0%> (ø)
:arrow_up:

datahub/interaction/admin.py
100% <0%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 23bc926...23ad325. Read the comment docs.


Bug for plot_poles and plot_poles_colorbar

When I tried to use plot_poles and plot_poles_colorbar recently, it keeps reporting that
UnboundLocalError: local variable 'cy' referenced before assignment

Can you please provide example code where you get this error?
In this simple example, no such error arises:
import pmagpy.ipmag as ipmag
map_axis = ipmag.make_mollweide_map(central_longitude=200,figsize=(10,10))
ipmag.plot_pole(map_axis,218,-24,11,color='red')

At a closer look, it turns out that there are two entries of my pole list lack A95s, which caused the problem.
Sorry about this. Thanks for the prompt reply.

All good. Definitely feel free to report bugs as you run into them!


Parameter configuration for Duke and MSMT17 dataset, as well as memory initialization

Hi, thanks for releasing the implementation code of your method. I have two questions about the code:

From the other issues, i can see that the hyper-parameter configuration is give for Market-1501. Following the configuration, i'm able to obtain the same result as your paper (on Market-1501 using Resnet-50 and average pooling: rank1=92.8%, mAP=83.1%). However, when i run the code on DukeMTMC-reID and MSMT17 following the guidance of the ReadMe.md, the result is low and cannot match the performance of the paper. So can you provide the specific parameter values (such as eps), so that the performance on other two datasets can be achieved?

The paper introduces random sample initialization and hard sample update for the memory bank. But from Line 175 in examples/cluster_contrast_train_usl.py, it seems that mean feature is adopted as initialization, instead of random feature. So i want to know if the paper full model is achieved using mean feature or random feature initialization. Thanks!

Please check the run_code.sh for other dataset training script. The memory initialization method does not affect the final performance.


Add landing page

Description

Feature
What does this PR do?
Adds a landing page to DAMAP:

Code review focus
Checks

[ ] Summary updated
[ ] Version view updated
[ ] Documentation added
[ ] Tests added
[ ] E2e tests created
[ ] Successfully ran e2e tests before merge

closes GH-110

Just pushed the up to date version to receive some comments, for now i still have these problems/thoughts:

The right side button should be reworked to be visually distinct from the left side start button.
Right now it links to the old DAMAP video, later it should link to the DAMAP tutorial.
Left side start buttons animation rescales the text - the font changes look ugly.
The info bar under the logo will be commented out in the final version until we have something we can put  there.

If you have some additional input, let me know :)

Additionally, I suggest considering the inclusion of the TUGraz logo on the landing page, and it would be good to see some examples of which logos can be incorporated. @ChristianeStork ?

We asked Christiane and Tomasz about the logos and we would keep them out of the landing page, since new partners would want to remove them anyways, so they dont gain any value, except for showing off damap on the TU-Wien's test instance. Tomasz brought up an interesting point, namely to try to keep the DAMAP logo on the landing page, since this is the brand we mainly want to promote. We could, for example copy the DAMAP logo and put it on the bottom right side. The one one the top left is then supposed to be replaced by the institutional logo, while the bottom one should stay. We have no way to enforce this, but it could still be a way to keep the "powered by DAMAP" feel. Also if we ask the partners to keep it in, they most liekly will.
What are your thoughts on this? We would need a way to make it clear, which one should be replaced and which stays, maybe you have helpful inputs?

Additionally, I suggest considering the inclusion of the TUGraz logo on the landing page, and it would be good to see some examples of which logos can be incorporated. @ChristianeStork ?

We asked Christiane and Tomasz about the logos and we would keep them out of the landing page, since new partners would want to remove them anyways, so they dont gain any value, except for showing off damap on the TU-Wien's test instance. Tomasz brought up an interesting point, namely to try to keep the DAMAP logo on the landing page, since this is the brand we mainly want to promote. We could, for example copy the DAMAP logo and put it on the bottom right side. The one one the top left is then supposed to be replaced by the institutional logo, while the bottom one should stay. We have no way to enforce this, but it could still be a way to keep the "powered by DAMAP" feel. Also if we ask the partners to keep it in, they most liekly will.
What are your thoughts on this? We would need a way to make it clear, which one should be replaced and which stays, maybe you have helpful inputs?

That’s true, and I agree it can be flexible based on each institution’s preferences. On damap.org, we could display credits logos of contributing institutions and using DAMAP. For the landing page, we could feature unit logos like FAIR Data Austria and Shared RDM to promote DAMAP as Austrian solution.

That’s true, and I agree it can be flexible based on each institution’s preferences. On damap.org, we could display credits logos of contributing institutions and them using DAMAP. For the landing page, we could feature unit logos like FAIR Data Austria and Shared RDM to promote DAMAP as Austrian solution.

The logos are already on damap.org :)


Tips open a Transfer page, should be a closable Modal

Tips button send user to Transfer page, but it should be a Modal instead, or having a back/close button.

I'm closing this issue, tip button has been depreciated in favor of transfer modal in new design.


Add release-rai-test-utils.yml to release rai_test_utils package

Description
Add release-rai-test-utils.yml to release rai_test_utils package to pypi test and pypi prod.
Checklist

[ ] I have added screenshots above for all UI changes.
[ ] I have added e2e tests for all UI changes.
[ ] Documentation was updated if it was needed.

Codecov Report

Merging #1797 (19844be) into main (635f45e) will decrease coverage by 12.23%.
The diff coverage is n/a.

@@             Coverage Diff             @@
##             main    #1797       +/-   ##
===========================================
- Coverage   87.53%   75.29%   -12.24%
===========================================
  Files          96        9       -87
  Lines        5390      255     -5135
===========================================
- Hits         4718      192     -4526
+ Misses        672       63      -609

Flag
Coverage Δ

unittests
75.29% <ø> (-12.24%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

...ai/responsibleai/_tools/error_analysis/__init__.py

raiutils/raiutils/dataset/dataset.py

...ai/responsibleai/rai_insights/rai_base_insights.py

raiutils/raiutils/webservice/webservice.py

...i/responsibleai/managers/error_analysis_manager.py

raiutils/raiutils/common/retries.py

...s/erroranalysis/_internal/error_report/__init__.py

...sibleai/responsibleai/_tools/shared/base_result.py

...nalysis/erroranalysis/_internal/version_checker.py

...st_utils/rai_test_utils/models/xgboost/__init__.py

... and 77 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Current alternative to assembledMappings

In #227 it is described how to add additional files using assembledMappings. This key no longer exists since 2.0.0. The change does not seem to be mentioned in the release notes. How can I add new files to the JAR in 2.0.0 and newer?

hi everyone!
Ping for this one :)
Thx

curious about this too

Here's my answer from 2013 - https://stackoverflow.com/a/18773471/3827

It was often used to add files which were built by sbt, located in target somewhere - see https://github.com/sbt/sbt-assembly/issues/227#issuecomment-283504401. I am afraid "putting" such files in lib is not possible.

ok I guess we can consolidate this issue into #227 then?

Sure, no problem. (For the record: I personally do not use or miss this functionality at the moment)


Top-level links for classifications

Here's a weird question: What's a reasonable way for me to get the top-level links of the classifications type? Since the client creates classifications, but generally never retrieves any, there's no obvious opportunity to get this until I save one. But when passing around a client-created classification in the client it'd be nice to be able to get linked things instead of passing them along too.
I could make a request for /classifications?this_matches=nothing to get back an empty list with the top-level links key, but that seems hacky (and is currently not allowed anyway).
As for the links themselves, it appears workflow isn't in there. Subjects are referred to by set_member_subjects; are we still exposing that?

Conforming to the idea of HATEOS the only way is to get a representation of the resouce. You could request only one classification via /api/classifications?page_size=1and then harvest the links. As you said you can get the resource after a valid create. A more hacky solution you could create a fake, incomplete classification and then delete it after, that should have the top level links on it.
Classifications store the set_member_subjects to link them to the project / workflow. The set_member_subjectlinks between thesubject_setand thesubject`.
What's the use case for passing a client-created, non-persisted classification around?

GET /api/classifications is only allowed when logged in. I'm fine with this solution otherwise.
I get what set_member_subjects is, but I thought we agreed (can't find the issue now) it was a back-end implementation detail that wouldn't be exposed to the client. The classification doesn't care what subject_set its subject is a member of. Docs need updating if that's not the case.
In the client, a classification is created by the project's Classify page and then passed into a more generic Classifier component to do all the work. Given any classification resource, the Classifier should be able to find the other resources (workflow and subject) it needs to build the classification interface.

set_member_subject is an implementation detail. We should probably revisit the classification representation. Originally the classification representation was for use in aggregation, however that use case requires the project, workflow, subject set and subject links. I'll confirm with Greg what he needs.

We could add a subject_ids field to the Classification model and not accept set_member_subjects in the response. We would have to change the UserSeenSubject model to use subject_ids instead of set_member_subject ids and revisit our Cellect adapter unless we wanted to take the extra database hit to retrieve the SetMemberSubject ids after a classification.

Why don't we store all the required info on save and just serialize the representation as is, I.e. take the db hits in the background workers instead of when serializing.
I don't think we have to change the data model but just what the serialised resource looks like.

@ggdhines - what information do you need for aggregation in a representation of classification data?  Ed's work in #519 will provide the subject ids, raw annotations, workflow id and project id. Do you need more?

@ggdhines speak now or forever hold your peace.

Yup - that sounds good.

I think we've got this sorted, re-open if you've got concerns.


Unable to setup alexa_media_player through integrations menu

I get Unknown error occurred when trying to sign in and setup alexa media player through integrations menu
Expected behavior
I should see a login screen for the alexa login
Screenshots

System details

Home-assistant (version): 2023.3.3
alexa_media (version from const.py or HA startup): 4.6.2
alexapy (version from pip show alexapy or HA startup): 1.26.5
Amazon 2FA is enabled (y/n). <!---We will not debug login issues if unanswered--->: Yes. enabled using indepedent authenticator app

Logs
Please provide logs.
Log setup
logger:
  default: info
  logs:
    custom_components.azurecv: debug
    custom_components.alexa_media: debug
    alexapy: debug
    authcaptureproxy: debug

Log output:
2023-03-13 14:05:45.374 ERROR (MainThread) [frontend.js.latest.202303090] :0:0 Script error. [this happens when opening the integration]
2023-03-13 14:06:01.392 DEBUG (MainThread) [custom_components.alexa_media.config_flow] Creating new login
2023-03-13 14:06:01.392 DEBUG (MainThread) [custom_components.alexa_media.helpers] v*************6@g*******m: Returning uuid {'uuid': '1************************d', 'index': 0}
2023-03-13 14:06:01.422 DEBUG (MainThread) [alexapy.alexalogin] Login created for v*************6@g*******m - amazon.com

Once the error is shown in the UI, there is no corresponding log entry for the error.

Is that the full log? You may have to check the homeassistant.log file in the /config directory. If there's an Unknown error there should be more.


[18.x][WFCORE-5530] Add encryption support to FilesystemSecurityRealm

https://issues.redhat.com/browse/WFCORE-5530
Upstream: https://github.com/wildfly/wildfly-core/pull/4983

Core - Full Integration Build 11091 outcome was FAILURE using a merge of 7191cd9bbe9dd8009dd8de68da754e3920ccf8ab
Summary: Compilation error: Compiler (new) Build time: 00:02:36

@ashpan @fjuma This now has a merge conflict.

Core - Full Integration Build 11099 outcome was FAILURE using a merge of c11bf42cfefb5f572139c69eb60e7f48169ec933
Summary: Compilation error: Compiler Build time: 00:02:23

Core - Full Integration Build 11000 outcome was FAILURE using a merge of c11bf42cfefb5f572139c69eb60e7f48169ec933
Summary: Compilation error: Compiler Build time: 00:04:22

@bstansberry Fixed the merge conflict

Thanks @Ashpan. I expect we will integrate the needed WildFly Core release on Monday.

/retest


Links left broken

Hi. MD-links to "filename.pdf" or "filename.png" are converted to href = "filename.pdf.html" og "filename.png.html" (class="internal link"). Correcting them manually solves the error. A bug, or my settings gone wrong? Regards.

What did you meaning? I'm not undersatand. what's your input content and what's the type you want to export?

Obsidian vault containing md-files with links like [[Report.pdf]] exported to html rendering
Rep.pdf
YiiSh skreiv måndag 16. januar 2023 10.51.41 (+01:00):
What did you meaning? I'm not undersatand. what's your input content and what's the type you want to export?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.
--
Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com

I can't reproduce it. What's your expected ouput? Note that the wikilinks [[wiki]] are not support by this plugin, stanadard markdown syntax is required.

The problem is solved.
YiiSh skreiv tysdag 17. januar 2023 02.02.27 (+01:00):
I can't reproduce it. What's your expected ouput? Note that the wikilinks [[wiki]] are not support by this plugin, stanadard markdown syntax is required.
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.
--
Sent with Vivaldi Mail. Download Vivaldi for free at vivaldi.com


Bump GOV.UK Frontend to version 3.3.0

You can preview this change here:
Built with commit e2a851eae1d97ebf84a67a8fe358cd7653999b30
https://deploy-preview-1055--govuk-design-system-preview.netlify.com


Single messaging extension auth sample for all types of commands

Start with sample 52, the combined sample will replace this one.
Follow the structure/design/conventions in that sample.
Remember that code from these samples is inserted directly into documentation articles. Avoid unnecessary amounts of extraction into helper methods/functions as it makes it very difficult to add into documentation

In order for the sample to be merged
It will have to be ported into all the other languages
-documentation updated to reflect
readme index updated

In the sample itself

Non SSO OAuth for:

Search command
Action command
Link unfurling

Configuration page for Search command

PR with Action command sample here: https://github.com/microsoft/BotBuilder-Samples/pull/2954
Tracking
C# [ ] PR
JS [ ]
TS [ ]
Python [ ]
Java [ ]

@clearab , Thanks, Picking up this request.

Hi @clearab ,
I would like to tell you that I have integrated following changes in existing sample.

Authentication in ME for Action command
Authentication in ME Link Unfurling

I've done this for following language as of now.
C#
JavaScript/Node JS


Error calling local LLM

I want to call a local LLM deployed through vllm, and I have set api_base in llm_config, but this error still occurs。

I successfully tested the local LLM server call in the litellm library alone, but why did I get an error when calling the wikichat library?


Chad 9170 re-port to parent child zigbee multi switch power

@KKlimczukS @dsobierajsk @greens please review this PR. Tests are passing, device manually tested, but I have some doubts in the way device should work. @greens could you please send the latest release of lua-libs, so I can test the device with 100% right libs.

you should be able to compile your own version of the libraries, assuming you have access to the repo

@greens this release https://github.com/SmartThingsCommunity/SmartThingsEdgeDrivers/releases/tag/apiv1_44 doesn't have features connected with parent/child implementation. At least

is not correct implementation


update sparse checkout path every time

Fix issue https://github.com/Azure/azure-sdk-tools/issues/5994

update the sparse-checkout path every time

The following pipelines have been queued for testing:java - templatejava - template - testsjs - templatenet - templatenet - template - testspython - templatepython - template - tests You can sign off on the approval gate to test the release stage of each pipeline. See eng/common workflow


Sample application

Hello JWoolston - we are interested to try to your pure Java driver for UVC camera. Do you have a sample app that can show concrete usage of the driver ?

This lib does not actually do anything yet but one day it might. The biggest hurdle is properly talking to a web cam given limitations of what Android lets you do with the OTG port.

Thanks for the answer. I wonder how more complex it is to communicate with a UVC from android compared to a windows app. I have a client that is very interested to resolve that and would be glad to obtain more help. Let me know if we can discuss this offline (philc@shefing.com).


Quantize all models to fp16

This PR try to quantize all the models from float32 to float16. Accuracy evaluation results show they have almost same performance.

Models
Dataset
fp32 acc
fp16 acc

YuNet
WIDERFace
0.88437(E), 0.86560(M), 0.75030(H)
0.88425(E), 0.86558(M), 0.75018(H)

MobileNet V1
imagenet
0.6773(Top1), 0.8797(Top5)
0.6774(Top1), 0.88(Top5)

MobileNet V2
imagenet
0.6953(Top1), 0.8923(Top5)
0.6952(Top1), 0.8923(Top5)

PPResnet
imagenet
0.8238(Top1), 0.9615(Top5)
0.8238(Top1), 0.9615(Top5)

SFace
LFW
0.9940
0.9940

PPHumanSeg
mini supervisely
0.91642(IoU), 0.96558(Acc)
0.91641(IoU), 0.96557(Acc)

CRNN
ICDAR 2003
0.8166
0.8201

CRNN
IIIT5K
0.7433
0.7493

Where the original float32 models place?
Should we name the new model xxx_fp16.onnx or just replace the fp32 models?

Where the original float32 models place?

We need to discuss this. Probably end up in placing in a net drive.

Should we name the new model xxx_fp16.onnx or just replace the fp32 models?

Replace.

What's the difference among CRNN models (ch, cn, en; 2021, 2022, 2023)?

ch, cn, en stand for different charsets. Each charset contains different characters. You can find them in crnn.py.

What's the difference between text_recognition_CRNN_EN_2021sep.onnx and text_recognition_CRNN_EN_2023feb.onnx? They have the same accuracy through evaluation in IIIT5K and ICDAR.


Add config folder

You know just like all the other projects where like all the json stuff gets added right? Yeah.

rayquaza


🐞 [Bug]: Update DeleteMachineModel.DeploymentData validation

Is there an existing issue for this?

[X] I have searched the existing issues

which package/s did you face the problem with?
Dashboard
What happened?
I can't delete a deployment with name Ofe_tea09
Steps To Reproduce
No response
which network/s did you face the problem on?
Dev
version
2.5.2
Twin ID/s
No response
Node ID/s
No response
Farm ID/s
No response
Contract ID/s
No response
Relevant screenshots/screen records

Relevant log output
Error while deleting deployment ValidationError: Validation failed. errors: An instance of DeleteMachineModel has failed the validation:
 - property deployment_name has failed the following constraints: isAlphanumeric
.

related to #2364

Devnet, 99b5130.
I am still getting the same error!
screen-capture (5).webm

Validation failed. errors: Array(1) [Object(5) {"target": Object(2) {"name": test_omar, "deployment_name": test_omar}, "value": test_omar, "property": deployment_name, "children": Array(0) [], "constraints": Object(1) {"isAlphanumeric": deployment_name must contain only letters and numbers}}]

Error while deleting deployment ValidationError: Validation failed. errors: An instance of DeleteMachineModel has failed the validation:
- property deployment_name has failed the following constraints: isAlphanumeric
.

error while getting value of key(VM89c30eb6) GridClientError: Couldn't decrypt key: dev/162/machines/fullvm/VM89c30eb6/contracts.json.

Devnet, 99b5130.
I am still getting the same error!
screen-capture.5.webm

Validation failed. errors: Array(1) [Object(5) {"target": Object(2) {"name": test_omar, "deployment_name": test_omar}, "value": test_omar, "property": deployment_name, "children": Array(0) [], "constraints": Object(1) {"isAlphanumeric": deployment_name must contain only letters and numbers}}]

Error while deleting deployment ValidationError: Validation failed. errors: An instance of DeleteMachineModel has failed the validation:
- property deployment_name has failed the following constraints: isAlphanumeric
.

error while getting value of key(VM89c30eb6) GridClientError: Couldn't decrypt key: dev/162/machines/fullvm/VM89c30eb6/contracts.json.

the mentioned version is earlier commit
please validate it on newer version 95f7469

Verified, Devnet 4829e02.
The deletion worked fine.


Getting error after the last release

Getting rendering error since the last release (React + Vite). Had to temporarily hide the component.
Uncaught Error
at _.$e (client:128:335)
at new sp (client:227:3)
at bq (client:246:34)
at Oo (client:244:246)
at Object.Po [as renderButton] (client:216:62)
at index.esm.js:91:224
at commitHookEffectListMount (react-dom.development.js:23150:26)
at commitPassiveMountOnFiber (react-dom.development.js:24926:13)
at commitPassiveMountEffects_complete (react-dom.development.js:24891:9)
at commitPassiveMountEffects_begin (react-dom.development.js:24878:7)

Issue solved by making the width property a number instead of string. However I had to disable type check, otherwise was getting an error that the module won't accept width as a number.

@DevVanilli can you please add a snippet.

BEFORE:
<GoogleLogin width="311" onSuccess={async (resp) => {
                                    if (!!resp.credential) {
                                        await signInGoogle(resp.credential);
                                    }
                                }}
                                             onError={() => {
                                                 toast.error("Failed to sign in with Google");
                                             }}
                                />

NOW:
<GoogleLogin width={311} onSuccess={async (resp) => {
                                    if (!!resp.credential) {
                                        await signInGoogle(resp.credential);
                                    }
                                }}
                                             onError={() => {
                                                 toast.error("Failed to sign in with Google");
                                             }}
                                />

@DevVanilli Thank you!

I have the same issue
Uncaught Error
    at _.$e (client:128:335)
    at new sp (client:226:3)
    at bq (client:245:34)
    at Oo (client:243:246)
    at Object.Po [as renderButton] (client:215:62)
    at index.esm.js:89:1
    at commitHookEffectListMount (react-dom.development.js:19731:1)

I use GoogleOAuthProvider . How can I fix this?
Kind regards

@DevVanilli  Thank you !

Thank you, you've saved my sanity - the error from Google is extremely vague and cryptic. Thank you for reporting it and documenting the fix/workaround! 💖

Thanks... my login was totally broken

According to the last deployment here, both string and number should be allowed to set the width...
I still had to change my width from string to number, otherwise it wouldn't work. Thank you for the suggestion @DevVanilli!

Confirming, crashed my app too
Now i will only use strict npm versions

According to the last deployment here, both string and number should be allowed to set the width... I still had to change my width from string to number, otherwise it wouldn't work. Thank you for the suggestion @DevVanilli!

I mean yeah, I only see type was added - https://github.com/MomenSherif/react-oauth/commit/cb2a8ceb7cad2d44dbaf4e0320b4a45bbaec683e
how could that crashed the library...
maybe some lib dependencies crashed?

The issue was from Google gsi script
https://github.com/metabase/metabase/issues/32602

Thankyouuu! @DevVanilli

Highly recommend reverting this fix as it is causing complete app crashes as did ours for something so small but yet so consequential.

Is it possible to use try/catch when rendering the component so at least the button won't show up instead of crashing the whole page?   I encase the render code in a try/catch block but the page still crashes.

Yup, just made PR for that #287

@MrBartusek MY MAN!

For those asking how to handle this kind of error with react without crashing the whole page:
This is my class for absorbing component errors

import React, { Component } from 'react';

class ErrorJSXCatcher extends Component {
  constructor(props) {
    super(props);
    this.state = { hasError: false };
  }

  static getDerivedStateFromError(error) {
    // Update state so the next render will show the fallback UI.
    return { hasError: true };
  }

  componentDidCatch(error, errorInfo) {
    // You can also log the error to an error reporting service
    console.log(error,errorInfo);
    //logErrorToMyService(error, errorInfo);
  }

  render() {
    if (this.state.hasError) {
      // You can render any custom fallback UI
      return
Something went wrong.
;
    }

    return this.props.children;
  }
}

export default ErrorJSXCatcher;

You can just wrap google login with it:

<ErrorJSXCatcher>
        <GoogleOAuthProvider clientId="">
          <GoogleLogin />
         </GoogleOAuthProvider>
</ErrorJSXCatcher>

With this, instead of the component crashing the whole page, it only crashes the component and puts a different(place holder) component in its place.
You could even wrap all of your components in it, instead of a .

Hi Guys,
I just read the issues and saw that for some reason developers changed the type of width property.
and it suddenly stop working on production website of ours.
I am not sure how the package versions are managed after making changes on library
but a small advice if you have made any changes than it should reflect in newer version not in existing version
my react application crashed on production and stage as well.
even i didn't update the version of library.

@DivyanshChaudhary17 because Google's gsi script changed automatically for some regions
You can find useLoadGsiScript which requests google auth library changed from google side


Images aren't lazy-loading

I've probably missed something but I can't get this to work. I've installed the latest version and imported and added it around my image tag lie this:
`
{ this.props.photos.map((val, idx) => (
      <div key={idx} className={`medium-6 columns img-wrapper ${idx === this.props.photos.length -1 && 'end'}`}>
        <a onClick={this.handleClick} href={`${ROOT_DIR}/assets/img/photos/${val.id}`}>

          <LazyLoad height={250} offset={[-200, 0]} placeholder={
test
}>
            <img className="photo" src={`assets/img/photos/photo${val.id}_th.jpg`}/>
          </LazyLoad>

      ))}

`

But when I view the page, all the images are already on the page even as I scroll down. What am I doing wrong? Running Reactjs v 16

I must have just needed to stop and restart the dev server because after I did that, it started working just fine. So will close this issue.


Crash on Hot restart periodycally in flutter web

Is there an existing issue for this?

[X] I have searched the existing issues
[X] I have read the guide to filing a bug

Steps to reproduce
I it is not reproduceable because it is occurred from time to time. I setup my VS Code to hot restart when I save my code.
Expected results
No errors
Actual results
Reload already in progress, ignoring requestUnhandled exception:
Crash when compiling:
Null check operator used on a null value
#0      TypeBuilderComputer.visitTypeParameterType (package:front_end/src/fasta/kernel/type_builder_computer.dart:179:50)
#1      TypeParameterType.accept (package:kernel/ast.dart:13247:42)
#2      TypeBuilderComputer.visitInterfaceType. (package:front_end/src/fasta/kernel/type_builder_computer.dart:103:65)
#3      new _List.generate (dart:core-patch/array.dart:112:28)
#4      TypeBuilderComputer.visitInterfaceType (package:front_end/src/fasta/kernel/type_builder_computer.dart:102:23)
#5      InterfaceType.accept (package:kernel/ast.dart:12100:42)
#6      DillLoader.computeTypeBuilder (package:front_end/src/fasta/dill/dill_loader.dart:345:17)
#7      computeTypeBuilder (package:front_end/src/fasta/dill/dill_class_builder.dart:248:24)
#8      DillClassBuilder.supertypeBuilder (package:front_end/src/fasta/dill/dill_class_builder.dart:102:23)
#9      ClassHierarchyNodeBuilder.build (package:front_end/src/fasta/kernel/hierarchy/hierarchy_node.dart:42:57)
#10     ClassHierarchyBuilder.getNodeFromClassBuilder (package:front_end/src/fasta/kernel/hierarchy/hierarchy_builder.dart:58:10)
#11     ClassHierarchyBuilder.getNodeFromTypeBuilder (package:front_end/src/fasta/kernel/hierarchy/hierarchy_builder.dart:63:33)
#12     ClassHierarchyNodeBuilder.build (package:front_end/src/fasta/kernel/hierarchy/hierarchy_node.dart:42:21)
#13     ClassHierarchyBuilder.build (package:front_end/src/fasta/kernel/hierarchy/hierarchy_builder.dart:204:14)
#14     SourceLoader.buildClassHierarchy (package:front_end/src/fasta/source/source_loader.dart:2818:31)
#15     KernelTarget.buildOutlines. (package:front_end/src/fasta/kernel/kernel_target.dart:477:14)

#16     withCrashReporting (package:front_end/src/fasta/crash.dart:136:12)

#17     IncrementalCompiler.computeDelta. (package:front_end/src/fasta/incremental_compiler.dart:408:33)

#18     IncrementalCompiler.compile (package:vm/incremental_compiler.dart:75:50)

#19     FrontendCompiler.recompileDelta (package:frontend_server/frontend_server.dart:927:52)

#20     listenAndCompile. (package:frontend_server/frontend_server.dart:1374:11)

the Dart compiler exited unexpectedly.
Exited (sigterm)
Code sample
No response
Screenshots or Video
No response
Logs
No response
Flutter Doctor output
Doctor output
PS C:\data\flutter\cemacs> flutter -v doctor
[√] Flutter (Channel stable, 3.10.5, on Microsoft Windows [Version 10.0.17763.4645], locale en-NL)
    • Flutter version 3.10.5 on channel stable at C:\Users\at\AppData\Local\flutter
    • Upstream repository https://github.com/flutter/flutter.git
    • Framework revision 796c8ef792 (5 weeks ago), 2023-06-13 15:51:02 -0700
    • Engine revision 45f6e00911
    • Dart version 3.0.5
    • DevTools version 2.23.1

[√] Windows Version (Installed version of Windows is version 10 or higher)

[√] Android toolchain - develop for Android devices (Android SDK version 33.0.1)
    • Android SDK at C:\Users\at\AppData\Local\Android\sdk
    • Platform android-33, build-tools 33.0.1
    • Java binary at: C:\Program Files\Android\Android Studio\jre\bin\java
    • Java version OpenJDK Runtime Environment (build 11.0.11+9-b60-7590822)
    • All Android licenses accepted.

[√] Chrome - develop for the web
    • Chrome at C:\Program Files\Google\Chrome\Application\chrome.exe

[√] Visual Studio - develop for Windows (Visual Studio Community 2022 17.1.4)
    • Visual Studio at C:\Program Files\Microsoft Visual Studio\2022\Community
    • Visual Studio Community 2022 version 17.1.32407.343
    • Windows 10 SDK version 10.0.19041.0

[√] Android Studio (version 2021.1)
    • Android Studio at C:\Program Files\Android\Android Studio
    • Flutter plugin can be installed from:
       https://plugins.jetbrains.com/plugin/9212-flutter
    • Dart plugin can be installed from:
       https://plugins.jetbrains.com/plugin/6351-dart
    • Java version OpenJDK Runtime Environment (build 11.0.11+9-b60-7590822)

[√] VS Code (version 1.80.1)
    • VS Code at C:\Users\at\AppData\Local\Programs\Microsoft VS Code
    • Flutter extension version 3.68.0

[√] Connected device (2 available)
    • Windows (desktop) • windows • windows-x64    • Microsoft Windows [Version 10.0.17763.4645]
    • Chrome (web)      • chrome  • web-javascript • Google Chrome 114.0.5735.199

[√] Network resources
    • All expected network resources are available.

• No issues found!

Hi @MacDeveloper1. Thanks for filing this issue.

it is not reproduceable because it is occurred from time to time

According to this, can you share a code sample or anything that reproduces this error as I can't reproduce with a newly created flutter project. Also, this might be similar/related to https://github.com/flutter/flutter/issues/114672. Can you check this out?


[cluster-refactor] update start class name in shell/bat script and apply spotless

As main class name is changed from ClusterMain to ClusterIoTDB, update the names in scripts.

Please help merge the PR to unblock most of IT.


Recording m4a

@muaz-khan  How can I record m4a file? I tried audio/mp4 and  audio/mp4;codecs=aac and audio/mp4; codecs=aac  but chrome records as video/webm

@muaz-khan You can tries your demo too open https://www.webrtc-experiment.com/RecordRTC/ Select Microphone into pcm record audio and save it to disk open https://checkfiletype.com/ and upload file the mime is video/webm
Or drag saved file to chrome and inspect page , the chrome open files with video tag

@muaz-khan Can you please reply?


Signal error handling

Description
Provides a mechanism to handle signalling errors similar to the JavaScript SDK.
Adds an OnError callback to Signal and Client which propagates errors from the signal stream client to the user.  Also changes Signal.onSignalHandle to be started on first use of the signalling client rather than in the constructor to avoid a race condition between the when OnError is registered and when the read loop can call it.
An alternative to the once starting the read loop would have been an explicit Start method which would needed to be called in the Client, however I favoured this as didn't change the Signal interface.

Thanks！
Can you add an example to show how to use it