judges-action#200: add total_issues_and_pulls to Fbe::Graph

Need for https://github.com/zerocracy/judges-action/issues/200

@Suban05 please review

@rultor release, tag is 0.0.69

@rultor release, tag is 0.0.69

@yegor256 OK, I will release it now. Please check the progress here

@rultor release, tag is 0.0.69

@yegor256 Done! FYI, the full log is here (took me 10min)

@Yegorov Great job on your contribution! 🎉 You've earned +4 points, bringing your total to +166. While there's room for improvement in code reviews and comments, we appreciate your effort. Keep up the momentum and continue to enhance your contributions!


Add hypervisor cores report

Add OOTB report for number of physical/hypervisor cores.
USPTO Tags: USPTO - License column seems to not be available.
Screenshot

Links [Optional]
https://bugzilla.redhat.com/show_bug.cgi?id=1437589
Steps for Testing/QA [Optional]
Cloud Intel ->  Reports -> Configuration Management -> Virtual Machines -> Hypervisor Cores -> Queue

@h-kataria please look at this, I am not 100% sure, that this is right.

@PanSpagetka can you paste a screenshot of report output

@h-kataria screenshot added

Changed to WIP.  I need to discuss this with PM as the customer case is solved and I see no need for an OOTB report to be added.

Closing this PR, BZ closed as not a bug.


Make buttons work in old IE, and in combination

This pull request:

adds type='submit' so that they will submit their parent form in all browsers (without this they do nothing in IE 7 and below)
adds an optional name parameter which gets submitted with the other elements of a form, so that the backend can detect which button has been pressed
changes from a button element to an input element so that the above works consistently in all browsers

9.0.0 :+1:


loader fixes

Loader animation is fixed and also the time of the loader is increased to 2.5 seconds

Yeah sure I'll fix that

Also, please mention the issue number.

@KiranAminPanjwani this is fixed now issue no 39

Happy Contributing! 😊🎉


Video generates with subtitles, but no audio

Hey,
I'm getting the video generation out, but I'm not able to hear any audio while the audio files are created.
Is there any way to fix this?

Can you provide the cmd console

This is from point of query entry:
`[+] Cleaned ../temp/ directory
[+] Cleaned ../subtitles/ directory
[Video to be generated]
Subject: write a video about ai
Artificial Intelligence (AI) has revolutionized the way we live and work. From self-driving cars to virtual assistants, AI is transforming various industries and impacting our daily lives in profound ways. In this video, we will explore the fascinating world of AI and its applications.
Introduction
AI, or Artificial Intelligence, is the field of computer science that focuses on creating intelligent machines capable of performing tasks that would typically require human intelligence. These machines can learn, reason, and make decisions based on data and algorithms.
Applications of AI
Let's dive into some of the most exciting applications of AI across different industries:

Healthcare: AI is enhancing medical diagnosis, improving patient care, and even assisting in drug discovery. Machine learning algorithms can analyze medical images to detect diseases like cancer at an early stage, leading to more effective treatment.

Finance: AI is revolutionizing the finance industry by enabling automated trading, fraud detection, and personalized financial advice. AI-powered chatbots are also being used to provide customer support and answer queries.

Transportation: Self-driving cars are a prime example of AI in transportation. These vehicles use sensors and AI algorithms to navigate roads, making transportation safer and more efficient. AI is also being used to optimize traffic flow and manage logistics.

Education: AI is transforming education by personalizing learning experiences for students. Intelligent tutoring systems adapt to individual students' needs, providing tailored content and feedback. AI can also automate administrative tasks, freeing up educators' time.

Retail: AI is enhancing the retail experience by enabling personalized recommendations based on customer preferences and past behavior. Chatbots are being used to assist customers with their queries, improving customer service.

Manufacturing: AI is improving efficiency and productivity in manufacturing processes. Robots powered by AI can perform complex tasks with precision and speed, leading to higher production rates and reduced costs.

Ethical Considerations
While AI offers numerous benefits, it also raises ethical concerns. Issues such as bias in algorithms, privacy, and job displacement need to be addressed to ensure the responsible development and use of AI.
Conclusion
Artificial Intelligence is transforming our world and has the potential to reshape industries and improve our lives in ways we couldn't have imagined. As AI continues to advance, it is crucial to understand its capabilities, limitations, and ethical implications.
This concludes our video on Artificial Intelligence. Thank you for watching!
End of Script
["AI video", "Artificial Intelligence video", "AI applications video", "AI in different industries video", "AI impact video"]
Generated 5 search terms: AI video, Artificial Intelligence video, AI applications video, AI in different industries video, AI impact video
=>
=>https://player.vimeo.com/external/502524159.hd.mp4?s=5806d59a0c32b8b435e367192a7f4d33bad62aa7&profile_id=175&oauth2_token_id=57447761
=>
=>https://player.vimeo.com/external/512209430.sd.mp4?s=917ec11c9a221281add796f5ddf9971eb61bd147&profile_id=139&oauth2_token_id=57447761
=>
[+] Downloading videos...
[+] Videos downloaded!
[+] Script generated!
Artificial Intelligence (AI) has revolutionized the way we live and work. From self-driving cars to virtual assistants, AI is transforming various industries and impacting our daily lives in profound ways. In this video, we will explore the fascinating world of AI and its applications.

Introduction
AI, or Artificial Intelligence, is the field of computer science that focuses on creating intelligent machines capable of performing tasks that would typically require human intelligence. These machines can learn, reason, and make decisions based on data and algorithms.
Applications of AI
Let's dive into some of the most exciting applications of AI across different industries:

Healthcare: AI is enhancing medical diagnosis, improving patient care, and even assisting in drug discovery. Machine learning algorithms can analyze medical images to detect diseases like cancer at an early stage, leading to more effective treatment.

Finance: AI is revolutionizing the finance industry by enabling automated trading, fraud detection, and personalized financial advice. AI-powered chatbots are also being used to provide customer support and answer queries.

Transportation: Self-driving cars are a prime example of AI in transportation. These vehicles use sensors and AI algorithms to navigate roads, making transportation safer and more efficient. AI is also being used to optimize traffic flow and manage logistics.

Education: AI is transforming education by personalizing learning experiences for students. Intelligent tutoring systems adapt to individual students' needs, providing tailored content and feedback. AI can also automate administrative tasks, freeing up educators' time.

Retail: AI is enhancing the retail experience by enabling personalized recommendations based on customer preferences and past behavior. Chatbots are being used to assist customers with their queries, improving customer service.

Manufacturing: AI is improving efficiency and productivity in manufacturing processes. Robots powered by AI can perform complex tasks with precision and speed, leading to higher production rates and reduced costs.

Ethical Considerations
While AI offers numerous benefits, it also raises ethical concerns. Issues such as bias in algorithms, privacy, and job displacement need to be addressed to ensure the responsible development and use of AI.
Conclusion
Artificial Intelligence is transforming our world and has the potential to reshape industries and improve our lives in ways we couldn't have imagined. As AI continues to advance, it is crucial to understand its capabilities, limitations, and ethical implications.
This concludes our video on Artificial Intelligence. Thank you for watching!
End of Script
Service available!
Audio file saved successfully as '../temp/68222e27-d4c4-4540-9fbe-ad9bfce9d87e.mp3'
Service available!
Audio file saved successfully as '../temp/0b557620-70e7-49f4-8512-c2aba1373fb7.mp3'
Service available!
Audio file saved successfully as '../temp/247fd7e5-4710-4a8b-80bb-459ee4c1646e.mp3'
Service available!
Audio file saved successfully as '../temp/3430aa90-cd32-41fb-bfdb-9a23b585aab6.mp3'
Service available!
Audio file saved successfully as '../temp/348cb10b-14a9-4573-9f94-ae742b11728b.mp3'
Service available!
Audio file saved successfully as '../temp/2a284815-d25c-4f1d-9ca7-096d5288d72b.mp3'
Service available!
Audio file saved successfully as '../temp/f069691b-9b3a-44e3-a9ce-c35189567f3c.mp3'
Service available!
Audio file saved successfully as '../temp/16d211ab-6013-4e0a-863a-6d504f36f7cc.mp3'
Service available!
Audio file saved successfully as '../temp/3d523f0b-817c-41de-b31b-58524598bdf1.mp3'
Service available!
Audio file saved successfully as '../temp/fd7a676c-446b-40f1-a986-298442b9f202.mp3'
Service available!
Audio file saved successfully as '../temp/4a8d494d-3d18-4fe7-bfe4-7d2ca9a4d653.mp3'
Service available!
Audio file saved successfully as '../temp/5410ff4f-7252-4d27-9d1d-436847cb8bee.mp3'
Service available!
Audio file saved successfully as '../temp/043e17a6-fc9e-4d7d-a8dd-2d0009d599e6.mp3'
Service available!
Audio file saved successfully as '../temp/32d730f1-7f45-4956-a6b3-4befba5b111f.mp3'
Service available!
Audio file saved successfully as '../temp/d598c41c-0619-475f-901a-4985d1b638c2.mp3'
Service available!
Audio file saved successfully as '../temp/ecadecf2-f4c7-4ee9-a1d2-d3a24bc3e1db.mp3'
Service available!
Audio file saved successfully as '../temp/74d25ff4-b31a-4a32-b72f-a88c281641ad.mp3'
Service available!
Audio file saved successfully as '../temp/3e3d3bf5-86a2-4039-833d-bb081e7322c2.mp3'
Service available!
Audio file saved successfully as '../temp/677285c4-8769-4f35-9e8e-d96791e3af0f.mp3'
Service available!
Audio file saved successfully as '../temp/aa4877eb-17b4-4e8d-85c1-101acc9b4f41.mp3'
Service available!
Audio file saved successfully as '../temp/4091496e-d2ea-44fe-a170-7fa23e6d68f6.mp3'
MoviePy - Writing audio in ../temp/063af234-6b76-446a-8445-a5737bb34e41.mp3
MoviePy - Done.
[+] Subtitles generated.
[+] Combining videos...
[+] Each video will be 100.375 seconds long.
Moviepy - Building video ../temp/dfd8990d-ee05-4bcc-bc3a-671c854a3736.mp4.
Moviepy - Writing video ../temp/dfd8990d-ee05-4bcc-bc3a-671c854a3736.mp4
t:  38%|█████████▉                | 2305/6023 [00:33<00:49, 74.50it/s, now=None]t:  85%|██████████████████████▏   | 5131/6023 [01:37<00:23, 37.55it/s, now=None]Moviepy - Done !
Moviepy - video ready ../temp/dfd8990d-ee05-4bcc-bc3a-671c854a3736.mp4
Moviepy - Building video ../temp/output.mp4.
MoviePy - Writing audio in outputTEMP_MPY_wvf_snd.mp3
MoviePy - Done.
Moviepy - Writing video ../temp/output.mp4
Moviepy - Done !
Moviepy - video ready ../temp/output.mp4
[+] Video generated!
[+] Path: output.mp4
<IP_ADDRESS> - - [04/Feb/2024 13:55:21] "POST /api/generate HTTP/1.1" 200 -
`

The script is way too long, this is meant for shorts, not long form.

The script is way too long, this is meant for shorts, not long form.

Possible to add a cancel button in frontend if the script is too long so no restart is needed?


Reflection not supported for decoding

The Objective-C libraries I have used for JSON, such as JSONModel, support reflection when decoding. This is good because JSON requests are often simple, while the responses are complex. For example, a REST API to search for a user may accept a single user ID in the request but return a complex user model in the response.
Reflection (mirroring) is supported in JSONCodable for encoding but not decoding. The user ID can be encoded "for free" but the decoding of the user model requires many lines of code.
For example, you can do:
extension User: JSONEncodable {}

and the library will handle serialization automatically. However, the reverse doesn't work; you have to deserialize the JSON manually. For example:
extension User: JSONDecodable {
    init?(JSONDictionary: JSONObject) {
        let decoder = JSONDecoder(object: JSONDictionary)
        do {
            email = try decoder.decode("email")
            name = try decoder.decode("name")
            ...
        }
       ...
    }
}

Is there a technical issue that prevents JSONCodable from auto-deserializing JSON using JSONDecodable? I wonder if it is particularly challenging for some reason. If not, I would like to help remove this limitation.

Yes I'm glad you asked! Swift requires you to initialise all properties in its initialiser and there's no dynamic way to assign values to properties automatically. Feel free to bounce around ideas thought I've been stuck with this for a while.

I'll ponder on it, but in the meantime, what about just requiring the user to make all of the model's properties Optional? Or give them all default values?

 After all, Swift makes it easier to work with mutability and value types.

This is such a great library. Very simple and powerful!
I would like to also vote for a reflection-based decoding. If users design their objects as suggested by vocaro, perhaps there could be a method like this:
extension Company: JSONDecodable {
  init(object: JSONObject) throws {
      let decoder = JSONDecoder(object: object)
      try decoder.autoDecode()
  }
}

The above challenges make it difficult to implement but you're welcome to send in a PR and help us out!


Installation help

Hello!
I use pi zero. Would anyone help with the installation? How to set up? I want to transfer data from Xiaomi and iNode devices to a more remote Home Assistant server.

Sorry, I missed your question. There are two options, I think.

Use ESPhome with BLE gateway, as described here: https://custom-components.github.io/ble_monitor/parse_data. This will collect the raw BLE data with an ESP device and will forward it over WiFi to your remote Home Assistant server with BLE monitor. The HA server (BLE monitor) will take care of the translation from the RAW message to a HA sensors.
Set up a second HA machine with Bluetooth, and use remote Home Assistant to link the two Home Assistant servers: https://github.com/custom-components/remote_homeassistant With this method, one HA server will take care of the translation of the RAW data to HA sensors, and remote Home Assistant will take care of forwarding the sensor data to your remote Home Assistant server.

Note that not all raspberry zero's have Bluetooth. I think the zero 2 W does have it. Is you haven't bought a device yet, I would go the ESPhome route.


Allow re-scan of devices to support hot-plugging

The use of a bare generator in EVENT_MAP['type_codes'] makes EVENT_MAP a single use object.  Converting the generator to a tuple allows reuse of EVENT_MAP and constructing a new DeviceManager that re-scans for devices.
Addresses issue #66

I now see that pull request #81 fixes the same problem, but doesn't add a function to re-scan devices.

Thanks. I just need to find a day to test with the 100 devices.

This should also fix #106. Attempting to create a new DeviceManager instance manually does not work as rescan because of the bare generator in EVENT_MAP.

This fix works only when inputs is imported as a whole. It would not change the instance of devices when it is imported individually (from inputs import devices), as it is shown instead in the examples.
>>> import inputs
>>> from inputs import devices
>>>
>>> inputs.devices == devices
True
>>> inputs.rescan_devices()
>>>
>>> inputs.devices == devices
False
>>> ```

I suspect that is because input.devices not mutated, it is replaced. As a result, inputs.devices and local devices no longer reference the same object.  Any local references to input.devices would need to be refreshed after using rescan_devices().
import inputs`
devices = inputs.devices
[...]
inputs.rescan_devices()
devices = inputs.devices

Or, perhaps rescan_devices() could return devices so that it becomes devices = inputs.rescan_devices().   The problem with all of this is that it doesn't solve the problem of a developer expecting devices to be mutated instead of replaced and not expecting to need to re-cache the local reference.
Is there a better solution other than updating examples and documentation?


OpenBSD: only get active CPU core count

Newer computers may have some cores offline because of the
Meltdown/Spectre patches from a while ago, making uv_cpu_info
potentially misleading and leading to people attempting to use more
threads than they actually have available. This makes it so only the
cores that are online and doing any work are counted.

I don't exactly disagree with your change - if you think it's a good change I'll merge it - but I want to point out that this would make libuv-on-openbsd diverge from libuv's behavior on other platforms.
Random data point: HW_NCPU is also what golang's runtime uses to figure out what number of system threads to use.

I'd prefer not to introduce this inconsistency.

I think whether or not it's inconsistent compared to other platforms depends on whether or not they also disable SMT to deal with Meltdown. Linux and FreeBSD mitigate Meltdown through other methods than outright disabling SMT, keeping the cores available for use. I'm not sure about how other OSes mitigate it.
If OpenBSD is the only or one of a few OSes that disable SMT entirely, I don't think it'd be too inconsistent to only list the active cores since it's not entirely arbitrary which platforms do or don't disable SMT.

@libuv/collaborators Your opinions, please?

I think it would be nice if someone from the OpenBSD project could give a more official opinion (apologies to @Kaiepi if you actually do represent the project - I'm not familiar enough with it).

Question: what's the CPU count if one does echo 0 > /sys/devices/system/cpu0/online on Linux? Do we count it? If this can be detected and we are able to skip it, we'd at least have 2 platforms that behave the same.
This is not a +1, but more of an observation.

@saghul Good point. On Linux we read from /proc/stat and /proc/cpuinfo and those files only list online CPUs.

:+1: from me given the discussion above.

Good point. On Linux we read from /proc/stat and /proc/cpuinfo and those files only list online CPUs.

@bnoordhuis In that case I'm +1.

Fresh CI with no related failures: https://ci.nodejs.org/view/libuv/job/libuv-test-commit/1487/
Landed in https://github.com/libuv/libuv/commit/64ab7cc7405744060ab4ac396944c007646fe3e6. Thanks!


Adds Dubbo instrumentation 新年快乐

This is a Tracing filter for RPC providers and consumers in Dubbo
When used on a consumer, TracingFilter adds trace state as attachments
to outgoing requests. When a provider, it extracts trace state from
incoming requests. In either case, the filter reports to Zipkin how long
each request took, along with any error information.
Note: A Dubbo Provider is a server, and a Dubbo Consumer is a client in
Zipkin terminology.

Configuration
The filter "tracing" requires an extension of type Tracing configured.
Most typically, this is provided by Spring, so have this in place before
proceeding. Here's an example in XML.
Then, configure the filter named "tracing" in your producer or consumer.
Here's an example of using Spring 2.5+ XML
<!-- a provider -->
<dubbo:service filter="tracing" interface="com.alibaba.dubbo.demo.DemoService" ref="demoService"/>

<!-- or a consumer -->
<dubbo:reference filter="tracing" id="demoService" check="false" interface="com.alibaba.dubbo.demo.DemoService"/>

谢谢 @blacklau @sdcuike and @jessyZu who wrote dubbo filters for Brave in the past
Fixes #504

cc @chickenlj

by the way, the screen shot was from the normal dubbo demo. I changed its config to say "tracing" in the filter list, added the dependency and spring XML for the Tracing component.
I suspect it would be similarly easy with https://github.com/alibaba/dubbo-spring-boot-starter and sleuth, but not tried, yet.

good

Hi,  adriancole
This is really a good news for dubbo users.
But as a new one to openzipkin, it really takes some time for me to integrate TracingFilter into a dubbo demo project.
I think it would be better if we can put the configuration of [tracing](https://github.com/openzipkin/brave/tree/master/spring-beans) in more prominent position so users can easily notice that.
And also, for users who choose not to use spring, i think we should also point out the way of how to use inject Tracer.
What do you think?
Best Regards

But as a new one to openzipkin, it really takes some time for me to
integrate TracingFilter into a dubbo demo project.

thanks for spending time on this. very valuable to have feedback especially
as not released yet.
I think it would be better if we can put the configuration of [tracing](

https://github.com/openzipkin/brave/tree/master/spring-beans) in more
prominent position so users can easily notice that.

Fo you mean this should be easier to notice in general, or easier to notice
in the dubbo README or something else? What should change in your opinion?

And also, for users who choose not to use spring, i think we should also
point out the way of how to use inject Tracer.

Do you mean like show how to make a
manual com.alibaba.dubbo.common.extension.ExtensionFactory for tracing? or
is there a different extension approach you have in mind? manual one won't
be too hard I think.

opened issue about api configuration as this task might be complex as whatever we doc should mention somehow to shutdown the reporter https://github.com/openzipkin/brave/issues/632

fyi I have a working example, but it isn't great due to issues noted in this issue. Please follow there for next work https://github.com/openzipkin/brave/issues/632#issuecomment-370355437

Sorry for late reply.

Fo you mean this should be easier to notice in general, or easier to notice
in the dubbo README or something else? What should change in your opinion?

I mean easier to notice in the dubbo-rpc README, can be just a link. Just a suggestion, maybe configuration of  tracing is a common sense for users familiar with openzipkin.

Do you mean like show how to make a
manual com.alibaba.dubbo.common.extension.ExtensionFactory for tracing? or
is there a different extension approach you have in mind? manual one won't
be too hard I think.

Yes, a ExtensionFactory can be one way for creating tracing instance. And i am also thinking of users to  create a tracing instance manually and inject into ExtensionLoader as an extension.

This is what i want, sorry i failed to notice this part in README

The filter "tracing" requires an extension of type Tracing configured. Most typically, this is provided by Spring, so have this in place before proceeding. Here's an example in XML.


Elasticsearch coders

explain how to change name coders in README; switch from refined-soundex to soundex for default broad name coder

Need to wait until earlier PRs have been approved.


Config Maps and Volumes are not getting mounted

Our GKE cluster is running on Kubernetes version v1.21.14. Pods were running all good until yesterday, now Configmaps and Volumes are not getting Mounted.
Deployment Mode: Helm Chart
Helm Chart Version: 1.1.0
Image: v1beta2-1.2.3-3.1.1
Kubernetes Version: 1.21.14
Helm command to install: helm install spark-operator --namespace *** --set image.tag= v1beta2-1.2.3-3.1.1 --set webhook.enable=true -f values.yaml
Spark operator pod starts successfully after webhook-init pod get completed.
But my application pod using Spark Operator is unable to come up due to below error:
Events:                                                                                │ │   Type     Reason       Age                  From               Message                                                                                │ │   ----     ------       ----                 ----               -------                                                                                │ │   Normal   Scheduled    49m                  default-scheduler  Successfully assigned pod/re-driver to gke │ │ w--taints-6656b326-49of                                                                                │ │   Warning  FailedMount  49m                  kubelet            MountVolume.SetUp failed for volume "spark-conf-volume-driver" : configmap "spark-drv-8c0f12839ca69805-conf-map" not found       │ │   Warning  FailedMount  27m (x3 over 40m)    kubelet            Unable to attach or mount volumes: unmounted volumes=[re-checkpoint], unattached volumes=[spark-conf-volume-driver kube-api-acce │ │ s-lsflz re-checkpoint app-conf-vol cert-secret-volume spark-local-dir-1[]: timed out waiting for the condition                                                         │ │   Warning  FailedMount  20m (x2 over 45m)    kubelet            Unable to attach or mount volumes: unmounted volumes=[re-checkpoint], unattached volumes=[kube-api-access-lsflz re-checkpoint app-conf-vol cert-secret-volume spark-local-dir-1 spark-conf-volume-driver[]: timed out waiting for the condition

Is there a solution?

Any update?

MountVolume.SetUp failed for volume "spark-conf-volume-driver" : configmap "spark-drv-a4a28f849e410e3b-conf-map" not found	FailedMount
happens with default settings.

Seeing exact error mentioned by @Liftingthedata as well, even after attaching the cluster-admin ClusterRole to the ServiceAccount created by chart installation and specifying the aforementioned ServiceAccount in examples/spark-pi.yaml.
Please help!

I encountered similar issue. The problem frequently happen when the spark operator is under provisioned or under high load.

@pradithya could you please share your node configuration?

Is there any solution for this? I am also facing the similar issue. I am not sure but what I think is driver pod is trying to mount configmap before it is getting created which shows that configmap not found.
Warning  FailedMount  66s   kubelet            MountVolume.SetUp failed for volume "spark-conf-volume-driver" : configmap "spark-drv-f42632859b918eee-conf-map" not found

I've began to encounter it constantly once I've introduced environment variables to my Scala script (and properly modified K8s manifest). Haven't found out how to solve it yet.

I think it's because the ConfigMap resource that was needed for VolumeMount of spark-conf-volume-driver already existed and could not be created.
My event log was: MountVolume.SetUp failed for volume "spark-conf-volume-driver" : configmap "spark-drv-15baf1865950378a-conf-map" not found
So I typed kubectl get configmap -n spark-app
then it showed:
NAME                                  DATA   AGE
kube-root-ca.crt                      1      25h
spark-drv-15baf1865950378a-conf-map   1      34m
spark-drv-52be6d8658b53968-conf-map   1      3h23m
so I deleted all spark-drv(/*) ConfigMaps that was auto-created when starting the SparkApplication pod.
Then finally kubectl delete & kubectl apply the SparkApplication manifest .yaml file.
See if this works guys and please let me know.

hi guys, any solution for this issue ?

Hi All,
Experienced this when we migrated to the helm chart installation of the spark operator, our volumes were mounted correctly via configmaps, but kubernetes was erroring out..
Make sure you have the following settings enabled on the helm chart below...
webhook:
  # -- Enable webhook server
  enable: true
  namespaceSelector: "spark-webhook-enabled=true"

Then label the spark namespace (or target namespace for your spark jobs)  with:
spark-webhook-enabled=true

We found that was enough to get it working.
Application side
apiVersion: "sparkoperator.k8s.io/v1beta2"
kind: ScheduledSparkApplication
metadata:
 name: example-test
 namespace: spark
spec:
 schedule: "31 12 * * *"
 concurrencyPolicy: Allow
 template:
   timeToLiveSeconds: 1200
   type: Python
   arguments:
     - --config-file-name=/opt/spark/work-dir/config/config.ini
   sparkConf:
     spark.kubernetes.decommission.script: "/opt/decom.sh"
     .  . .
   hadoopConf:
     fs.s3a.impl: "org.apache.hadoop.fs.s3a.S3AFileSystem"
     . . .
   mode: cluster
   imagePullPolicy: Always
   mainApplicationFile: local:///opt/spark/work-dir/run.py
   sparkVersion: "3.2.1"
   restartPolicy:
       type: Never
   driver:
     cores: 1
     coreLimit: "500m"
     memory: "500m"
     labels:
       version: 3.2.1
     serviceAccount: job-tole
     volumeMounts:
       - name: "config"
         mountPath: "/opt/spark/work-dir/config"
   executor:
     cores: 1
     instances: 1
     memory: "500m"
     labels:
       version: 3.2.1
     volumeMounts:
       - name: "config"
         mountPath: "/opt/spark/work-dir/config"
   volumes:
     - name: "config"
       configMap:
         name: "config"
         items:
           - key: "config.ini"
             path: "config.ini"

If you don't use the helm chart you still need to enable the webhook, otherwise the spark-operator won't be able to create the right configmaps and volume mounts on the driver and executor pods when they are spawned.

I have enabled the webhook, using the namespaceSelector with the correct selectors, and still having the issue. Any idea?
I am using the latest version. I have also tried enabling webhook on all namespaces, but still face the same issue

Does not work for me also. Followed the steps mentioned above but still getting same error.

I have enabled the webhook, using the namespaceSelector with the correct selectors, and still having the issue. Any idea? I am using the latest version. I have also tried enabling webhook on all namespaces, but still face the same issue.
I am unable to use tolerations as well

Did you manage to solve this issue?

The spark-pi job just hangs either before the driver is initialized or after driver the starts running. I do see the config-map load error in the driver's events but it does get created afterwards. Is this a resource problem? I'm running this on minikube with 4 CPU and 8GB memory !!

My issue was the webhook port.. It for some reason doesn't run on the default port anymore. So I had to update the port to 443 based on the docs here, even though I'm on EKS instead of GKE

My issue was the webhook port.. It for some reason doesn't run on the default port anymore. So I had to update the port to 443 based on the docs here, even though I'm on EKS instead of GKE

Thank you. I am using AKS and it worked for me as well.

I've done everything mentioned here with no success

The webhook only adds volumes if the driver/executor has a volumeMount for them:
https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/blob/master/pkg/webhook/patch.go#L138-L143.
The same goes for configMaps
https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/blob/master/pkg/webhook/patch.go#L335C1-L339
The code doesn't check if a driver/executor initContainer/sidecar mounts the vols.
As a workaround you just have to add the volumeMounts directly to the driver/executor spec as well

Bump, is there any other possible solution? I have tried all the above with no success. Giving my configurations if it is of any help. Using helm chart 1.1.27 and v1beta2-1.3.8-3.1.1
values.yaml
# https://github.com/kubeflow/spark-operator/tree/master/charts/spark-operator-chart
nameOverride: spark-operator
fullnameOverride: spark-operator

image:
  # -- Image repository
  repository: ghcr.io/googlecloudplatform/spark-operator
  # -- Image pull policy
  pullPolicy: IfNotPresent
  # -- if set, override the image tag whose default is the chart appVersion.
  tag: "v1beta2-1.3.8-3.1.1"

imagePullSecrets:
  - name: regcred

sparkJobNamespace: spark-operator

resources:
  limits:
    cpu: 1
    memory: 512Mi
  requests:
    cpu: 1
    memory: 512Mi

webhook:
  enable: true
  port: 443
  namespaceSelector: "spark-webhook-enabled=true"

SparkApplication manifest
apiVersion: "sparkoperator.k8s.io/v1beta2"
kind: SparkApplication
metadata:
  name: spark-pi2
  namespace: spark-operator
spec:
  type: Scala
  mode: cluster
  image: "apache/spark:3.4.2"
  imagePullPolicy: IfNotPresent
  imagePullSecrets:
    - regcred
  mainClass: org.apache.spark.examples.SparkPi
  mainApplicationFile: "local:///opt/spark/examples/jars/spark-examples_2.12-3.4.2.jar"
  sparkVersion: "3.4.2"
  timeToLiveSeconds: 600
  restartPolicy:
    type: Never
  volumes:
    - name: config-vol
      configMap:
        name: cm-spark-extra
  driver:
    cores: 1
    coreLimit: "1200m"
    memory: "512m"
    labels:
      version: 3.4.2
    serviceAccount: airflow-next
    volumeMounts:
      - name: config-vol
        mountPath: /mnt/cm-spark-extra
  executor:
    cores: 1
    instances: 1
    memory: "512m"
    labels:
      version: 3.4.2
    volumeMounts:
      - name: config-vol
        mountPath: /mnt/cm-spark-extra

Here is the container and volume spec of the pod being spun up
spec:
  volumes:
    - name: aws-iam-token
      projected:
        sources:
          - serviceAccountToken:
              audience: sts.amazonaws.com
              expirationSeconds: 86400
              path: token
        defaultMode: 420
    - name: spark-local-dir-1
      emptyDir: {}
    - name: spark-conf-volume-driver
      configMap:
        name: spark-drv-b14d8f8f2b497a58-conf-map
        items:
          - key: spark.properties
            path: spark.properties
            mode: 420
        defaultMode: 420
    - name: kube-api-access-tf4pb
      projected:
        sources:
          - serviceAccountToken:
              expirationSeconds: 3607
              path: token
          - configMap:
              name: kube-root-ca.crt
              items:
                - key: ca.crt
                  path: ca.crt
          - downwardAPI:
              items:
                - path: namespace
                  fieldRef:
                    apiVersion: v1
                    fieldPath: metadata.namespace
        defaultMode: 420
  containers:
    - name: spark-kubernetes-driver
      image: apache/spark:3.4.2
      args:
        - driver
        - '--properties-file'
        - /opt/spark/conf/spark.properties
        - '--class'
        - org.apache.spark.examples.SparkPi
        - local:///opt/spark/examples/jars/spark-examples_2.12-3.4.2.jar
      ports:
        - name: driver-rpc-port
          containerPort: 7078
          protocol: TCP
        - name: blockmanager
          containerPort: 7079
          protocol: TCP
        - name: spark-ui
          containerPort: 4040
          protocol: TCP
      env:
        - name: SPARK_USER
          value: root
        - name: SPARK_APPLICATION_ID
          value: spark-2d80cebdab33400b83cbfe61fd09faee
        - name: SPARK_DRIVER_BIND_ADDRESS
          valueFrom:
            fieldRef:
              apiVersion: v1
              fieldPath: status.podIP
        - name: SPARK_LOCAL_DIRS
          value: /var/data/spark-1505b0f4-c95a-4bba-aa76-9451b34af9ea
        - name: SPARK_CONF_DIR
          value: /opt/spark/conf
        - name: AWS_STS_REGIONAL_ENDPOINTS
          value: regional
        - name: AWS_DEFAULT_REGION
          value: us-east-1
        - name: AWS_REGION
          value: us-east-1
        - name: AWS_ROLE_ARN
          value: arn:aws:iam::123456:role/my-sa
        - name: AWS_WEB_IDENTITY_TOKEN_FILE
          value: /var/run/secrets/eks.amazonaws.com/serviceaccount/token
      resources:
        limits:
          cpu: 1200m
          memory: 896Mi
        requests:
          cpu: '1'
          memory: 896Mi
      volumeMounts:
        - name: spark-local-dir-1
          mountPath: /var/data/spark-1505b0f4-c95a-4bba-aa76-9451b34af9ea
        - name: spark-conf-volume-driver
          mountPath: /opt/spark/conf
        - name: kube-api-access-tf4pb
          readOnly: true
          mountPath: /var/run/secrets/kubernetes.io/serviceaccount
        - name: aws-iam-token
          readOnly: true
          mountPath: /var/run/secrets/eks.amazonaws.com/serviceaccount
      terminationMessagePath: /dev/termination-log
      terminationMessagePolicy: File
      imagePullPolicy: IfNotPresent

I am at a lost here. spark-conf-volume-driver is being set up as spark-drv-b14d8f8f2b497a58-conf-map and I see it under my kubernetes configmaps. I am on EKS and set webhook.enable to true and the port to 443. I did the work around configured a volumeMount under both the driver and executor although I do not see this being configured under my pod however I do not think this matters? As far as I know, everything is configured correctly. Is there somebody that can help?

Bump, is there any other possible solution? I have tried all the above with no success. Giving my configurations if it is of any help. Using helm chart 1.1.27 and v1beta2-1.3.8-3.1.1
values.yaml
# https://github.com/kubeflow/spark-operator/tree/master/charts/spark-operator-chart
nameOverride: spark-operator
fullnameOverride: spark-operator

image:
  # -- Image repository
  repository: ghcr.io/googlecloudplatform/spark-operator
  # -- Image pull policy
  pullPolicy: IfNotPresent
  # -- if set, override the image tag whose default is the chart appVersion.
  tag: "v1beta2-1.3.8-3.1.1"

imagePullSecrets:
  - name: regcred

sparkJobNamespace: spark-operator

resources:
  limits:
    cpu: 1
    memory: 512Mi
  requests:
    cpu: 1
    memory: 512Mi

webhook:
  enable: true
  port: 443
  namespaceSelector: "spark-webhook-enabled=true"

SparkApplication manifest
apiVersion: "sparkoperator.k8s.io/v1beta2"
kind: SparkApplication
metadata:
  name: spark-pi2
  namespace: spark-operator
spec:
  type: Scala
  mode: cluster
  image: "apache/spark:3.4.2"
  imagePullPolicy: IfNotPresent
  imagePullSecrets:
    - regcred
  mainClass: org.apache.spark.examples.SparkPi
  mainApplicationFile: "local:///opt/spark/examples/jars/spark-examples_2.12-3.4.2.jar"
  sparkVersion: "3.4.2"
  timeToLiveSeconds: 600
  restartPolicy:
    type: Never
  volumes:
    - name: config-vol
      configMap:
        name: cm-spark-extra
  driver:
    cores: 1
    coreLimit: "1200m"
    memory: "512m"
    labels:
      version: 3.4.2
    serviceAccount: airflow-next
    volumeMounts:
      - name: config-vol
        mountPath: /mnt/cm-spark-extra
  executor:
    cores: 1
    instances: 1
    memory: "512m"
    labels:
      version: 3.4.2
    volumeMounts:
      - name: config-vol
        mountPath: /mnt/cm-spark-extra

Here is the container and volume spec of the pod being spun up
spec:
  volumes:
    - name: aws-iam-token
      projected:
        sources:
          - serviceAccountToken:
              audience: sts.amazonaws.com
              expirationSeconds: 86400
              path: token
        defaultMode: 420
    - name: spark-local-dir-1
      emptyDir: {}
    - name: spark-conf-volume-driver
      configMap:
        name: spark-drv-b14d8f8f2b497a58-conf-map
        items:
          - key: spark.properties
            path: spark.properties
            mode: 420
        defaultMode: 420
    - name: kube-api-access-tf4pb
      projected:
        sources:
          - serviceAccountToken:
              expirationSeconds: 3607
              path: token
          - configMap:
              name: kube-root-ca.crt
              items:
                - key: ca.crt
                  path: ca.crt
          - downwardAPI:
              items:
                - path: namespace
                  fieldRef:
                    apiVersion: v1
                    fieldPath: metadata.namespace
        defaultMode: 420
  containers:
    - name: spark-kubernetes-driver
      image: apache/spark:3.4.2
      args:
        - driver
        - '--properties-file'
        - /opt/spark/conf/spark.properties
        - '--class'
        - org.apache.spark.examples.SparkPi
        - local:///opt/spark/examples/jars/spark-examples_2.12-3.4.2.jar
      ports:
        - name: driver-rpc-port
          containerPort: 7078
          protocol: TCP
        - name: blockmanager
          containerPort: 7079
          protocol: TCP
        - name: spark-ui
          containerPort: 4040
          protocol: TCP
      env:
        - name: SPARK_USER
          value: root
        - name: SPARK_APPLICATION_ID
          value: spark-2d80cebdab33400b83cbfe61fd09faee
        - name: SPARK_DRIVER_BIND_ADDRESS
          valueFrom:
            fieldRef:
              apiVersion: v1
              fieldPath: status.podIP
        - name: SPARK_LOCAL_DIRS
          value: /var/data/spark-1505b0f4-c95a-4bba-aa76-9451b34af9ea
        - name: SPARK_CONF_DIR
          value: /opt/spark/conf
        - name: AWS_STS_REGIONAL_ENDPOINTS
          value: regional
        - name: AWS_DEFAULT_REGION
          value: us-east-1
        - name: AWS_REGION
          value: us-east-1
        - name: AWS_ROLE_ARN
          value: arn:aws:iam::123456:role/my-sa
        - name: AWS_WEB_IDENTITY_TOKEN_FILE
          value: /var/run/secrets/eks.amazonaws.com/serviceaccount/token
      resources:
        limits:
          cpu: 1200m
          memory: 896Mi
        requests:
          cpu: '1'
          memory: 896Mi
      volumeMounts:
        - name: spark-local-dir-1
          mountPath: /var/data/spark-1505b0f4-c95a-4bba-aa76-9451b34af9ea
        - name: spark-conf-volume-driver
          mountPath: /opt/spark/conf
        - name: kube-api-access-tf4pb
          readOnly: true
          mountPath: /var/run/secrets/kubernetes.io/serviceaccount
        - name: aws-iam-token
          readOnly: true
          mountPath: /var/run/secrets/eks.amazonaws.com/serviceaccount
      terminationMessagePath: /dev/termination-log
      terminationMessagePolicy: File
      imagePullPolicy: IfNotPresent

I am at a lost here. spark-conf-volume-driver is being set up as spark-drv-b14d8f8f2b497a58-conf-map and I see it under my kubernetes configmaps. I am on EKS and set webhook.enable to true and the port to 443. I did the work around configured a volumeMount under both the driver and executor although I do not see this being configured under my pod however I do not think this matters? As far as I know, everything is configured correctly. Is there somebody that can help?

I'm having the same issue on OCI. I've followed the same steps.

I also noticed this problem with a very limited CPU (resources.limits.cpu: "100m") and two concurrent spark apps. It's very consistent and in that case the configmap for the driver was created for only one app. After updating the resources (requests to 1 CPU, and no limit) this odd behavior disappeared.

this still happens, using spark-submit on a high number of submits sometimes occur.

@dannyeuu Try to increase the spark operator's CPU request/limit. I encountered this issue when the operator is experiencing high utilization/throttling.

Curious if this shares the root cause with another issue I saw. Does anyone see client-side throttling logs for the operator? Should look something like this:

Waited for ... due to client-side throttling, not priority and fairness ...

In my case the Config Map was created but the pod was crashing with the MountVolume.SetUp failed for volume "spark-conf-volume-driver" : configmap "spark-drv-###############-conf-map" not found.
I tried to view to logs of the pod before it failed and saw that there was another unrelated reason due to which the pod crashed.
After fixing that issue the configmap error went away.

Im facing similar issue .. the cm is created but i get the error -> -poc--bbe7876b-cbcu
3m8s        Warning   FailedMount                    pod/structured-streaming-313-1727908779-driver         MountVolume.SetUp failed for volume "spark-conf-volume-driver" : configmap "spark-drv-7b6887924f646fe0-conf-map" no
I'm on version - 1.1.27  (Spark 3.1.1) .. any solutions for this ?

Any update ?

What i did.
We launch all our tasks via airflow SparkKubernetesOperator.
I created a pool for all spark-kuber tasks with 2-3 slots in there and added additional sleep(40secs) after k8s resource "sparkapplication" create. And it helped to me.


This is also very likely causing https://github.com/grpc/grpc/issues/23661.

Jan, thank you for investigating this problem! I want to spend more time addressing this problem without the rollback because all problems I've seen is not technically Abseil problem but is caused by our test code which are not strictly robust. My plan is to fix them forward while keep this PR intact.


[BUG]: Generate columns : The doc info is invalid

Report hasn't been filed before.

[X] I have verified that the bug I'm about to report hasn't been filed before.

What version of drizzle-orm are you using?
0.37.0
What version of drizzle-kit are you using?
0.29.1
Other packages
No response
Describe the Bug
I spent the past 3 hours trying to figure out an error I kept on running into with generate columns.
These are the docs I referenced: https://orm.drizzle.team/docs/generated-columns
Every example shown in the doc will throw an error
export const test = pgTable("test", {
    generatedName: text("gen_name").generatedAlwaysAs(sql`hello "world"!`),
});
// Error: error: syntax error at or near "world"

export const test = pgTable("test", {
    generatedName: text("gen_name").generatedAlwaysAs(sql`hello "world"!`),
});
// Error: error: syntax error at or near "world"

Is this article deprecated? Or what is the correct to assign text to generated columns?

I'm having the same issue. Here's a repro: https://drizzle.run/yctyikzrddx9ah8s6j3l9qts
Go to schema page to see examples. The first two schemas are working examples, all the others are not working examples.
After looking at the debug view and doing my own tests, it seems the string is just missing quotations. If you write sql in the template string as if you're writing sql and not a js string, it works.
The docs display the correct output sql that drizzle will produce, but it just doesn't work with postgres. As a temporary fix, just format your generated output like I did in the users_manual_sql table (bottom of this comment. I used two different ways to reference other columns for demo purposes), or ask Claude to write what you want in sql, then use that.
For example, if you have the following table:
export const usersString = pgTable("users_string", {
  firstName: text("first_name").notNull(),
  lastName: text("last_name").notNull(),
  fullName: text("full_name").generatedAlwaysAs(`full name`),
});

It will produce the following sql:
CREATE TABLE IF NOT EXISTS "users_string" (
	"first_name" text NOT NULL,
	"last_name" text NOT NULL,
	"full_name" text GENERATED ALWAYS AS (full name) STORED
);

which will give you the error: syntax error at or near "name"
If you make the table like this however:
export const usersManualSql = pgTable("users_manual_sql", {
  firstName: text("first_name").notNull(),
  lastName: text("last_name").notNull(),
  greeting: text("greeting").generatedAlwaysAs(`'hi ' || first_name || ' ' || "users_manual_sql"."last_name"`),
});

Then it will produce the following sql:
CREATE TABLE IF NOT EXISTS "users_manual_sql" (
	"first_name" text NOT NULL,
	"last_name" text NOT NULL,
	"greeting" text GENERATED ALWAYS AS ('hi ' || first_name || ' ' || "users_manual_sql"."last_name") STORED
);

Which will give you the correct data e.g.:
{
  "firstName": "Timya",
  "lastName": "Tighe",
  "greeting": "hi Timya Tighe"
}

Hi @m-atthart , I appreciate the response. After a couple of tries based on what you mentionned I was able to work around it.
For anyone facing the same issue, below is a working example that will generate a col value using 2 values from the row being inserted.
The example uses a generateHandle() helper function that formats the sql to generate a handle one or two values.
/**
 * Helper function to generate the sql that will create a handle from a column value.
 * - Optionally pass in a unique column to append to the handle.
 *
 * Example:
 * Name: US Bank Id: 37
 * Ouput: us-bank-37
 */
function generateHandle(column: PgColumn, uniqueColumn?: PgColumn): SQL {
  return sql`lower(replace(${column} || ' ' ||  ${uniqueColumn}, ' ', '-'))`;
}

/**
 * Organization
 * An account associated to a registered company.
 */
export const example = pgTable("organization", {
  ...DEFAULTS.ids,
  name: text().notNull(),

  /**
   * Handle is generated from the name and id
   */
  handle: text()
    .generatedAlwaysAs(
      (): SQL => generateHandle(organization.name, organization.id),
    )
    .notNull()
    .unique(),
});


Current resty fails completely in zsh

I just downloaded resty and it doesn't work at all for me with zsh:
$ . resty
$ resty 'http://localhost:4984'
http://localhost:4984*
$ GET /
curl: (3) <url> malformed

I've got zsh 4.3.11 on Mac OS X 10.8.2.
Unfortunately my shell-scripting fu is very low, so I don't know how to go about debugging this. No doubt it's some arcane difference in quoting between bash and zsh...

I didn't have any problem trying it on zsh 5.0.2, but have no idea if it comes from change in zsh, or changes that occur on resty

closing to do lack of activity


892 delegates endpoint does not work in a browser

Make sure these boxes are checked! 📦✅

[x] You have a nightly compatible version of rustfmt installed

rustup component add rustfmt --toolchain nightly

[x] You ran cargo +nightly fmt on the code base before submitting

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

1 of 1 (100.0%)  changed or added relevant line in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.02%) to 31.598%

Totals

Change from base Build<PHONE_NUMBER>:
0.02%

Covered Lines:
12372

Relevant Lines:
14084

💛  - Coveralls


[refactor](remove unused code) remove runtime tuple structure and useless utils class

Proposed changes

remove runtime tuple structure
remove some useless utils class like counter_cond_variable and batch thread pool
rename olap/tuple.h to olap/olap_tuple.h

Problem summary
Describe your changes.
Checklist(Required)

Does it affect the original behavior:

[ ] Yes
[ ] No
[ ] I don't know

Has unit tests been added:

[ ] Yes
[ ] No
[ ] No Need

Has document been added or modified:

[ ] Yes
[ ] No
[ ] No Need

Does it need to update dependencies:

[ ] Yes
[ ] No

Are there any changes that cannot be rolled back:

[ ] Yes (If Yes, please explain WHY)
[ ] No

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 36.14 seconds
load time: 499 seconds
storage size:<PHONE_NUMBER>7 Bytes
https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230130073708_clickbench_pr_86921.html


Ionic2 copyFile moveFile Error, Zone state notScheduled

here's my code either I use copyFile or moveFile it always goes to catch handler outside my promise fuction
moveFileToStorage(uri) {
        const _extension = '.' + this.getFileExtension(uri);
        const _name = this.getFileName(uri) + _extension;
        const _newPath = this.myStoragePath;
        const _newName = 'camera_' + this.hashName() + _extension;
        const _uri = uri.substring(0, uri.lastIndexOf('/') + 1);
        return this.file.moveFile(_uri, _name, _newPath, _newName);
    }

moveFileToStorage(uri).then((res) => { } ).catch( (err) =>{ err } ) <-- goes here catch handler

heres what zone output, actually I don't get what it mean, just a newbie in ionic 2 development.
{"__zone_symbol_currentTask": {"type":"microTask", "state":"notScheduled", "source":"Promise.then", "zone":"angular","cancelFn":null,"runCount"0}}
thanks.

Can you post a reproduce repo? thanks

hello Jialipassion here's my code scroll down to storeFile function
https://github.com/AUSdomgarcia/crud-ionic2/blob/master/src/pages/user/user.ts
and to see this.cameraSettings.useCamera()
https://github.com/AUSdomgarcia/crud-ionic2/blob/master/src/shared/camera-settings.service.ts
thanks..

ok, I will check it.

thanks I hope u can help me

@AUSdomgarcia , I just checked it, it is not a zone.js issue, it is just a ionic native error, you can ask for more detail in https://github.com/ionic-team/ionic-native

hi @JiaLiPassion  thank you for making time. I will close this a soon as i get a good feedback from ionic native.

btw @JiaLiPassion what can you about the catched error.
{"__zone_symbol_currentTask": {"type":"microTask", "state":"notScheduled", "source":"Promise.then", "zone":"angular","cancelFn":null,"runCount"0}}
what does it mean?

@AUSdomgarcia , this is just a property which zone add to the object.
the real error is image save url is invalid.

resolveLocalFilesystemUrl helps me to resolved the issue, I just had a mistake on how I implemented moveTo or copyTo, I didnt notice that this.camera.getPicture(opts) returns DirectoryEntry and from that directoryEntry I will call the moveTo/copyTo method, not from this.file
cheers!


Chore/heading and button components

Splices the 'button' element out of AccordionItemHeading and into its own AccordionItemButton component.
A nice side-effect of this refactor was that the additional 'arrow' div was able to be refactored into a pseudo-element of the button, and as such the user no longer needs to add it explicitly.

Coverage decreased (-0.6%) to 87.435% when pulling 80dd4cd4f423710dd8867bfee66db7dbdbf46c91 on chore/heading-and-button-components into a99abcf1f75806045fb4f657c9442f17747715fc on next.


Trigger GameEvents from the inspector

Create an editor script to make it possible to trigger GameEvents from the Unity Inspector. Probably best to create a generic class that gets extended for each GameEvent type.

one easy way to implement this is to add [ContextMenu("Raise")] to the event... then you can right click and select menu item to execute in editor
this unity addon improves the editor experience for lists and ScriptableObjects and shows buttons for ContextMenus
https://github.com/SubjectNerd-Unity/ReorderableInspector

Thanks @rakkarage ! Using ContextMenu sounds really cool! Actually didn't know about that.
I think the easiest approach though would be to in the GameEventEditor support passing your own value (from the inspector). Would at the same time be pretty rad to support rewrite it using the Unity's new UIElement approach to writing editor UI.

Fixed in 6693a27d2da2ff691752560e9619863ea7a4e554


Big problems with manjaro

The first problem is GDM, which is not so easy to change the default environment. All right, I changed it somehow.
Next - flickering image with sound loss when connected to a 4k TV. The flickering worsens when the HDR flag is turned on (I have a 7900 xtx).
Impossibility to use mangohud, because steem reports that some presset is already used. Consequently, nothing can be changed - neither hertzovka, nor anything else.
And lastly - the button to exit to the desktop does not work.
If someone, like me, also uses manjaro, it is better to install a ready-made solution: chimera OS, bazzite or nobara. I'm washing my hands of this and don't want to have to fix it all for months

Thank you for reaching out. This does work with GDM, so no need to switch to SDDM. The README.md file has been updated that provides instructions to set up and test this for GDM.
Unfortunately I won't be able to recreate the issue with flickering image with sound loss when connect to a 4K TV. However, there are known issues in using 'lib32-amdvlk' with Steam and it is better to use lib32-vulkan-radeon instead. Gamescope also includes flags that could help with optimisation (e.g., '--immediate-flips'. You can find these options by running 'gamescope --help' from the terminal.
As for MangoHud, the recommendation is to use the '--mangoapp' flag when running Steam with Gamescope. Make sure both mangohud and lib32-mangohud packages are installed. You can test this by running 'gamescope --mangoapp -e -- steam -steamdeck -steamos3' from the terminal or command line.
For the option to Switch to Desktop, make sure the /usr/bin/steamos-session-select script is present with execute permissions set (chmod +x /usr/bin/steamos-session-select).
Distributions like Bazzite, ChimeraOS and Nobara takes away the hassle setting up the Steam Deck experience from scratch with a community behind it. But then you're locked in to their distribution of choice (e.g., Fedora) and they have their own set of problems. When setting up from scratch, you have a choice of distribution that supports Gamescope.
I hope this helps. Just wondering, are you running the Flatpack version of Steam? This is something I haven't tried with, and used the package provided by the distribution instead. Also, I haven't used Manjaro in a long while.

As follow up, I've applied this guide on a mini PC with AMD iGPU running Manjaro with Gnome and GDM and it works fine. I'll update this guide to reflect that it works for other distributions that supports Gamescope.
As you're using Manjaro, there is a package called gamescope-session-steam. Installing this package will achieve similar results and is easier than following this guide as a do-it-yourself approach.
Of course, using distributions like Bazzite will be a lot easier to use is you want to avoid the do-it-yourself approach.

В качестве продолжения, я применил это руководство на мини-ПК с AMD iGPU под управлением Manjaro с Gnome и GDM, и оно работает нормально. Я обновлю это руководство, чтобы отразить, что оно работает для других дистрибутивов, поддерживающих Gamescope.
Поскольку вы используете Manjaro, существует пакет под названием gamescope-session-steam. Установка этого пакета позволит достичь аналогичных результатов и будет проще, чем следование этому руководству в качестве самостоятельного подхода.
Конечно, использование дистрибутивов, таких как Bazzite, будет намного проще в использовании, если вы хотите избежать подхода «сделай сам».

Yeah, I went to download bazzite as soon as I wrote that ticket. And I'm happy with it. Out of the box, full customization of steam and gamescope for TV. Even sleep mode works as well as on the steam deck itself. System updates are downloaded there and installed in silent mode by themselves. And for packages that don't have rpm, flatpak or appimage versions, a GUI program for containerization is already pre-installed. Overall, I'm happy with it

Sorry for the delay in responding, and I'm glad that you've found a solution. Distributions like Bazzite makes it easier to set up on a Steam Deck or on a living room PC for that console-like experience.
Thank you for taking interest on this project. The intention is to help people understand how Gamescope works with Steam on Linux to provide that SteamOS experience - its pretty much the basis for SteamOS. I hope this has been useful.
I'll mark this ticket as closed in the next few days.


feat: derive Deserialize/Serialize for ObjectMetaData

I hereby agree to the terms of the CLA available at: https://databend.rs/dev/policies/cla/
Summary
Derive serde Deserialize and Serialize for ObjectMetadata, because we want to save the object medata in local storage and serialize it with serde.
I'd appreciate it if you accepted this PR, thank you.

Thanks for the contribution!
This change mostly LGTM except one thing: can we make serde a feature so that we only derive those traits while needed?

@Xuanwo  Of course, we can. I have refactor the code and make serde as a feature(disabled by default), please take a look, thank you.


Fix copy process for symlink file

SSIA

Codecov Report
Attention: Patch coverage is 43.33333% with 34 lines in your changes are missing coverage. Please review.

Project coverage is 59.74%. Comparing base (91eed34) to head (ed3a403).

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.
Additional details and impacted files
@@            Coverage Diff             @@
##           master     #120      +/-   ##
==========================================
+ Coverage   55.32%   59.74%   +4.41%
==========================================
  Files          10       10
  Lines        2122     1796     -326
==========================================
- Hits         1174     1073     -101
+ Misses        762      531     -231
- Partials      186      192       +6


Update guess.py

Added a guess limit for users + displaying the number the program chose

Hello could you please review my pull request, or merge into another branch ?


Detection accuracy of dynamic obstacles

Thank you very much for your help. Is it correct that my_agents.size() in line 584 of sfw_planner.cpp represents the number of detected dynamic obstacles + 1 (robot itself)? When I modified the program to display this value during the simulation, it sometimes displayed various values such as 4 or 5 even though there was only one robot and one pedestrian. In addition, visualization with rviz showed some moving points other than the actual pedestrians. Is it collect to assume that this is a problem with the accuracy of the dynamic_obstacle_detector package or the performance of the robot's sensor? I am currently using 2d lidar for my simulation.
(My previous question about costmap_cost was resolved. Sorry for the inconvenience.)

Yes, it is correct; the agents size takes into account the robot.
Regarding the dynamic obstacles detector, as it is said in the documentation, it is a very simple detector that does not perform a very good detection. Sometimes it senses the two legs as independent obstacles, and the moving occlusions in the background walls provoked by the moving people are detected as dynamic obstacles too. Anyway, these false detections in the background should not affect the planner too much.
We are working in much better detectors, but that package is used to test the social planners for the moment.

I apologize for the delay in thanking you.
Thank you very much for your answer.


Make code coverage work again

Currently all the code coverage reports are timing out.
Before that, code coverage in some languages languages wasn't always available.
This is not urgent, but at some point, we need to revisit this and make sure we are getting results reliably. Perhaps we could use some of the new infrastructure tricks that we've introduced in the past month.
https://grpc-testing.appspot.com/job/gRPC_coverage/8838/
https://github.com/grpc/grpc/issues/6672

A big issue was that builds were failing because of a bad worker, but that worker is now disabled. I upped the timeout time from Jenkins, and from the completed build I see these reasons for builds timing out:

We added a lot of tests (over 2000 more compared to the last successful build in June)
More tests are taking longer, which can be seen by sorting by duration for these two builds: https://grpc-testing.appspot.com/job/gRPC_coverage/9081/testReport/(root)/tests/ and https://grpc-testing.appspot.com/job/gRPC_coverage/lastStableBuild/testReport/(root)/tests/
I believe that the time it takes for tests to time out have been increased over the last few months

I'm not too sure what can be done about this, but at least builds are completing and after more builds complete, we'll see if the results are reliable.

C# tests are failing when all languages are being ran, but they pass when running only C# tests. See https://grpc-testing.appspot.com/job/gRPC_coverage/9122/testReport/(root)/tests/ vs https://grpc-testing.appspot.com/job/gRPC_coverage/9120/testReport/. So, it seems like something in the previous tests are breaking something. I'll look into it, but I just wanted to send an update in case this might have happened before and you know what the issue is.

The problems seems to be loading of C# native library:
System.IO.IOException : Error loading native library "/var/local/git/grpc/src/csharp/Grpc.Reflection.Tests/bin/Debug/libgrpc_csharp_ext.x64.so"
TearDown : System.NullReferenceException : Object reference not set to an instance of an object
  at Grpc.Core.Internal.UnmanagedLibrary..ctor (System.String[] libraryPathAlternatives) [0x00068] in <8add62ce508f4dcbbd89255d51bd80c4>:0
  at Grpc.Core.Internal.NativeExtension.Load () [0x0005d] in <8add62ce508f4dcbbd89255d51bd80c4>:0
  at Grpc.Core.Internal.NativeExtension..ctor () [0x00007] in <8add62ce508f4dcbbd89255d51bd80c4>:0
  at Grpc.Core.Internal.NativeExtension.Get () [0x0002c] in <8add62ce508f4dcbbd89255d51bd80c4>:0
  at Grpc.Core.Internal.NativeMethods.Get () [0x00001] in <8add62ce508f4dcbbd89255d51bd80c4>:0
  at Grpc.Core.GrpcEnvironment.GrpcNativeInit () [0x00001] in <8add62ce508f4dcbbd89255d51bd80c4>:0
  at Grpc.Core.GrpcEnvironment..ctor () [0x0001f] in <8add62ce508f4dcbbd89255d51bd80c4>:0
  at Grpc.Core.GrpcEnvironment.AddRef () [0x0002e] in <8add62ce508f4dcbbd89255d51bd80c4>:0
  at Grpc.Core.Server..ctor (System.Collections.Generic.IEnumerable`1[T] options) [0x0006e] in <8add62ce508f4dcbbd89255d51bd80c4>:0
  at Grpc.Core.Server..ctor () [0x00000] in <8add62ce508f4dcbbd89255d51bd80c4>:0
  at Grpc.Reflection.Tests.ReflectionClientServerTest.Init () [0x0001a] in <a645daf926c34570a66c4b6afe98cc4b>:0
  at (wrapper managed-to-native) System.Reflection.MonoMethod:InternalInvoke (System.Reflection.MonoMethod,object,object[],System.Exception&)
  at System.Reflection.MonoMethod.Invoke (System.Object obj, System.Reflection.BindingFlags invokeAttr, System.Reflection.Binder binder, System.Object[] parameters, System.Globalization.CultureInfo culture) [0x00038] in <94fd79a3b7144c54b4cb162b50fc7761>:0

There's two possible reasons:

the library is not in the given location (it should be copied to there by msbuild when building the C# solution)
the library cannot be loaded because there are some symbols missing (C# is built with make EMBED_OPENSSL=true option, while C core isn't).

It seems that it might be 2), because if ran alone (= C core does not get built), things work just fine.
We've actually seen a similar issue with performance tests:
https://github.com/grpc/grpc/blob/66de9494afd6aa5eaddb5f8fe66f275c4b2a8e38/tools/run_tests/performance/build_performance.sh#L43
I'll try think of a workaround to use here...

It looks like the same issue was supposed to be addressed by #7401. However, the last successful build was https://grpc-testing.appspot.com/job/gRPC_coverage/6482/ which predates when that PR was merged. Also, the builds prior to and after 6482 have the same issue with C#. Also they're built on the same machine and tested the same revision of gRPC, so I'm not sure what to make of this flaky successful build.

https://grpc-testing.appspot.com/job/gRPC_coverage/9200/ - Here's another flake that was the only one to run C# tests successfully in the last few thousand builds. I tested for a possible race condition by running inner_jobs=1 on a fresh VM, but that didn't work so I'm still not sure why this build was successful. Also, I talked with Nico, and he said that setting EMBED_OPENSSL=true for C core tests should be fine, and I have had positive results doing this, so I think it should be fine to do this just for the coverage test.

Coverage has been stable for about a week. Example report:
https://grpc-testing.appspot.com/job/gRPC_coverage/15156/HTML_Report/


IE8: Unable to get value of the property 'appendChild': object is null or undefined

I really like the facebooker2 plugin, keep up the great work!  I'm receiving this javascript error when displaying a page using facebooker2 in IE8.  It works fine in IE9 and all other browsers, but is failing consistently in IE8 both ssl and non-ssl.  I am using facebooker2 0.0.16
The that is throwing the error is line 40 in lib/facebooker2/rails/helpers/javascript.rb:
document.getElementById('fb-root').appendChild(e);

It appears to not be able to find the div with an id of "fb-root" even though it is inserted into the document on line 23 and I'm not sure why.  My fix at the moment locally when playing around with this is to add an if statement around line 40 to not perform appendChild if it can't find fb-root but I don't think that is a permanent solution.
Are you able to recreate this in IE8?  Thanks.  Jeff

We haven't had any problems in IE8 that I've heard of. I have heard complaints from others about this issue though. Can you replicate it with a really small sample app? I would love a simple test case to play with.
Mike
On Mar 5, 2012, at 10:43 AM, Jeff Steil wrote:

I really like the facebooker2 plugin, keep up the great work!  I'm receiving this javascript error when displaying a page using facebooker2 in IE8.  It works fine in IE9 and all other browsers, but is failing consistently in IE8 both ssl and non-ssl.  I am using facebooker2 0.0.16
The that is throwing the error is line 40 in lib/facebooker2/rails/helpers/javascript.rb:
document.getElementById('fb-root').appendChild(e);

It appears to not be able to find the div with an id of "fb-root" even though it is inserted into the document on line 23 and I'm not sure why.  My fix at the moment locally when playing around with this is to add an if statement around line 40 to not perform appendChild if it can't find fb-root but I don't think that is a permanent solution.
Are you able to recreate this in IE8?  Thanks.  Jeff

Reply to this email directly or view it on GitHub:
https://github.com/mmangino/facebooker2/issues/77

--
Mike Mangino
http://www.elevatedrails.com

Thanks for the quick reply.  Sure, I should be able to put something together to replicate this, I'll let you know when it is ready.


ci: skip tests involving L7 proxy if race detector is enabled

Running tests involving the L7 proxy fail when using the race detector, so skip them in that case.
See individual commit for details.
Fixes #13753
Fixes #13757

test-race-runtime

test-race-runtime

test-me-please

The tests somehow weren't disabled in Runtime-4.9-Race. It looks like $(RACE) is not passed to ginkgo, so the tests themselves are not built with the race detector enabled.

test-race-runtime

test-me-please

test-me-please

test-race-runtime

test-race-gke

test-race-4.19

test-race-upstream-k8s

test-race-runtime

test-race-gke

test-race-4.19

test-race-upstream-k8s

test-me-please

retest-net-next

retest-4.9

test-race-runtime

test-me-please

test-race-4.9

test-race-4.19

test-race-upstream-k8s

retest-gke

test-race-gke

All required tests passed (with and without race detector), the only one failing is the k8s upstream test with race detector. This one also fails on master on the same test: https://jenkins.cilium.io/view/Race Detection/job/cilium-master-K8s-Upstream-Race-Detection/15/
Thus, marking as ready to merge.


chore: release 18.15.0 images needed for cypress monorepo (chrome/fir…

…efox updates to come later)
will close this PR once the job succeeds and the images are available on dockerhub

closing as cypress/browsers:node-18.15.0-chrome-106.0.5249.61-1-ff-99.0.1-edge-114.0.1823.51-1 is available. also cancelled the included images job as I do not want to overwrite what currently exists on cypress/included:13.0.0


automatic publish on merge to master.

🧩 Feature request
Description
Automate publishing new 'nightlu' packages when branches are merged into master.

This is done


reg-110 catalog release 2.20.0

For catalog release 2.20.0, Scheduled on 10th Feb 2022 at 8:30

@johannahemminger please do a language review for this release tomorrow morning.

Followed Adam's instructions on Slack (with Mark's guidance)


Update C# port link

The ownership of the C# port has changed, you will note that the old location https://github.com/aidanbebbington/libphonenumber-csharp/ redirects to the new location.

I signed it!
Not sure if it's needed in this case.

Thanks! Approving...


how to predict

it seems there is no prediction in main_supcon.py, how do you determine prediction? get the max of features between size (2, classes)?

Hi, @accelsao,
A linear classifier need to be trained for prediction, please see main_linear.py.

I still don't understand, how does main_linear.py determine the prediction?


[memory] Introduce a Better Abstraction for Runtime Buffers

Description
In this PR I fix issue https://github.com/demikernel/demikernel/issues/86.
Here is a digest of the commits:

In commit aab28885ea2fad42ded151b3bef0a461c3ee7695 I introduce the new HeapBuffer abstraction.
In commits ee0efe081b96594e29036ced6b4ccb0457964d7e, 1b024fbaf5f8a441eacd327f22bdb1b2329170ab,  I patch our LibOSes to rely on this new abstraction.

Also, note that:

In commit 1c027eb81b24315f83a56ff27713cc2a33f130d8 I fix a bug in our TCP push pop test. It was expecting a packet of a given content and size. This check was not good because this unit tests performns a one-directrion transmission.

A meta comment: I don't like the name HeapBuffer, because these aren't necessarily heap buffers.  At least not in the way people generally speak of a program's heap.
I think this is supposed to be the equivalent of Window's NET_BUFFERs or Unix's Mbufs, but both of those names are also bad for various reasons.  I would probably call these just "DataBuffer".  Or we can have a separate discussion about what to call them.

@BrianZill

A meta comment: I don't like the name HeapBuffer, because these aren't necessarily heap buffers. At least not in the way people generally speak of a program's heap.
I think this is supposed to be the equivalent of Window's NET_BUFFERs or Unix's Mbufs, but both of those names are also bad for various reasons. I would probably call these just "DataBuffer". Or we can have a separate discussion about what to call them.

Sure! Do you have a suggestion on what we should call this?

My suggestion would be something along the lines of "DataBuffer", or if that is too generic, maybe "IoBuffer".  I'd avoid using "NetworkBuffer" or "NetBuffer" as we want Demikernel to be used for other types of I/O as well (eventually).  Maybe we could go with "MemoryBuffer" or "MemBuffer", but that seems even more generic than "DataBuffer" and might be too close to Berkeley Mbufs.

My suggestion would be something along the lines of "DataBuffer", or if that is too generic, maybe "IoBuffer". I'd avoid using "NetworkBuffer" or "NetBuffer" as we want Demikernel to be used for other types of I/O as well (eventually). Maybe we could go with "MemoryBuffer" or "MemBuffer", but that seems even more generic than "DataBuffer" and might be too close to Berkeley Mbufs.

Sure @BrianZill . I did it.


TypeError: function() argument 'code' must be code, not str

its gives above error on line import python_weather when used in android for reference here is the link
https://stackoverflow.com/questions/72676144/typeerror-function-argument-code-must-be-code-not-str/72676439?noredirect=1#comment128378227_72676439

hmmm, this seems to be an issue with aiohttp, as the stack trace said


Port CIFAR data augmentation to KeystoneML master

cc @Vaishaal - A draft of the code is at https://github.com/shivaram/keystone/blob/keystone-vw-experiments/src/main/scala/nodes/images/RandomFlips.scala
Right now the code does both random patches and the center + corners, but we should separate them out into different nodes

awesome,

I know this is basically a function node that does a flatmap, but in the interest of code reuse, would it make sense to take in arbitrary Image->Image functions? I'd love to be able to quickly write a "rotate image slightly" function of Image -> Image type and then have this node just Do The Right Thing.

Well I've already started refactoring to help some of this - I split the code into two parts one is a FunctionNode to just extract random patches and the second a RandomFlipper node (i.e. something that flips horizontally with some chance). We can refactor the second function to just be RandomImageTranslator that takes in Image => Image translate function and a probability. Would that meet your use case ?
Basically the FunctionNode is necessary to go from one Image to a bunch of patches. And then on for each patch we can have a number of transformers.

Added this to 0.3.0 because I think it's highly useful and we're pretty close to done.


bold, depopulate

This pull request was generated by the 'mq' tool
[test]
flake rate: 0.1
logical conflict every: 100
sleep for: 300s
close stale after: 4 hours
[pullrequest]
requests per hour: 0
deps=[b,d]

/trunk merge


Why is your site blocked for the Dominican Republic?

Hello @shamuel22, I don't know, it shouldn't be. I'll investigate!


Removed deprecated castShadows and receiveShadows

Fixes #4242
castShadows and receiveShadows are now removed in favor of ShadowMode.
Basically just reverted most of https://github.com/AnalyticalGraphicsInc/cesium/pull/4005/commits/e862db599c56e582c9bab424a0bedd0b1637bfb0

No rush for this, it just needs to get in before 1.26.

@lilleyse please update the CZML doc if required.
CC @shunter


[ACS Rooms] API Review

IMPORTANT: This is just a placeholder, we are still actively working on our swagger and it is not ready for Azure Board Review at the moment.
General Information for Rooms API Review:

Service name: ACS Rooms
Key contact for this review: Minnie Liu
Link to previous API version: azure-rest-api-specs/communicationservicesrooms.json at main · Azure/azure-rest-api-specs (github.com)
Description of the material to be reviewed/changed: Rooms GA Changes
Link to swagger: azure-rest-api-specs/communicationservicesrooms.json at 211d16d9e08ad2e6b336b7db7d20280d7d70f3c6 · Azure/azure-rest-api-specs (github.com)
Champion scenarios that briefly explain how developers will use your API: Rooms API Champion Scenarios.docx

New API Review meeting has been requested.
Service Name: IC3 ACS Rooms
Review Created By: Jorge Garcia Hirota
Review Date: 3/14/2023 1:00 PM PT
PR: https://github.com/Azure/azure-rest-api-specs/pull/22540
Hero Scenarios Link: here
Core Concepts Doc Link: Not Provided
Description:
Detailed meeting information and documents provided can be accessed here
For more information that will help prepare you for this review, the requirements, and office hours, visit the documentation here

Notes from API Review on 3/14/23 (pi day!)

GET and PATCH on participants are fine by themselves but unusual viewed in combination
Response from PATCH on pageable collection - unusual situation but empty object seems fine
Do we need to have AAD authentication as part of the Security definitions? Is it a requirement for GA?

A: the spec should accurately describe security requirements -- AAD not required.

value is good for array, participants should be object
date-time values should be suffixed with "At" link
Last value wins is the correct interpretation of Merge-Patch behavior
Pass participants to CreateRoom as a map rather than array
Role can be optional as long as there is a clearly documented default, and that is then the default value for configurable roles when that comes along.
empty object in merge-patch means don't change anything. To set role to default role you need '{ "role": null }'

No concerns with this API. It is good to go for preview, and also for GA if no further changes.

@mikekistler We've addressed all the comments, most of them were just comments.
The changes we made:
- Pass participants to CreateRoom as a map rather than array
Could you take another look?


Non-logged in users shouldnated/prompt of the day

Non-logged in users should get some kind of message telling them they need to log in to play rated/prompt of the day. Right now it just shows a blank screen.


app menu

the menu in the header should be cleaned up

[ ] create a side bar menu with a toggle button in the header
[ ] move the persistence related stuff to the sidebar


feat: add core functionality

Description
Adds core package functionality

Testing required outside of automated testing?

[x] Not Applicable

Screenshots (if appropriate):

[x] Not Applicable

Rollback / Rollforward Procedure

[x] Roll Forward
[ ] Roll Back

Reviewer Checklist

[ ] Description of Change
[ ] Description of outside testing if applicable.
[ ] Description of Roll Forward / Backward Procedure
[ ] Documentation updated for Change

:tada: This PR is included in version 1.0.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Use of CAT in nextflow nf-core pipeline

Hi,
we would like use, or more precise continue using CAT in the nf-core mag pipeline, however, there are a few issues we are facing currently.

If I see it correctly, one still needs to use the diamond version which was used to create the database, as already discussed in https://github.com/dutilh/CAT/issues/45. Is there any plan that this might change in future releases?
This is a problem for nextflow pipelines, since they use one specific container, i.e. with one specific diamond version. Thus only certain db versions could be used with the pipeline, and one would need to update the pipeline immediately after each new db release, if necessary. (And then it would not work with older db versions anymore.)

To know if a database version would be compatible to the current pipeline version, one would need to download 180 GB first.

Accessibility of older database versions: are older versions somewhere accessible? I know the databases are quite large, but for the sake of reproducibility, it would be good if also older database versions would remain accessible. Furthermore, if not, older pipeline versions would also not work anymore.

I just thought I double check if there is anything planned for the future or if we missed something here.
Thanks in advance!
Best, Sabrina

Hi @skrakau,
Thanks, it's great that you use CAT in the nf-core mag pipeline! :)
We don't have a longterm solution for this, but as said before it's on our list.
This is the standing: we cannot currently make any DIAMOND database compatible with any version of DIAMOND. Some versions of DIAMOND work with some DB formats, so it doesn't have to be a one-to-one match, but some don't. What we do instead is in the preconstructed DB folder supply the DIAMOND binaries with which the database files are made. It's in a folder called DIAMOND_X.X.X. A user (or pipeline) can manually set --path_to_diamond to this binary, and everything should run as intended.
If that helps I could make this path the default version of DIAMOND if it exists and no --path_to_diamond is supplied. The only thing you'll have to do is download the latest DB folder and all should run smoothly.
Alternatively if that doesn't work for you because want to supply your own version of DIAMOND I can put the version in the name of the tarball or put an extra text file on the server with the version number. Let me know your thoughts on this!
Regarding older DB versions: we do have the old databases on our own system so a user can always ask for them but currently I only put the latest on our download server (the storage there is limited). Also we don't want to keep TBs of data so we're thinking of a more robust solution of saving a single DB per timeframe...
Best wishes,
Bastiaan

Hi @bastiaanvonmeijenfeldt, thanks a lot for your answer and the updates!
Yes, the name in the tarball or in an extra file would help, then one could directly see if it is still compatible.
I will try to keep myself up to date. Thanks again!

Hi, I am having this problem (https://github.com/nf-core/mag/issues/188).  Even if I do --path_to_diamond, it does not overwrite the DIAMOND that is included in Nextflow MAG.  Can you make tbb.bio.uu.nl/bastiaan/CAT_prepare/CAT_prepare_20200304.tar.gz  available on your website?
Thanks,
Gail


Avoid using any's in common Date class

This causes any JS library exporting Date instances to blow up on the dynamic-export linter flag. Disabling the flag is not an option for library authors, since any project using that library will also have to disable that linter flag in turn.

thanks!


Remove Python 2 support

GraphQL-core v3 is out, and merging this PR is a prerequisite for migrating to it: #672 is related.

It helps make sure you have the correct version of Python before locking.
I don't see the harm in keeping it and encouraging people to use it to
avoid Python version issues. It doesn't stop anyone from doing pipenv lock directly, but it does minimize the odds that locking fails because of
a Python version mismatch.
On Sun, Dec 1, 2019, 11:20 AM pmantica1<EMAIL_ADDRESS>wrote:

@pmantica1 commented on this pull request.
In scripts/make_pipenv_lockfile.sh
https://github.com/kensho-technologies/graphql-compiler/pull/683#discussion_r352356154
:

echo 'Creating Python 3 lockfile...'
pipenv --rm
-pipenv lock --python="$(which python3)" --dev
+pipenv lock --python="$(which python)" --dev
I don't think we need this file anymore.
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/kensho-technologies/graphql-compiler/pull/683?email_source=notifications&email_token=AAR5MSTOFRDBXR56T2RYFGTQWPP5BA5CNFSM4JSNOIH2YY3PNVWWK3TUL52HS4DFWFIHK3DMKJSXC5LFON2FEZLWNFSXPKTDN5WW2ZLOORPWSZGOCNPFKBI#pullrequestreview-324949253,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAR5MSWFBRW5AJEA2GQIKBTQWPP5BANCNFSM4JSNOIHQ
.

I am still not a huge fan of not this scripts/make_pipenv_lock.sh file for the following reasons:

pipenv already gives you a warning when you are using a version of python other than the one specified by the Pipfile.
If we are going to have a script to enforce this sanity check when running pipenv lock why not also have a script to enforce it when running pipenv install or pipenv sync. It seems weird to me to special case pipenv lock since when you are creating your virtual environment with pipenv install you also need to make sure you are using the right version of python.

You mentioned that you don't see the harm in keeping it, but I think that these file contents are confusing for a new user. A new user would:

Randomly stumble onto this file because there is currently no documentation about it in the contributing docs.
Parse all the semi-complicated bash.
Become confused about what is the purpose of this file, specifically why we have a file like this one for creating a lock file but not a virtual environment.

At the end of the day, I think it makes more sense just include in the contributing docs the following phrase "be sure you are using the right version of python <link_to_how_to_specify_the_version_of_python_in_pipenv>". However, I don't think that we really need to do so because pipenv already gives you a warning if you are using the wrong python version.

If we are going to have a script to enforce this sanity check when running pipenv lock why not also have a script to enforce it when running pipenv install or pipenv sync. It seems weird to me to special case pipenv lock since when you are creating your virtual environment with pipenv install you also need to make sure you are using the right version of python.

pipenv sync and pipenv install affect only your local environment state, whereas pipenv lock updates the lockfile which affects everyone else's environment state too.
That said, pipenv lock seems to have weird behavior which threw me off. If you already have a pipenv-managed virtualenv, it seems to use that one and ignore whatever python resolves to in the current shell — so I thought that it doesn't actually verify the Python version. If you remove the virtualenv, it does check the Python version, so the script isn't necessary.


HD Skin support

Since I'm used to 16x16 skins instead of 8x8, it would be a nice addition to bedrock players (or java players who use mods for these skins (like me))

Hello, I tried to solve the issue.
This is what I did:
This change adds support for 16x16 skins, which are commonly used by Bedrock players and some Java players with mods. The modifications include adjusting the canvas size, updating drawing logic, and modifying the wrapping and mirroring functions to accommodate the larger skin format.
You can review changes in this commit: https://github.com/lattaai13/udu3324-PNGskin-23/commit/82779470703c4504c9d82a63ddd788a2e6a6474c.

[!CAUTION]
Disclaimer: The commit was created by Latta AI and you should never copy paste this code before you check the correctness of generated code. Solution might not be complete, you should use this code as an inspiration only.

This issue was tried to solve for free by Latta AI - https://latta.ai/ourmission
If you no longer want Latta AI to attempt solving issues on your repository, you can block this account.


Unable to remove default which-key keybindings config

I am trying to completely disable all default which-key bindings (besides those defined in my keymaps) but have been unsuccessful.
In my plugins/which-key.lua file I have:
return {
  "folke/which-key.nvim",
  event = "VeryLazy",
  init = function()
    vim.o.timeout = true
    vim.o.timeoutlen = 500
  end,
  keys = function()
    return {} -- <--should remove all default mappings
  end
}

I have tried overriding defaults as well as overriding keys but have been unsuccessful. Am I missing something?

I use the following hack.

./config/nvim/lua/plugins/default_bindings_disabled.lua:

return {
  {
    "LazyVim/LazyVim",
    opts = {
      defaults = {
        -- Disable all default key bindings
        keymaps = false,
      },
    },
  },
}

This setup will give you complete control over all key mappings in LazyVim, allowing only the ones you define.


Right click resets the zoom to RuneLite default when opening/closing sidepanel in resizable mode

Even with the option ticked when you right click on the minimap it zooms it all the way back in. If you toggle the plugin it works for one or two clicks then goes back to having right click reset the zoom.
GIF demonstration

After some testing via Discord, most likely cause by opening/closing sidepanel while in resizable mode.
Fixed in 5251bfc3c21f96c7888066f98ef9e6d33e5bcc7f


Auto-Port Names

When the ports are configured in a config file, there should be an auto option so that the explicit ports don't need to be listed. In that case, any ports present in the config file would be monitored.

Fixed in Revision 0.1.2.


Set folder permission

There is no way to set permissions for folder (e.g. chmod -R 777 /opt/app). Permissions work just for files.
There is also no way to run sh-command (Build it in base image is total overhead).
Think, please, this functionality

Re: setting permissions, if you are really in a situation like you described (having less-secure legacy code that you cannot update), then perhaps writing a Jib extension may be the best option for you. This should be a better way than the hack I mentioned in https://github.com/GoogleContainerTools/jib/issues/2249#issuecomment-578937936.

I believe the comments above as well as #1257 provide enough answers and potential solutions to this issue.


Move more provider traits into storage-api crate

Describe the feature
we still have a few traits defined in the reth-provider crate that are independent of reth-provider internals, like
https://github.com/paradigmxyz/reth/blob/e6a6fc4c2e188c71b6dc67e67549cf38d0bb1d46/crates/storage/provider/src/traits/history.rs#L10-L10
all of those should be moved to https://github.com/paradigmxyz/reth/blob/e6a6fc4c2e188c71b6dc67e67549cf38d0bb1d46/crates/storage/storage-api/Cargo.toml#L2-L2
ideally, trait by trait to make review easy.
can be re-exported from reth-provider to not break a ton of stuff
Additional context
No response

Hi @mattsse started with #12480  and I can continue on this depending on the recommended length of each pr!

cool, ty!

this one we can move as well
https://github.com/paradigmxyz/reth/blob/cef7ec80c13acac11ac4c2b93bf6bd19f4298d8c/crates/storage/provider/src/traits/header_sync_gap.rs#L31-L31

I had a look again on this and it seems it is used here:
https://github.com/paradigmxyz/reth/blob/cef7ec80c13acac11ac4c2b93bf6bd19f4298d8c/crates/storage/provider/src/providers/database/provider.rs#L1202
Do you still consider that it should be moved to storage-api crate?

hmm, actually not sure about this one because this is kinda p2p, so we can keep this particular one for now

hmm, actually not sure about this one because this is kinda p2p, so we can keep this particular one for now

Cool. What else do you think is necessary to close this ticket?

marking this as closed


UseFrontCameraIfAvailable does not work on Android.

Hello.
I found that UseFrontCameraIfAvailable did not work on Android devices.
I inspected github repository sources and found that front camera was always bypassed by code like this;
// We don't use a front facing camera in this sample.
var facing = (Integer)characteristics.Get(CameraCharacteristics.LensFacing);
if (facing != null && facing == (Integer.ValueOf((int)LensFacing.Front)))
{
          continue;
 }

If you implement UseFrontCameraIfAvailable support on Android, it will be best.
In addition, if it is possible to select or set a target camera for previewing, it will be very helpful. Current Android implementation may use first non-front camera.
Best regards.

I added a pull request with a fix for this


Caching

Need to implement caching to prevent database hits (assumption) every time the endpoint is accessed.

https://github.com/snickler/RSSCore/pull/4 Fixes this.


4490/GC+ mark & sweep

closes #4490

Thanks - seems like you nailed the

It was tested locally with spark-submit

Thanks - seems like you nailed the

It was tested locally with spark-submit

Cool! I can think of 4 scenarios that are worth verifying, but maybe there are more:

Just Mark.
Just Sweep.
Mark&Sweep.
No Mark & No Sweep.

Did we check all 4?


Feature request: make an endpoint that returns all navigations

Hello, instead of having to do a request to something like (...)/api/navigation/render/xyz for each navigation, it would be valuable to have 1 endpoint that returns all navigations, each containing at least the id, name, slug, and items.
It exists in the strapi admin panel but not in the API.
So an array of the navigations like this (url: GET strapi url/navigation):

but every navigation has the items too (url: GET strapi uri/navigation/{id}):

Hi everybody,
I agree with @fabiennecornel, this new feature would be very useful.
@fabiennecornel did you solve creating a custom endpoint on Strapi?

We are going to include it in one of next two releases


[API-8] Expose PaginationCalculator

Closes #2138.

Also, this could target api-7 as well.

I think it's worth noting in the documentation that this assumes the vanilla font. In ChatUILib I have FontData which reads a .png to determine character sizes, allowing non-vanilla ascii.png measurements.
For unicode characters there's glyph_sizes.bin, though I'm not sure if this is modifiable in a datapack.

Also, to centre text means knowing the width of the chat box. SpongeCommon assumes the default (320), but it is customizable (see https://ore.spongepowered.org/simon816/Chat-UI-Library#player-settings)

I think it's entirely fine that the Sponge Common implementation only supports vanilla content. Perhaps it could be expanded to be able to load data from resource packs and automatically configure based on the server pack, but it is a service and can be replaced by other more customizable implementations.
Another theoretical implementation could integrate with a client mod that passed the necessary sizing and resource pack information to the server,but that would be imo out of scope for sponge itself. However, to make this more friendly to such an implementation, the getCalculator method should probably take a Player parameter?

This has sat around for some time - what do we want to do with this?


Fetch asset_sums starting from a specific block

As of now, the token balances and eth balances are fetched from the most recent block. In production, it is likely the case that the CEX would need to generate a π of Solvency using as asset_sum some balances from a previous block, specifically the next block available at t where t is when the snapshot of liabilities was generated.
Therefore, we need a way to fetch these balances from a specific block number.

We can retrieve the ETH balance for a specific block number using the get_balance method, which accepts the block number as an optional parameter. However, contract methods, such as balance_of, do not have this functionality. Therefore, we need to create a method for eth_call that supports calling state in historical block states.

Ok, we can keep it as it for now. If this becomes a required feature, we'll think about this.
Closing the issue for now


Added WikiText-TL-39

This PR adds the WikiText-TL-39 Filipino Language Modeling dataset.
Paper: https://arxiv.org/abs/1907.00409
Repo: https://github.com/jcblaisecruz02/Filipino-Text-Benchmarks

looks like this PR also includes changes about another dataset covid_qa_deepset
Could you create another branch and another PR that only includes the changes for the wikitext-tl-39 dataset ?