ClearML serving design v2

ClearML serving design document v2.0
Goal: Create a simple interface to serve multiple models with scalable serving engines on top of Kubernetes
Design Diagram (edit here)

Features

Fully continuous model upgrade/configuration capabilities
Separate pre/post processing from model inference (serving engine)
Support custom python script per endpoint (pre/post processing)
Support multiple model inference serving engine instances
Support A/B/Canary testing per Endpoint (i.e. test new versions of the model with probability distribution)
Support model monitoring functions
Support for 3rd party monitoring plugins
Abstract Serving Engine interface
REST API with serving engine
gRPC interface between pre-processing python code and model inference

More efficient encoding than json encode/decode (both compute and network)

Performance (i.e. global latency / throughput  and model inference latency) logging

Optional custom metric reporting

Standalone setup for debugging

Pre-process (proxy) code (running on host machine) (launching the “Model Inference”)
Model inference (serving engine) inside local container

Deployment support for Kubernetes

Proxy container (with pre-processing code) has kubectl control
Serving engine container (model inference) launched by the proxy container

Autoscaling inference model engines based on latency

Modules

ClearML serving container

Singleton instance, acting as the proxy & load balancer

ClearML serving Task

Stores configuration of a single instance of the Serving container

3rd party plugins
Kubernetes config
Serving Engine configuration
Models / Endpoints

Serving Engine

Standalone container interacting with the ClearML serving instance
ClearML Sidecar configuring the Serving Engine (real-time) & sending reports back

ClearML model repository

Unique ID per model
Links to model files
Links to modler pre/post processing code base (git)
Supports Tags / Name
General purpose key/value meta-data
Queryable

Configuration CLI

Build containers
Configure serving system

Usage Example

CLI configuring the ClearML serving Task

Select initial set of models / endpoints (i.e. endpoint for specific model)
Set Kubernetes pod template YAML

Job YAML to be used for launching the serving engine container

CLI build Kubernetes Job YAML

Build the Kubernetes Job YAML to be used to launch the ClearML serving container
Add necessary credentials making sure the “ClearML serving container” will be able to launch serving containers

Kubectl launching the “ClearML serving container”

The “ClearML serving container” will be launching the serving engine containers

Once “ClearML serving container” is up, logs are monitored in the ClearML UI
Add additional models to a running “ClearML serving container”

Provide the “ClearML serving Task”
Add/Remove new model UID

@bmartinn nice works.

Can I ask any timeline to roll out this progressively / any branches that I can access while it is built?

From the description, it seems like the design is for inference requests to go through clearml-serving too, thus you added deployment strategies and preprocessing in clearml-serving. What's the thinking for inference requests to go through clearml-serving? Are you thinking to allow extension of clearml-serving by 3rd party to cover all aspects of model serving, such as pre/post processing, model validation, resources monitoring?

I did some part of the works too, so wondering how I can gel with the parallel works done by clearml team.

A/B/Canary/Mirrored. Had done up using kubernetes ingress with nginx controller to route / mirror inference requests to another set of triton instances. Simple configs which I can share if you find it useful.
clearml-sidecar.

I did part of the clearml-sidecar; embedded it in serving engine container and spin up a subprocess to monitor changes in clearml-serving state to update published models periodically.
The differences I have is that I do not store the model repo object, metrics as I feel that they are best managed by clearml-serving and serving engine respectively. Was trying to have a single source of truth and not duplicating the info which may have sync issue downstream.
was thinking about the unique ID design to identify the serving engine instances, so that i can differentiate or aggregate serving engine metrics at serving instance end. Any thoughts on this yet?

I'm hoping that late next week I will be able to push a new dev branch with new code to play around with

... What's the thinking for inference requests to go through clearml-serving?

Good point on latency, and obviously this is by choice. The feedback we received, and feel free to add some more, is that pre/post python callbacks are really necessary for a lot of use cases. We opted for this design as it allows users to very easily add pre/post python functions and still use serving engines for the model inference  heavy lifting. A good example for preprocessing function would be if the input is a url string, the preprocessing would download the data from the url, encode it (i.e. load it into a numpy array) and pass it to the serving engine to run the model inference itself. postprocessing example would be converting an encoded result to string human readable string representation.

Are you thinking to allow extension of clearml-serving by 3rd party to cover all aspects of model serving, such as pre/post processing, model validation, resources monitoring?

Yes this exactly what we have in mind. Specifically in the diagram the "3rd party plugin" would be an integration to model drift / anomaly detection, either running on the same machine, or sent to an external service.

I did some part of the works too, so wondering how I can gel with the parallel works done by clearml team.

😍

A/B/Canary/Mirrored. ...  kubernetes ingress ...

Yes that would be the easiest out of the box solution, I think the major drawback is the ability to easily configure it in realtime?!
My thinking is to have the ability to configure the clearml-serving externally, while it is running. As the current design routes all requests through the clearml-serving instance, it should not be very complicated. wdty? if this is achievable with k8s ingress (and configurable) I think I would prefer k8s ingress to do that, thoughts ?

I did part of the clearml-sidecar; embedded it in serving engine container and spin up a subprocess to monitor changes in clearml-serving state to update published models periodically.

Feel free to post a link to a gir repo / snippet :)

The differences I have is that I do not store the model repo object, metrics ...

I might have failed to illustrate it in the diagram, the idea is Not to store another copy, just reference the Model entity in clearml-server. The idea is to expand the Model entiry so we can store more information on it (right now it is limited to URL/configuration/key-val, I think it makes sense to store performance metrics and links to post/pre code on the model itself. In the beginning though, I think we will store it all on the "clearml-serving" Task, that will also serve as a UID for the clearml-serving instance.

was thinking about the unique ID design to identify the serving engine instances,

Right now we use additional Tasks to do that, every time the "sidecar" spins, it creates a new Task this identifies the serving engine itself (and thus we can store metrics on the serving engine instance performance). wdyt?

Expanding the original post
Suggested CLI:
ClearML Serving - launch mode serving control plane, to orchsetrate all model
serving

positional arguments:
  {display,config,model}
                        sub-command help
    display             Display information on the currently running clearml-serving instance

    config              Configure `clearml-serving` instance
              --packages [PACKAGES [PACKAGES ...]]     List of additional packages and versions needed by the model serving pre/post processing code

    model               Configure Model endpoints
              list             List current models
              remove           Remove model by it`s endpoint name
                        --endpoint ENDPOINT  model endpoint name
              add              Add/Update model
                        --endpoint ENDPOINT   Model endpoint (must be unique)
                        --id ID               Specify Static Model ID to be served
                        --name NAME           Specify Model Name/Tag/Project/Published to be selected and served
                        --tags TAGS           Specify Model Name/Tag/Project/Published to be selected and served
                        --project PROJECT     Specify Model Name/Tag/Project/Published to be selected and served
                        --published           Specify Model Name/Tag/Project/Published to be selected and served
                        --preprocess PREPROCESS Specify Pre/Post processing code to be used with the model (point to local file)
                        --input_size INPUT_SIZE [INPUT_SIZE ...] Specify the model matrix input size [Rows x Columns X Channels etc ...]
                        --input_type {float32,float16,uint8} Specify the model matrix input type
                        --output_size OUTPUT_SIZE [OUTPUT_SIZE ...] Specify the model matrix input size [Rows x Columns X Channels etc ...]
                        --output_type {float32,float16,uint8} Specify the model matrix output type

@bmartinn here's the work I am doing which focuses on the "clearml-sidecar". https://github.com/okyspace/clearml-serving/tree/triton_proxy/clearml_serving
Not sure if it makes sense to you.

@okyspace Quick update, things are finally wrapping up, here is the latest branch:
https://github.com/allegroai/clearml-serving/tree/dev
Next main step is getting the statistics merged as well :)

@bmartinn Thanks for the new design for ClearML serving.
For some reason I can't locate any configuration for deploying on K8s, although it was mentioned "Deployment support for Kubernetes".
Do you happen to have a yaml/helm available, I don't mind an unofficial one until the proper version is provided in the repo.

Hi @cccs-is , see here https://github.com/allegroai/clearml-helm-charts/tree/main/charts/clearml-serving

Perfect! Thanks @jkhenning! much appreciated.


Also sorry about the broken Korean, I had no idea how to translate "unwhistle" as it's not a real english word either. :sweat_smile:
Gonna release a new version soon!


[dunfell][gatesgarth][master] Update for ceres-solver-2.0.0 from latest meta-oe

Pushed to all active branches:
To github.com:ros/meta-ros.git
e845c113c..22a715ca5  dunfell -> dunfell
97e42c808..22a715ca5  dunfell -> dunfell-next
fb6cf9ff3..609472cd9  gatesgarth -> gatesgarth
fb6cf9ff3..609472cd9  gatesgarth -> gatesgarth-next
75de3cf41..3090740f0  master -> master
75de3cf41..3090740f0  master -> master-next


refactor: centralize version and version-range

goal: improve documentation by consolidating elements regarding "version".
pure refactoring, no new functionality was added, nor removed, nor changed.

[x] consolidate version
[x] consolidate range
[x] rename range definition to version-range
[x] add more examples
[x] review rendered documentation

@stevespringett thank you for the review. you are right, and I adjusted to the naming convention.


AVRO supported?

Hi,
Can I send avro (e.g. my message's value is using avro format) with this library? I checked the issues and the README and didn't any mention of avro. Begging your pardon if I just missed it.
Thanks,
Jobet

Yes, you can set your messages as a buffer see #646

Hi,
I tried the below code after getting the inspiration from the link you've provided above:

const kafka = require('kafka-node')
var avro = require('avsc')
const Producer = kafka.Producer
const KeyedMessage = kafka.KeyedMessage
const client = new kafka.KafkaClient({ kafkaHost: 'localhost:9092' })

var schema = avro.parse({"type":"record","name":"myrecord","fields":[{"name":"f1","type":"string"}]})
var obj = {"f1":"value1"}
var data = schema.toBuffer(obj)

const topic = 'test'

const producer = new Producer(client, { requireAcks: 1 })
console.log("About to send message...")

producer.on('ready', function () {
  const keyedMessage = new KeyedMessage('id', Buffer.from(data.buffer))

  producer.send([
    { topic: topic, messages: [keyedMessage]}
  ], function (err, result) {
    console.log(err || result)
    process.exit()
  })
})

producer.on('error', function (err) {
  console.log("Network issue")
  console.log('error', err)
})

Two things:

The message shows up on the topic with the expected key (i.e. id), but the value looks like a code js snippet, which I won't paste here anymore.
I am also expecting a schema to be added to the schema registry. But I don't know how to indicate in the above code where the schema registry lives (e.g. localhost:8081).

Any help would be appreciated!

This stackoverflow question relates to the missing avro-support: https://stackoverflow.com/questions/44440969/impossible-to-read-kafka-message-value

Hi,
I tried the below code after getting the inspiration from the link you've provided above:

const kafka = require('kafka-node')
var avro = require('avsc')
const Producer = kafka.Producer
const KeyedMessage = kafka.KeyedMessage
const client = new kafka.KafkaClient({ kafkaHost: 'localhost:9092' })

var schema = avro.parse({"type":"record","name":"myrecord","fields":[{"name":"f1","type":"string"}]})
var obj = {"f1":"value1"}
var data = schema.toBuffer(obj)

const topic = 'test'

const producer = new Producer(client, { requireAcks: 1 })
console.log("About to send message...")

producer.on('ready', function () {
  const keyedMessage = new KeyedMessage('id', Buffer.from(data.buffer))

  producer.send([
    { topic: topic, messages: [keyedMessage]}
  ], function (err, result) {
    console.log(err || result)
    process.exit()
  })
})

producer.on('error', function (err) {
  console.log("Network issue")
  console.log('error', err)
})

Two things:

The message shows up on the topic with the expected key (i.e. id), but the value looks like a code js snippet, which I won't paste here anymore.
I am also expecting a schema to be added to the schema registry. But I don't know how to indicate in the above code where the schema registry lives (e.g. localhost:8081).

Any help would be appreciated!

The key piece of information I was missing here is to set the consumer up with a 'buffer' encoding. When it was attempting to consume the message as a String I was receiving all sorts of errors from illegal union to index out of bounds. My Consumer now looks something like this...
kafkaConsumer = new Consumer(kafkaClient, [{ topic: kafkaTopic }], {
        encoding: 'buffer',
});

kafkaConsumer.on('message', (message) => {
        const value = Buffer.from(message.value, 'binary');
        const invoice = KafkaInvoice.fromBuffer(value);
        // Do something with Invoice
});

@narcisso  I am using your package but I can not find option to commit the offset manually and reading message one by one. Could you please help with that.

@bindu-tak thanks for using kafka-node-avro ! , this package wraps kafka-node for all kafka related mechanisms.
When consuming messages, we are creating a new ConsumerGroup from kafka-node.
To adjust the offset on your consumer you can take a look at the consumer documentation.
let consumer = kafka.addConsumer("my.cool.topic", { fromOffset : 'latest' });

consumer.on('message', message => {
 // we got a decoded message
});


Connecting from 1.9.2 to 1.9.4 server won't work

What version of ViaVersion are you using? Type /ver viaversion
0.8.1
What version of Spigot are you using? Type /ver
git-Paper-748 (MC: 1.9.4) (Implementing API version 1.9.4-R0.1-SNAPSHOT)
What plugins are you using? Type /plugins
http://prntscr.com/b59ex6
Are you using any additional software like BungeeCord? If so, what software and version? (Please list your plugins as well)
Latest BungeeCord version.
How does this error happen? login? Using an item?
I have the following setup:
Bungeecord->Hub (running on 1.8 with ViaVersion to allow both 1.8 and 1.9 clients to connect. I can connect to this server with 1.9.4)->Survival (running on 1.9.4 with ViaVersion and the plugins listed above.)
The thing is, I can connect to the hub flawlessly, but I can't connect to the survival server.
Is there an error in the console? Use pastebin.com. Is there a kick message?
No kinds of error or whatsoever. Bungeecord just sends the usual message: "Kicked whilst connecting to Survival: Outdated Client! Please use 1.9.4." as if the server wouldn't be using ViaVersion. I am really confused about this, so I am really looking forward for help! Thanks!

Hey, there is currently a beta version that supports backwards compatibility for 1.9.4. If you want to help testing it, here is the link: http://myles.us/ViaVersion/temp/ViaVersion-0.8.2-SNAPSHOT.jar
Please let us know if you found any bugs :)


Attempting to set up logging with the provided sample code fails due to incorrect typings.

Code:
import Log from "@rbxts/log";
import Log, { Logger } from "@rbxts/log";
import Zircon from "@rbxts/zircon";

Log.SetLogger(
	Logger.configure()
		// ... Any other configurations/enrichers go here.
		.WriteTo(Zircon.Log.Console()) // This will emit any `Log` messages to the Zircon console
		.Create(), // Creates the logger from the configuration
);

Error:
Argument of type 'LogEventConsoleSink' is not assignable to parameter of type 'ILogEventSink'.
  Types of property 'Emit' are incompatible.
    Type '(message: import("/Users/me/Documents/bloxparty/node_modules/@rbxts/zircon/node_modules/@rbxts/log/out/Core/index").LogEvent) => void' is not assignable to type '(message: import("/Users/me/Documents/bloxparty/node_modules/@rbxts/log/out/Core/index").LogEvent) => void'.
      Types of parameters 'message' and 'message' are incompatible.
        Type 'import("/Users/me/Documents/bloxparty/node_modules/@rbxts/log/out/Core/index").LogEvent' is not assignable to type 'import("/Users/me/Documents/bloxparty/node_modules/@rbxts/zircon/node_modules/@rbxts/log/out/Core/index").LogEvent'.
          Index signatures are incompatible.
            Type 'unknown' is not assignable to type 'defined'.ts(2345)

.WriteTo(Zircon.Log.Console() as ILogEventSink) seems to work. hmm

What's your version of @rbxts/log?


qp-target-sequencing reference filenames out of sync?

I think the local filenames of the GG 13.8 reference, used in the qp-target-sequencing plugin, is out of sync between qiita environment manager here:
https://github.com/qiita-spots/qiita/blob/57d1b146729223da9daa286a1cc75db6f2923746/qiita_db/environment_manager.py#L100-L108
and in the plugin itself:
https://github.com/qiita-spots/qp-target-gene/blob/858436ee6d4a1fccd35faee0b156a12953b5774a/qp_target_gene/__init__.py#L148-L149
I figure the plugin is correct, see this screenshot from qiita.ucsd.edu

hm, is there maybe even a way to overwrite these filepaths, provided by the plugin, when registering into qiita? Thus, the filepaths could point to those files that have actually downloaded through qiita-env make --download-references?!

In the original (like 10 years ago) Qiita design, the idea was that everything was self contained; however, we then realized that using plugins was the way to go. The old download-references is really deprecated.
Maybe this is a good opportunity, if you have the chance, to remove those old functionalities and just rely on the newest code. BTW this issue reminded me of this other one: https://github.com/qiita-spots/qiita/issues/3197.

FWIW I think your effort might be better focus if we had a quick call to see what you are trying to achieve and maybe summarize all your open issues into one. Anyway, you have my email ...

After https://github.com/qiita-spots/qiita/pull/3403 was merged, we should be able to easily and (almost) cleanly remove the old and deprecated ontology and reference download and processing; thus, changing the name of this issue so it can be addressed.


Please add usage description

Please add some details to show how to add checkbox to an existing project.
It took me a while to wonder to add a UiView to storyboard and then Change its class type to Checkbox inside  identity inspector.

Hi @Vahhab, thanks for the feedback. I will keep this issue open until I add it as a good reminder and motivation!


Add "renderer" environment variable #33463

Added "renderer" environment variable so the user and platform can conditionally compile each renderer's code, or none at all.
#33463

This is not useful as is, as the main use case is to compile both rendering backends and this breaks it.
It's likely also too early to implement this as the gles2 backend is not working in the vulkan branch.

Closing as per above comment.


Permissions on Postgres are wrong

The permissions on the Postgres image config here are incorrect. It is:
paths:
  - path: /var/lib/postgresql/data
    type: directory
    uid: 70
    gid: 70
    permissions: 777

But that is interpreted as uint32, i.e. 777 (seven hundred and seventy seven), when what we really want is 0o777, i.e. octal 777 (or rwxrwxrwx).

what's the right solution here, to change the value or change the way type? @kaniini


Sensor is count wrong direction.

Version of the custom_component
v0.0.20

Configuration
Add your logs here.

state_class: total_increasing
integration: sunspec
sunspec_key: TotWhExp
label: Total Watt-hours Exported
unit_of_measurement: Wh
device_class: energy
icon: mdi:solar-panel
friendly_name: Ac_meter Total Watt-hours Exported

## Describe the bug

A clear and concise description of what the bug is.

Hi i use this sunspec intregration, i have problem with one sensor total watt hours exported, the value in HA is count down, In my kostal smart meter the value is count up.
When i add the sensor to energy dashboard in HA it can't rister the feed in power correct because the sensor is count down the value.
Is it possible to chenge so the value is count UP.

Add your logs here.

This sounds odd, do you think the value returned is a negative number?
What inverter model is this?

I have the same with my KOSTAL smart Meter Energy G1
which details I must share?
exported energy will be displayed as negative value which HA interpret wrong…


Add back AMQ_ENABLE_METRICS_PLUGIN env var support to container image

Describe the bug
Users used to enable metrics plugin using this env var directly on broker openshift image by modifying the statefulset while being deployed via broker operator. Now as we moved the configuration into init container, this method no longer works. In future we will add direct support for enabling metrics plugin from CR level with operator.
However existing users should be able to use the old method without breaking their existing apps.
To Reproduce
Steps to reproduce the behavior:

deploy the broker via operator
modify statefulset and set env var AMQ_ENABLE_METRICS_PLUGIN to true in container spec
broker pod restarts and the metrics plugin is not installed.

Platform (please complete the following information):

OS: [e.g. Fedora]
Version [e.g. 32]
CEKit version [e.g. 3.5.0]
Container build tool [e.g. podman]

Expected behavior
Optional, use if not obvious. A clear and concise description of what you expected to happen.
Screenshots
Optional, add screenshots to help explain your problem.
Additional context
Optional. Add any other context about the problem here.

close as fixed


Website mistakes

Here is a double "even":

that even if even multiple instances

And here, I think, it is better to use "How about …":

What about undo/downgrade/downward migrations?

Thanks for pointing these out. For reference there is a GitHub repository for the website too https://github.com/flyway/flywaydb.org


[zh] Translate guestbook-logs-metrics-with-elk.md

zh-trans guestbook-logs-metrics-with-elk.md
ref:k8smeetup/website-tasks#3362

/retitle [zh] Translate guestbook-logs-metrics-with-elk.md

@yixin21 pls rebase this onto master and see if the gate is happy then.

Please feel free to reopen when you get cycles to continue this work.
/close


Fix documentation markup

> is verbatim code, @@ allows for markup like 'Action' inside the code block.

Thanks for this!


ECP-1087

Probably not, but to make the changes easier to review / more
straightforward, the idea is to convert the original domain service
(nature=CONTRIBUTED) into a simple one (nature=DOMAIN), and then have new
mixins just delegate to it.  That's a fairly mechanical change, the only
main issue is adjusting the number of any supporting methods (default2 ->
default1 etc).
But perhaps it's worth adding a TODO on these as a note to go back and
simplify/collapse any too-trivial domain services, eg if they were already
delegating to an XxxRepository, for example.
On Fri, 27 Sep 2019 at 14:14, Johan Doornenbal<EMAIL_ADDRESS>wrote:

@johandoornenbal commented on this pull request.
Is the PropertyService really needed I wonder? Maybe just create the
mixins ...
https://github.com/estatio/estatio/blob/0f96284da2a05cfb8969b2ccbf8cd9d22f8ae5ec/estatioapp/app/src/main/java/org/estatio/module/budget/contributions/PropertyService.java
—
You are receiving this because your review was requested.
Reply to this email directly, view it on GitHub
https://github.com/estatio/estatio/pull/95?email_source=notifications&email_token=AAH33SKKHVP7DFNDD2Y35IDQLYBMPA5CNFSM4I23WVGKYY3PNVWWK3TUL52HS4DFWFIHK3DMKJSXC5LFON2FEZLWNFSXPKTDN5WW2ZLOORPWSZGOCGFOS6I#pullrequestreview-294316409,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAH33SICHQT2BYUNH3VUK4TQLYBMPANCNFSM4I23WVGA
.

Ah OK

Looks OK to me


Clean up the MiniscriptKey and ToPublicKey traits

Done while investigating the use of secret keys in descriptors, this is only loosely related but anyways ...
Please note commit: 42ca0f3 Manually implement is_uncompressed for BitcoinKey is either a bug fix or it breaks a relied upon, seemingly undocumented feature - please review carefully. The rest is pretty straight forward.

And this PR led me to ask: https://github.com/rust-bitcoin/rust-miniscript/issues/619

Yeah, this does look like a bug, though in normal use of the interpreter the Bitcoin consensus rules will protect us. Good catch!
I also believe that in the interpreter context compressedness doesn't matter (because we are letting the consensus rules have full reign, and trying not to impose any further restrictions). But I don't remember exactly where we landed with the interpreter context.

By "interpreter context" do you mean NoChecks?

I'm still really struggling to understand these hash types. Conceptually a script hashlock is satisfied by providing the hash pre-image, right? It doesn't have anything to do with a key? Why are they in the MiniscriptKey trait, and why are the conversions done in the ToPublicKey trait?

Perhaps you can link me (again) to some consumer code of rust-miniscript that flexes these traits because as we use them in rust-miniscript I'm coming up short.

This is all non-urgent, answer at your leisure please.

I'm still really struggling to understand these hash types. Conceptually a script hashlock is satisfied by providing the hash pre-image, right? It doesn't have anything to do with a key?

Correct, nothing to do with a key.

Why are they in the MiniscriptKey trait, and why are the conversions done in the ToPublicKey trait?

Because otherwise we'd need 5 generics instead of 1, which is especially annoying because most users don't use generic hash preimages.

Perhaps you can link me (again) to some consumer code of rust-miniscript that flexes these traits because as we use them in rust-miniscript I'm coming up short.

I'm not aware of anybody using hash preimages at all. But Miniscript supports them, and this library therefore needs to support them, and it would be a frustrating and surprising limitation if you could genericize public keys without genericizing hashes.
But for an example of how generic keys are useful, see this file in ICBOC which has a generic "cached public key" type which holds a descriptor, but when needed, queries the hardware wallet (a ~100ms operation) to obtain an actual key.

Ok, cool. Thanks for the explanation man.


[Refactor] refactor hdfs backend selector

What type of PR is this：

[ ] bugfix
[ ] feature
[ ] enhancement
[x] refactor
[ ] others

Which issues of this PR fixes ：

Fixes #
Problem Summary(Required) ：

This is PR is try to refactor hdfs backend selector:
0. Remove ScanRangeAssignType because it's not used any more.

Move HDFSBackendSelector into a separated class
decouple it from Coordinator

Checklist:

[ ] I have added test cases for my bug fix or my new feature
[ ] I have added user document for my new feature or new function

[FE PR Coverage Check]
:disappointed: fail : 13 / 108 (12.04%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/qe/HDFSBackendSelector.java
0
82
00.00%
[40, 42, 47, 49, 55, 56, 57, 58, 59, 60, 61, 62, 63, 66, 71, 72, 73, 74, 77, 78, 79, 80, 81, 85, 86, 87, 88, 89, 90, 91, 92, 95, 96, 97, 98, 99, 100, 101, 102, 103, 105, 106, 107, 108, 110, 111, 112, 114, 115, 116, 117, 118, 119, 121, 122, 125, 126, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138, 139, 141, 142, 143, 145, 149, 152, 155, 156, 158, 159, 161, 162, 163, 164]

:large_blue_circle:
com/starrocks/qe/Coordinator.java
3
16
18.75%
[2097, 2098, 2100, 2105, 2106, 2107, 2108, 2109, 2127, 2128, 2131, 3132, 3153]

:large_blue_circle:
com/starrocks/qe/BackendSelector.java
10
10
100.00%
[]

run starrocks_admit_test


feat(serve): implement open default browser option for ng serve

Sometimes it's really handy to have auto browser opening when serving app.
This PR implements that by --open option for ng serve command.
Closes #1081

This is nice, thanks! I added the request for an alias, I think it would help. People could then do ng serve -o.

Thank you!


Using with Webpack

您好，看了之前的Issues,#2，但是还是不是很清楚如何引用，你说的用skeleton-loader这个的作用是什么？不是很明白，我是直接npm安装，然后直接import,这样在vue created中使用是不可以的。还望指点，谢谢！

Hi @confidence68, thank you for the comment.
Sorry, I can't read Chinese.
Do you mean that you want to know about the skeleton-loader?

Thanks for the  reply, @anseki.
I'm very sorry, I thought you were Chinese.
After see the Issues #2 ,But i still not clear how to use the project in  Vue or React。In fact, I have a similar problem with #6。
In my project i also use vue-loader .I want to know ,If I want to use leader-line,I must install skeleton-loader?
My current practice is that I install leader-line by NPM ,and then import it in my project .but this is not possible.
Thinks!

I see.
The import statement in ECMAScript needs just a export statement. The LeaderLine now is provided as ES5, not ES2015.
Therefore, you can import that into your script easily by using the skeleton-loader that inserts the export statement.
For example, simplest case:
(Of course you already installed the skeleton-loader and leader-line.)
src/index.js
import LeaderLine from 'leader-line';

var line1 = new LeaderLine(
  document.getElementById('start'),
  document.getElementById('end')
);

webpack.config.js (for Webpack v3)
module.exports = {
  entry: './src/index.js',
  output: {
    path: __dirname,
    filename: 'bundle.js'
  },
  module: {
    rules: [
      {
        test: require('path').resolve(__dirname, 'node_modules/leader-line/'),
        use: [{
          loader: 'skeleton-loader',
          options: {procedure: content => `${content}export default LeaderLine`}
        }]
      }
    ]
  }
};

Run webpack.
And open this HTML file by web browser.
<!DOCTYPE html>

  <meta charset="utf-8">

start

end

Or, more easy way without using the skeleton-loader:
window.LeaderLine

Also, you can access to LeaderLine after a statement:
const LeaderLine = window.LeaderLine;

Thank you very much. It has solved my problem！

:smile:

try this solution #6

I really do not understand the thumbs down here.
The skeleton loader fix is concise and, most importantly, works.

Hi @Zvax, thank you for the comment.
Yes, as you said, the skeleton-loader is good solution for legacy libraries. But user who doesn't understand Webpack and can't write config will be dissatisfied. Therefore, I think that the thumbs down doesn't really mean much. That is, the issue is solved very easily by user who knows Webpack, and the user never click the thumbs down button.
I hope that they who clicked the button learn Webpack and that solution. :smile:


Level 3 Stackoverflow

Any idea how to fix this?

My tick method currently looks like

helloo it should be return func.apply(this).tick();


no phase in kong.ctx.core.phase

In the log phase, it cannot be used kong.Response.GetStatus () and kong.Router.GetService (),

Thanks for the report.  Because of a low-level limitation, Go plugins run the Log method after the nginx request/response object has been released, so each PDK function that requires information has to be handled as a special case.  It seems we missed kong.Response.GetStatus()


Users who do not have permission for consent management, can view the purposes through REST API.

Steps to re-create

Login to Management Console as an admin user and create a user who only has login permission.

username<EMAIL_ADDRESS>password: Test123

Create 3 purposes as Marketing/ Sales and Stat.
Get the base64 value of (user1@wso2.com:Test123)
Execute the following curl command.

curl -k -v -H "Authorization: Basic base64encodedvalue" -H "Content-Type:application/json" -X GET "https://localhost:9443/api/identity/consent-mgt/v1.0/consents/purposes?limit=10&offset=0"

Expected: 401
Actual: 200
Purposes get listed.
Type/Bug
Affected/5.5.0-Alpha
Severity/Critical
Priority/High

Listing purposes is not a privileged operation. Users or application which can authenticate can view purposes. We need these information to be available without authorization for certain purposes. Ex- showing purposes on self registration page.


jquery.mmenu.offcanvas.min.js missing from Bower

Hi there
I was trying to configure menus with different positioning, without much luck, using the Bower release of mmenu.
After some debugging I noticed jquery.mmenu.offcanvas.min.js isn't included in the Bower release but is in this Git repo.
I've tried adding the missing file and code to my codebase manually but JS error messages are being returned:
Uncaught TypeError: Cannot read property '$blck' of undefined

The main option points to the ".all" .js and .css files, those files have the offcanvas add-on included.


Support output in the format of GitHub workflow commands

Is your feature request related to a problem? Please describe.
I'm interested in using griffe check in CI (in pull requests and/or before releases) to get warnings about breaking changes in a library's API. I already output annotations for test failures using pytest-github-actions-annotate-failures and other tools, such as Ruff, already support output in this format.
Describe the solution you'd like
For a result like this
$ griffe check my_package -a 1.2.0
my_package/enums.py:8: StringEnum: Public object was removed
my_package/client.py:96: Client.USER_AGENT: Public object was removed

I would like to be able to output it in the GitHub workflow command format:
$ griffe check my_package -a 1.2.0 --format=github  # suggested CLI option
::warning file=my_package/enums.py,line=8,title=StringEnum::Public object was removed
::warning file=my_package/client.py,line=96,title=Client.USER_AGENT::Public object was removed

Describe alternatives you've considered

I could try to parse the existing non-verbose output and wrangle it into the desired format
I could create a comment in the PR with the existing output format

Additional context
For example, this is how files are annotated when using pytest-github-actions-annotate-failures:

Thanks for the request, I like the idea :slightly_smiling_face:
I'll try to get to it soon.

Thanks @pawamoy. One potential caveat is that griffe check seems to annotate lines in the againts ref, while GitHub annotations always point to the current code.

I believe that's only an issue for removed objects, and I don't see another way to do that, unless we say line number is 0 for removed objects?

I believe that's only an issue for removed objects, and I don't see another way to do that,

I see, you're right.

unless we say line number is 0 for removed objects?

Yeah, that's a good solution 👍

By the way this was implemented for insiders: https://mkdocstrings.github.io/griffe/checking/#github


H1, H2, H3, ..., Subtitle, ..., P components

Hi,
First of all, thank you so much for the magic library you created!! You make beautiful web development much easier!!
Motivation 🔦
The Typography component is very painful to use because:

it is a long name (10 letters)
I nearly always have to specify the component attribute
it makes markup unreadable

For example, the following classic HTML code:

My title

My first h2 heading

This is my text.

becomes this using the Typography component:
<Typography component="h1">My title</Typography>
<Typography component="h2">My first h2 heading</Typography>
<Typography>This is my text.</Typography>

[ x ] I have searched the issues of this repository and believe that this is not a duplicate.

Summary 💡
I propose that you add H1, H2, ..., Subtitle, ..., P components.
For example H1 could be:
const H1 = (props, children) => {
    return <Typography component="h1" {...props}>{children}</Typography>
}

A proof that your library lacks these components is that I have to specify a component attribute to the Typography component.
Once again, thank you for your great work!

I'm not sure I wouldn't want to use this API. As far as I know, the heading DOM structure, for accessibility concerns, should be continuous. If you do an edit in the page, add / remove a header, you need to make sure the others are still correct. So it's likely that the components used will need to changed, hence changing the imports.
What about focusing on the variant instead of the component prop?
Notice that we have considered Text as an alternative name for the Typography component in the past. Now, the problem is that a global Text object already exists in the browser, eslint undefined rule won't report any problem if you forget the import it. I believe React will fail with a weird message (I haven't tried). At some point, I wanted to ask on Twitter about the tradeoff but never did.

@lcswillems
import Typography as T from '@material-ui/core/Typography';

?
Also, you should be using variant rather than component under normal circumstances.
We could possibly alias the variant prop to v:
<T v="h1">My title</T>

But with autocompletion, is it really an issue?

I'm not sure I wouldn't want to use this API. As far as I know, the heading DOM structure, for accessibility concerns, should be continuous. If you do an edit in the page, add / remove a header, you need to make sure the others are still correct. So it's likely that the components used will need to changed, hence changing the imports.

I have not understood what you mean... What does "the heading DOM structure should be continuous" mean? Or "If you do an edit in the page, you need to make sure the others are still correct" mean?
Using import T from '@material-ui/core/Typography'; and <T v="h1">My title</T> is nice!

But with autocompletion, is it really an issue?

It is more about code readibility.

What does "the heading DOM structure should be continuous" mean?

https://www.w3.org/WAI/tutorials/page-structure/headings/
https://developer.mozilla.org/en-US/docs/Web/HTML/Element/Heading_Elements#Accessibility_concerns

@lcswillems What do you think of #14876?

Im not sure I wouldn't want to use this API.

@lcswillems What do you think of #14876?

This is an interesting proposition! It would work for me if the props given to h1 inside the RunningText will be forwarded to Typography. E.g. if I can write
My heading
 and get a heading with the primary color.
However, this proposition requires to wrap the code in a RunningText component.

What does "the heading DOM structure should be continuous" mean?

https://www.w3.org/WAI/tutorials/page-structure/headings/
https://developer.mozilla.org/en-US/docs/Web/HTML/Element/Heading_Elements#Accessibility_concerns

Thank you for the links! I see what you mean! But I don't understand the link with what I propose? My solution will have no impact on the continuity of heading DOM structure. I am wrong?

I don't see how we can directly leverage this issue. Thanks for taking the time to provide this feedback.

I don't understand what is the problem?
Why you can't just add components like:
const H1 = (props, children) => {
    return <Typography component="h1" {...props}>{children}</Typography>
}

?

@lcswillems It would create fragmentation in the community.

Fragmentation?

People will ask themselves: "Which one should I use?"


updates outdated link to the developer guide in README

-[developer guide]: https://crossplane.io/docs/master/developer-guide.html
+[developer guide]: https://crossplane.io/docs/master/contributing/overview.html
Simple README fix, like it says on the tin!
edit: please wait to merge until https://github.com/crossplane/crossplane/pull/1371 lands in master
I have:

[x] Run make reviewable to ensure this PR is ready for review.
[x] Ensured this PR contains a neat, self documenting set of commits.
[x] Updated any relevant [documentation], [examples], or [release notes].
[ ] Updated the RBAC permissions in [clusterrole.yaml] to include any new types.

@hasheddan note that the change was previously changing the domain unintentionally, from crossplane.io to crossplane.github.io so I made another edit to keep crossplane.io.


Setting config.session_secret without setting a $session_secret on Kong breaks the plugin

Hi,
Setting config.session_secret (even to a correct base64 encoded value) breaks the plugin if the $session_secret variable has not been set on Kong.
The problem disappears if you set it first on Kong (I use it in a docker environment where you can set it with the following ENV variable KONG_NGINX_PROXY_SET: "$$session_secret <yoursecret>") but then I'm not sure why you would set it through the plugin in the first place.
Couldn't that whole feature be dropped and a recommendation to set a session_secret in your Kong configuration be added in the documentation?
As a side-note, we encountered that problem when trying to fix an issue where loading static files for Kibana behind Kong would fail, thus leading us to #78 and after some more research to #1 where we discovered that setting session_secret properly on Kong itself would solve all our issues.
Thanks.

Hello @asjongers!
This is really great comment and seems you've fixed issue with request to the redirect_uri_path but there's no session state found after redirect.
I've been using kong as part of docker setup and added that environment variable without adding session_secret to the plugin. But whenever i add both - i have error kong error 500.
Can you please give more detailed information how did you fix an issue?
Some information about my setup:
// docker-compose.yml env variable
- KONG_NGINX_PROXY_SET="$$session_secret perfect_s3cr3+"

kong version: 0.13.0
plugin version: current master installed with luarocks install kong-oidc
If you would be able to give some more information or any clue to the issue, would be great! 🙏
Thank you

Hi @z-aliakseyeu.
In our case, we stopped using config.session_secret as it would just end up overriding the one already set but if you really do need to set one, make sure you provide a properly base64 encoded secret or your service will probably end up sending a 500 response because of this if clause:
  if config.session_secret then
    local decoded_session_secret = ngx.decode_base64(config.session_secret)
    if not decoded_session_secret then
      utils.exit(500, "invalid OIDC plugin configuration, session secret could not be decoded", ngx.exit(ngx.HTTP_INTERNAL_SERVER_ERROR))
    end
    ngx.var.session_secret = decoded_session_secret
  end

If it's not already the case, try setting config.session_secret to a proper base64 encoded secret and see if it works! You could use this website to generate one.


New MPD terms

email from Molly
Requested term: abnormal trimethylamine N-oxide level
Proposed parent: MP:0009642 abnormal blood homeostasis
Proposed def: abnormal amount of this metabolite which is derived from gut bacteria; high levels are associated with heart disease hardening of arteries, diabetes, and colon cancer
Requested term: abnormal betaine level
Proposed parent: MP:0009642 abnormal blood homeostasis
Proposed def: abnormal amount of this modified amino acid consisting a glycine with three methyl groups serving as methyl donor for various metabolic pathways
Requested term: abnormal phosphocholine level
Proposed parent: MP:0009642 abnormal blood homeostasis
Proposed def: abnormal amount of this intermediate in the synthesis of phosphatidylcholine in tissues
Requested term: abnormal glycerophosphocholine level
Proposed parent: MP:0009642 abnormal blood homeostasis
Proposed def: abnormal amount of this choline derivative and one of two major forms of choline storage (the other is phosphocholine) in the cytosol

Looking at our annotations:
trimethylamine N-oxide level (TMAO)
NOTE: Existing MP annotation from J:174999 (decreased trimethylamine-N-oxide (TMAO) urinary excretion)
Usefull reference: PMID: 30275434
SOURCE: CHEBI:15724, Wikipedia:Trimethylamine_oxide
betaine
Existing MP annotations from J:177569 (reported in tissues, esp liver, under abnormal amino acid level), J:286033 (reported in brain and plasma)
SOURCE: CHEBI:17750, Wikipedia:Trimethylglycine
phosphocholine
Existing MP annotations from J:267987 (reported in various tissues under decreased choline level, J:267002 (reported in skin, under abnormal lipid level and abnormal skin morphology), J:111561 (reported in alveolar macrophages)
SOURCE: CHEBI:18132
glycerophosphocholine
Existing MP annotation from J:267002 (reported in skin, under abnormal lipid level and abnormal skin morphology)
SOURCE: CHEBI:36313

Thanks Anna. I'll add these today.

abnormal trimethylamine N-oxide level child of abnormal homeostasis, also added increased and decreased children MP:0021122-MP:0021124

emailed Molly to determine if we should add amino acid betaine or the more specific term glycine betaine

added the general amino-acid betaine term
all requested terms plus increased and decreased children added


Merges internal namespaces

Perhaps this is according the the spec (I admit to not fully reading it and just going by how I think it should work ;), but to me this is unexpected:
		{
			"Vendor": "golang.org/x/text/unicode/norm",
			"Local": "github.com/syncthing/syncthing/internal/golang.org/x/text/unicode/norm",
			"Version": "2076e9cab4147459c82bc81169e46c139d358547",
			"VersionTime": "2015-03-17T19:07:45+09:00"
		},
		{
			"Vendor": "golang.org/x/text/internal/triegen",
			"Local": "github.com/syncthing/syncthing/internal/triegen",
			"Version": "2076e9cab4147459c82bc81169e46c139d358547",
			"VersionTime": "2015-03-17T19:07:45+09:00"
		},
		{
			"Vendor": "golang.org/x/text/internal/ucd",
			"Local": "github.com/syncthing/syncthing/internal/ucd",
			"Version": "2076e9cab4147459c82bc81169e46c139d358547",
			"VersionTime": "2015-03-17T19:07:45+09:00"
		}

That is, golang.org/x/text/unicode/norm is located where I expect it, but golang.org/x/text/internal/triegen and .../ucd gets dropped directly in github.com/syncthing/syncthing/internal?

That's an issue. It needs to be more exact when determining the final path.
I'll look into. Thanks.
On Thu, Apr 16, 2015, 23:00 Jakob Borg<EMAIL_ADDRESS>wrote:

Perhaps this is according the the spec (I admin to not fully reading it
and just going who I think it should work ;), but to me this is unexpected:
    {
        "Vendor": "golang.org/x/text/unicode/norm",
        "Local": "github.com/syncthing/syncthing/internal/golang.org/x/text/unicode/norm",
        "Version": "2076e9cab4147459c82bc81169e46c139d358547",
        "VersionTime": "2015-03-17T19:07:45+09:00"
    },
    {
        "Vendor": "golang.org/x/text/internal/triegen",
        "Local": "github.com/syncthing/syncthing/internal/triegen",
        "Version": "2076e9cab4147459c82bc81169e46c139d358547",
        "VersionTime": "2015-03-17T19:07:45+09:00"
    },
    {
        "Vendor": "golang.org/x/text/internal/ucd",
        "Local": "github.com/syncthing/syncthing/internal/ucd",
        "Version": "2076e9cab4147459c82bc81169e46c139d358547",
        "VersionTime": "2015-03-17T19:07:45+09:00"
    }

That is, golang.org/x/text/unicode/norm is located where I expect it, but
golang.org/x/text/internal/triegen gets dropped directly in
github.com/syncthing/syncthing/internal?
—
Reply to this email directly or view it on GitHub
https://github.com/kardianos/vendor/issues/2.

@calmh Thanks. I've looked into this some more and I can confirm that this is an issue caused from not looking for and inspecting the vendor file of the package being imported. Because of that it incorrectly assumes it should pop the vendor internal package to a top level package.

@calmh This should be fixed on: https://github.com/kardianos/vendor/commit/2b0b5efac01334b3972646bee5f433f0cea725f1
. Thanks.

:+1:


fs: littlefs: Fix cache and lookahead size checks in littlefs_fs for block devices

This fixes an issue where wrong values were checked against block device defaults. Kconfig values are used when no filesystem config values are provided, and the buffers are sized according to the Kconfig values, but the checks were only performed against filesystem config variables.

I'm interested in why cache and lookahead buffer values are reduced, especially when static buffers have been already assigned.

I'm interested in why cache and lookahead buffer values are being reduced, especially when buffers have been already assigned.

To align with block size of a device: https://github.com/zephyrproject-rtos/zephyr/commit/09574e68eb3a6f30c8e2e0f787a9fc52953474d3

This fixes an issue where wrong values were checked against block device defaults. Kconfig values are used when no filesystem config values are provided, and the buffers are sized according to the Kconfig values, but the checks were only performed against filesystem config variables.

The default are only used when not instance specific not provided.

I'm interested in why cache and lookahead buffer values are being reduced, especially when buffers have been already assigned.

To align with block size of a device: 09574e6

In that case wouldn't it make more sense to round down to the closest smaller multiple of block size? With a cache size set to 2047, it will still be reduced to 512 despite 1536 being a multiple of 512.

This fixes an issue where wrong values were checked against block device defaults. Kconfig values are used when no filesystem config values are provided, and the buffers are sized according to the Kconfig values, but the checks were only performed against filesystem config variables.

The default are only used when not instance specific not provided.

Exactly, however in this case we are only checking against instance specific, which is 0 when nothing is provided.

The default are only used when not instance specific not provided.

Exactly, however in this case we are only checking against instance specific, which is 0 when nothing is provided.

Ah, right. There is a bug because the cache_size serves as test variable that is set between lines 780-784 to either instance specific or default, so the comparison in these lines was not actually testing the right variable in the end.

I'm also going to submit a new PR to change the block alignment behavior for these values, but it might be better to merge this as a quick fix since it breaks using block devices without instance specific configs or devicetree defined.


SECURITY: don't allow any service url if custom services backend is used

I discovered a bug where when you use a custom services backend and hence not have a MAMA_CAS_SERVICES setting the logic falls back to depreciated MAMA_CAS_VALID_SERVICES setting which in that case most likely is also not present, which in turn causes django-mama-cas to treat ANY service url as valid.
This PR fixes the issue.

now also fixes some other minor issues in the codebase that CI pointed me to.

Hi @evilscientress,
I don't see any security problem, it is just maintaining backwards compatibility. Default operating mode is "open", please see: https://django-mama-cas.readthedocs.io/en/latest/security.html?highlight=MAMA_CAS_VALID_SERVICES#open-vs-closed
I agree with your first commit modifying how service_allowed works. When you implement your own backend should be because you want to restrict services as MAMA_CAS_SERVICES is doing.
I'd say that you need to create a test to verify the new code you added. It would also show that the test fails without your code modifications.
I haven't checked the other commits. I'll do if @jbittel is ok with merging this change.

OK, I'll add a today or tomorrow.

Finally had time to write the test for the bug I fixed.

Going to reopen the PR with a separate branch. See #84


Update extension.ts

when I used the extension, I had to notice that the system to generate the constructor it uses the keyword __constructor instead of __construct

@escannord, Thanks :)
Well spotted. Merged and shipped right away:
https://marketplace.visualstudio.com/items?itemName=IvanGrigorov.php-getters-and-setters
V1.0.4


Auto reconnect after quad lipo disconnect, Debug + Toast messages clean

Handle waiting for video if USB Goggles stay connected but airunit/vista unplugged/replugged

avoid USB reading errors when USB unplugged just before the 1sec retry (onPlayerError)
some clean on debug logs, toast messages

works great ! thanks @omouren  & @dukey32123 for your work on this :)


Feature Request - Related with Side Bar

Hi! Three suggestions:

Is it possible to add an option that enables auto-hide Side Bar when focus goes back to textedit area?
Currently for Side Bar the word used is toggle, for Activity Bar/Status Bar the word used is hide/show. Is it possible to unify them?
The current name for Side Bar is quite confusing. I always forget whether it refers to Side Bar or  Activity Bar. Will it be better to rename Side Bar to Side Panel and Activity Bar to Side Menu/Side Bar?
Thanks for your effort!

Please follow our issue reporting guidelines and file a separate issue for each request Submitting-Bugs-and-Suggestions.

The current name for Side Bar is quite confusing.

We have no plans to change this, sorry.


AtmosPipeColor stuff should just be prototypes

It's at least 5,000+ wasted yaml lines per high-pop map.

Do you want all the used colors to be prototypes? So teal, blue, red, brown, purple? And for vents, passive vents, mixers, filters, pumps, volume pumps, valves, passive gates, scrubbers, injectors, pneumatic valves, etc? Because that's gunna make the entity list absolutely balls to work with for atmos devices

Yea, no, Vera, me, and probably every mapper do not want this.
Heavily bloats the entity list, makes mapping more of a pain, etc.

Bloating the entity list & making mapping a pain seems like its more of a mapping tools issue, so if anything this should probably just be deferred until better pipe colouring support is added? Because it is still true that this just bloats map files & should probably be using prototypes if possible.

Yea, no, Vera, me, and probably every mapper do not want this.
Heavily bloats the entity list, makes mapping more of a pain, etc.

We will make the tooling better before doing it but don't close performance issues.

If this is done, please make sure you come up with another way to check if a grid has disconnected networks, because the way it currently works the command colornetwork is the only sensible way to do that.


Cannot resolve method 'findById' in 'ButterKnife'

CheckedTextView checkedTextView = ButterKnife.findById(view,view.getId());
It is giving error
Cannot resolve method 'findById' in 'ButterKnife'

It was removed in version 9. You can use view.findViewById, but calling that with view.getId() is useless as it will always return itself.


Is it possible make the fade version of jcarousel be the autostart to fade effect?

Is it possible make the fade version of jcarousel be the autostart to fade effect?

you can try jcarouselFade plugin

i'm using it, but it cannot be the autostart the fade effect. can it auto start the fade animation?

you mean fade animation when carousel initialized? or fade animation with jcarouselAutoscroll plugin?

I mean .. can it start to the fade effect when loaded the page? (no need click any button and icon)

Example
Is this what you want?

Sorry. this is not.
i just want to the fade effect is autostart when the page is loaded.

+1 for fade animation with jcarouselAutoscroll plugin

@wilsontse88 && @Craigy-
There's a 3rd party plugin mentioned on the jcarousel main page, called jcarouselFade.
If that doesn't work for you, I'm sure there's somewhere in the jcarousel source to make a change to the transition type. I haven't dived in, but I could if it's a heavily desired thing.

Sorry for long waiting. I completely forgot about this opened issue. But now I think I have good news for you @wilsontse88 @Craigy-  =)
Another example where jcarouselFade working with jcarouselAutoscroll properly. Maybe problem was with old version of jcarouselAutoscroll which didn't support method option? It was added in this pull request


Allow IndexWriter#updateDocuments() by Query

Description
Currently IndexWriter#updateDocuments() method accepts only Term for entries to be deleted. As of 9.5.0 version there is no way to update documents by StoredField, LongPoint etc. These fields can be updated only through the consistent call of IndexWriter#deleteDocuments(Query) and IndexWriter#addDocuments(Iterable) but by using them this way we lost the atomicity control under these operations. Can we consider overload updateDocuments() method with Query?

Already fixed in https://github.com/apache/lucene/pull/12341


i get the error when running the gradio_app.py

output = torch.nn.functional.linear(A, F.dequantize_4bit(B, quant_state).to(A.dtype).t(), bias)
RuntimeError: mat1 and mat2 shapes cannot be multiplied (332x4096 and 1x8388608)

same here, did u solve it?

bitsandbytes>0.43.1 will be ok,other version like 0.42 get worse

same here, did u solve it?


[SPARK-7542] [SQL] Support off-heap index/sort buffer

This brings the support of off-heap memory for array inside BytesToBytesMap and InMemorySorter, then we could allocate all the memory from off-heap for execution.
Closes #8068

Merged build triggered.

Merged build started.

Merged build triggered.

Merged build started.

Test build #45070 has started for PR 9477 at commit 862b38f.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45067/
Test FAILed.

Merged build triggered.

Merged build started.

Test build #45072 has started for PR 9477 at commit 77555e1.

Merged build triggered.

Merged build started.

Test build #45076 has started for PR 9477 at commit 3cb22d4.

Test build #45072 has finished for PR 9477 at commit 77555e1.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45072/
Test FAILed.

Test build #45076 has finished for PR 9477 at commit 3cb22d4.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):\n  * final class ShuffleSortDataFormat extends SortDataFormat<PackedRecordPointer, LongArray> \n  * final class UnsafeSortDataFormat extends SortDataFormat<RecordPointerAndKeyPrefix, LongArray> \n

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45076/
Test FAILed.

Test build #45070 has finished for PR 9477 at commit 862b38f.

This patch fails from timeout after a configured wait of `250m`.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45070/
Test FAILed.

@JoshRosen This is ready for review

Test build #1983 has started for PR 9477 at commit 3cb22d4.

Merged build triggered.

Merged build started.

Test build #45096 has started for PR 9477 at commit 89319e0.

LGTM overall, but I'd like to address one concern before merging: I'm worried that passing both the MemoryConsumer and TaskMemoryManager to the sorter components will open the potential for bugs; I feel that those classes should allocate their memory using only the public MemoryConsumer methods.
Note that the MemoryConsumer methods actually end up calling the TaskMemoryManager methods which your code calls directly: https://github.com/apache/spark/blob/81498dd5c86ca51d2fb351c8ef52cbb28e6844f4/core/src/main/java/org/apache/spark/memory/MemoryConsumer.java#L81
I think that we should mark those TaskMemoryManager methods as methods that are only supposed to be called by the memory consumer and not directly by developers. The problem with calling them directly is that the bookkeeping in the MemoryConsumer itself won't have been updated. This current API has such a high potential for this type of misuse that I think we should look at fancy Java-isms to restrict the visibility / callability of those methods such that they can only be called from MemoryConsumer.
If you fix this by having those classes only allocate through their MemoryConsumers then feel free to merge as soon as this passes tests. I can take care of a followup to fix the documentation / code to avoid this type of misuse.

Test build #1983 has finished for PR 9477 at commit 3cb22d4.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build triggered.

Merged build started.

Test build #45108 has started for PR 9477 at commit b42e7db.

@JoshRosen I should had addressed your comments, will merge this once pass the tests.

Merged build triggered.

Merged build started.

Test build #45110 has started for PR 9477 at commit 854a99f.

Test build #45096 has finished for PR 9477 at commit 89319e0.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):\n  * final class ShuffleSortDataFormat extends SortDataFormat<PackedRecordPointer, LongArray> \n  * final class UnsafeSortDataFormat extends SortDataFormat<RecordPointerAndKeyPrefix, LongArray> \n

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45096/
Test PASSed.

Merged build finished. Test PASSed.

Test build #45108 has finished for PR 9477 at commit b42e7db.

This patch fails from timeout after a configured wait of `250m`.
This patch merges cleanly.
This patch adds the following public classes (experimental):\n  * final class ShuffleSortDataFormat extends SortDataFormat<PackedRecordPointer, LongArray> \n  * final class UnsafeSortDataFormat extends SortDataFormat<RecordPointerAndKeyPrefix, LongArray> \n

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45108/
Test FAILed.

Test build #45110 has finished for PR 9477 at commit 854a99f.

This patch fails from timeout after a configured wait of `250m`.
This patch merges cleanly.
This patch adds the following public classes (experimental):\n  * final class ShuffleSortDataFormat extends SortDataFormat<PackedRecordPointer, LongArray> \n  * final class UnsafeSortDataFormat extends SortDataFormat<RecordPointerAndKeyPrefix, LongArray> \n

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45110/
Test FAILed.

Jenkins, retest this please.

Merged build triggered.

Merged build started.

Test build #45125 has started for PR 9477 at commit 854a99f.

Merged build triggered.

Merged build started.

Test build #45127 has started for PR 9477 at commit c35f512.

Merged build triggered.

Merged build started.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45133/
Test FAILed.

Merged build finished. Test FAILed.

Test build #1989 has started for PR 9477 at commit b367daf.

Test build #45125 has finished for PR 9477 at commit 854a99f.

This patch fails from timeout after a configured wait of `250m`.
This patch merges cleanly.
This patch adds the following public classes (experimental):\n  * final class ShuffleSortDataFormat extends SortDataFormat<PackedRecordPointer, LongArray> \n  * final class UnsafeSortDataFormat extends SortDataFormat<RecordPointerAndKeyPrefix, LongArray> \n

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45125/
Test FAILed.

Test build #45127 has finished for PR 9477 at commit c35f512.

This patch fails from timeout after a configured wait of `250m`.
This patch merges cleanly.
This patch adds the following public classes (experimental):\n  * final class ShuffleSortDataFormat extends SortDataFormat<PackedRecordPointer, LongArray> \n  * final class UnsafeSortDataFormat extends SortDataFormat<RecordPointerAndKeyPrefix, LongArray> \n

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45127/
Test FAILed.

Merged build finished. Test FAILed.

Test build #1989 has finished for PR 9477 at commit b367daf.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):\n  * final class ShuffleSortDataFormat extends SortDataFormat<PackedRecordPointer, LongArray> \n  * final class UnsafeSortDataFormat extends SortDataFormat<RecordPointerAndKeyPrefix, LongArray> \n

The failed test is not related, will re-run it.

Test build #1993 has started for PR 9477 at commit b367daf.

Test build #1994 has started for PR 9477 at commit b367daf.

Test build #1993 has finished for PR 9477 at commit b367daf.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):\n  * final class ShuffleSortDataFormat extends SortDataFormat<PackedRecordPointer, LongArray> \n  * final class UnsafeSortDataFormat extends SortDataFormat<RecordPointerAndKeyPrefix, LongArray> \n

LGTM, so I'm going to merge this into master and 1.6. Thanks!

Test build #1994 has finished for PR 9477 at commit b367daf.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):\n  * final class ShuffleSortDataFormat extends SortDataFormat<PackedRecordPointer, LongArray> \n  * final class UnsafeSortDataFormat extends SortDataFormat<RecordPointerAndKeyPrefix, LongArray> \n


Disable filtration of option when searchable.

We have implemented custom search in backend Api.
Results are coming as intended in form of array in options.
But not showing UI, Most probably because filter is working.
Text input -> A B C
Options -> ['CBA']
Not showing in UI list.
Option should be visible in UI list.

Solved with internal search prop.


Dead link

"comparison table" link in first sentence is a dead link. https://docs.microsoft.com/azure/load-balancer/concepts-limitations#skus

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: ab6eefa3-52f8-4172-46d3-c5a6c1f95370
Version Independent ID: 8a5653c5-158d-8154-451b-2840cf77b4d0
Content: Upgrade from Basic Public to Standard Public - Azure Load Balancer
Content Source: articles/load-balancer/upgrade-basic-standard.md
Service: load-balancer
GitHub Login: @irenehua
Microsoft Alias: irenehua

@stevemachacz Thanks for pointing this out.
I have assigned the issue to content author to check and update the document.

@irenehua
Can you please check and update the document.

@VikasPullagura-MSFT The link is working. Could you double check and confirm?

Link now works. Thank you.


flatmate_brand now links to consumption

I did something similar, but I linked to homepage (which redirects to consumption), so we don't need to merge this request.


chore: add num-integer-backend feature to mithril dependency to fix build issue

@Mercurial this change has a penalty on performance.
Could we go back and try to understand the root cause of the issue? because I can't reproduce the build error you're describing.


Improved documentation

Codecov Report

Merging #6 (2407354) into main (ddd87f2) will not change coverage.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##             main       #6   +/-   ##
=======================================
  Coverage   87.98%   87.98%
=======================================
  Files          11       11
  Lines         932      932
=======================================
  Hits          820      820
  Misses        112      112

Impacted Files
Coverage Δ

src/error.rs
0.00% <ø> (ø)

src/read/decode/float.rs
60.00% <ø> (ø)

src/read/decode/mod.rs
100.00% <ø> (ø)

src/read/decode/rle_v2.rs
85.61% <ø> (ø)

src/read/decompress/mod.rs
98.07% <ø> (ø)

src/read/mod.rs
98.18% <ø> (ø)

src/read/stripe.rs
91.66% <ø> (ø)

src/lib.rs
100.00% <100.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us.


validateValue seems not be a valid method for ValidatorServiceProvider

Hi, I'm following the documentation but I'm getting an error with the validateValue method, seems not exist, this issue seems to be related but it's not clear why it was closed when the error persist, I'm using the latest silex version and following this code

What you try to validate, a single value, an array or an object.... had the same problem today... Since i tried to validate an array i had to use the method "validate" instead of validateValue

validateValue does not exist anymore if you use the Symfony 3 component, as it was deprecated since Symfony 2.5.


126 scoping flake8 linting

Description
flake8 was failing linting for some of the files in the tests directory and utils. we will be skipping lint checks on those files as they are not part of the core algorithm codes
Motivation and Context
exclude linting on non-critical files for pre-merge checks
Type of Change

How to Test
Run run-pip-audit.sh in every plugin dir. Will be 1 plugin as an example

cd stock-plugins/aiverify.stock.accumulated-local-effect/algorithms/accumulated_local_effect
bash ci/run-pip-audit.sh

Checklist
Please check all the boxes that apply to this pull request using "x":

[x]  I have tested the changes locally and verified that they work as expected.
[ ]  I have added or updated the necessary documentation (README, API docs, etc.).
[x]  I have added appropriate unit tests or functional tests for the changes made.
[x]  I have followed the project's coding conventions and style guidelines.
[ ]  I have rebased my branch onto the latest commit of the main branch.
[x]  I have squashed or reorganized my commits into logical units.
[ ]  I have added any necessary dependencies or packages to the project's build configuration.
[x]  I have performed a self-review of my own code.

Screenshots (if applicable)
Additional Notes

The requested reviews are Approved. Proceeded to merge PR to Main


(asan) heap-buffer-overflow in screen_del_lines()

I have a script that builds vim and runs tests with various configure options.
While running it, asan found a heap-buffer-overflow bug.
Aborted (core dumped)
Makefile:168: recipe for target 'test_gui.res' failed
make[2]: *** [test_gui.res] Error 134
make[2]: Leaving directory '/home/dope/sb/vim/src/testdir'
Makefile:2143: recipe for target 'scripttests' failed
make[1]: *** [scripttests] Error 2
make[1]: Leaving directory '/home/dope/sb/vim/src'
Makefile:36: recipe for target 'test' failed
make: *** [test] Error 2

Maybe a race condition if gui_resize_shell() is
called asynchronously?
I'll check later whether it's reproducible all the time.
Environment

Vim 8.1.1639 (huge, gtk3, --disable-rightleft)
xubuntu-18.04.2, x86_64

Dominique wrote:

I have a script that builds vim and runs tests with various configure
options.  While running it, asan found a heap-buffer-overflow bug.
Vim-8.1.1639 was configured with:
$ CC=clang-8 ./configure --with-features=huge --enable-gui=gtk3 --disable-rightleft

Bug found with asan while running tests:
VIMRUNTIME=../../runtime; export VIMRUNTIME;  ../vim -f  -u unix.vim -u NONE -U NONE --noplugin --not-a-term -S runtest.vim test_gui.vim
="test_gui.vim" 821 lines, 23235 characters

Executing Test_1_set_secure()>=================================================================
==5173==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x611000254288 at pc 0x000000ac668a bp 0x7fff47358c50 sp 0x7fff47358c48
READ of size 4 at 0x611000254288 thread T0
    #0 0xac6689 in screen_del_lines /home/dope/sb/vim/src/screen.c:10358:32
    #1 0xad2fd2 in win_do_lines /home/dope/sb/vim/src/screen.c:9917:15
    #2 0xad3654 in win_del_lines /home/dope/sb/vim/src/screen.c:9818:14
    #3 0xaafc37 in win_update /home/dope/sb/vim/src/screen.c:1504:11
    #4 0xab7eb9 in win_update /home/dope/sb/vim/src/screen.c:2347:3
    #5 0xaa44ce in update_screen /home/dope/sb/vim/src/screen.c:785:6
    #6 0x6e3f99 in ex_redraw /home/dope/sb/vim/src/ex_docmd.c:8358:5

At the start of update_screen() thre is a call to screen_valid(), thus
LineOffset[] should have the right size.  So either somehow screen_Rows
and Rows differ, or the array index is actually wrong here.
Oh, there is another call to screen_valid() at the top of
screen_del_lines(), thus that must be OK.  If it did resize there,
perhaps the arguments to screen_del_lines() are now wrong though.

0x611000254288 is located 0 bytes to the right of 200-byte region [0x6110002541c0,0x611000254288)
allocated by thread T0 here:
#0 0x4d3d23 in __interceptor_malloc (/home/dope/sb/vim/src/vim+0x4d3d23)
#1 0x88b24b in lalloc /home/dope/sb/vim/src/misc2.c:924:11
#2 0xacd01d in screenalloc /home/dope/sb/vim/src/screen.c:9034:22

That's allocating LineOffset[].

Maybe a race condition if gui_resize_shell() is
called asynchronously?
I'll check later whether it's reproducible all the time.

It's hard to do anything with more information.  If you can reproduce,
adding some ch_log() calls might reveal the problem.
Hmm, If you can reproduce it, see if this helps:
--- ../../git/vim81/src/term.c	2019-06-06 15:19:28.251404512 +0200
+++ term.c	2019-07-06 13:55:50.301056261 +0200
@@ -3423,9 +3423,9 @@
if (width < 0 || height < 0)    /* just checking... */
return;

if (State == HITRETURN || State == SETWSIZE)

if (State == HITRETURN || State == SETWSIZE || updating_screen)
{

/* postpone the resizing */

// postpone the resizing
State = SETWSIZE;
return;
}

--
Shit makes the flowers grow and that's beautiful
/// Bram Moolenaar --<EMAIL_ADDRESS>-- http://www.Moolenaar.net   \
///        sponsor Vim, vote for features -- http://www.Vim.org/sponsor/ \
\\  an exciting new programming language -- http://www.Zimbu.org        ///
\\            help me help AIDS victims -- http://ICCF-Holland.org    ///

I suppose this is fixed by 847a5d69a826c02a7cb8a14884f3fef69d74fed7, so closing.


Can't get quart-rate-limiter working (maybe because I'm using quart_openapi?)

from quart import Quart, render_template, request, jsonify, send_from_directory, make_response
from quart_openapi import Pint, Resource

import asyncio
import asyncpg
import aioredis
from datetime import timedelta
import json
import socket
import os
import random
import requests
import re

from quart_rate_limiter import RateLimiter, RateLimit, rate_limit

# ! create the app
# app = Quart(__name__)

app = Pint(__name__, title='The Chemical Workshop API')

rate_limiter = RateLimiter(
    default_limits=[RateLimit(1, timedelta(seconds=5))]
)

@app.before_serving
async def startup():
    # ! init redis
    app.redis = redis = aioredis.from_url(
        "redis://localhost", encoding="utf-8", decode_responses=True
    )

@app.after_serving
async def shutdown():
    print("shutting down !")
    await app.redis.close()

@app.route('/')
async def index():
    return str(request.headers)

@app.route('/abc')
@rate_limit(1, timedelta(seconds=10))
async def hello_abc():
    return str("test")

if __name__ == "__main__":
    app.run(host='<IP_ADDRESS>', port=6060)

I'm expecting '/' to allow 1 request every 5 seconds
and '/abc' to allow 1 every 10 seconds
and i can spam the route with 100+ requests per second and i never get limited
is this because of quart_openapi ? if so, is there an alternative that works with quart_rate_limiter ?

nevermind !
rate_limiter = RateLimiter(app,
    default_limits=[RateLimit(1, timedelta(seconds=5))]
)

fixed it, not works as intended, i hope
thanks for nothing !


Archive stale directories & purge large files from history

Features
Less memory usage
The repo currently weighs around 186MiB, which is surprisingly large for a repo like ours, source-code-wise. Forking the repo, only copying the develop branch, yields a memory usage of 135MiB. After a bit of toying around and identifying large files living in git, it turns out the repo contains a lot of (potentially very old) big files: either GIFs, images, model .bin files or even node_modules/ directories.
If still relevant to Disco (e.g. example_training_data/), these big files should be stored on the Cloud and downloaded on demand. Otherwise, they can simply be removed; I tried and remove them from the entire git history. I even went further and removed a few very old package-lock.json files dating from the mobile-browser-based-version/ era, which is arguably source code, but is of pretty much no use to the Disco project, and represented significant memory usage.
This resulted in the repo weighing 6.5MiB, a 20-fold decrease.
Less directories
Although this also affects memory usage, this is mostly to ease the repo's readability and navigation. Basically, lots of stale files are still preserved for the sake of history: simulator/, experiments/, web-client/ui_tests/, etc. The problem is, those files can be quite large at times, increase the number the complexity of the repo's file structure, and kill the "programming language stats" of GitHub (GitHub says our repo is 75% Jupyter Notebooks). Removing them from the repo would solve these issues.
How to reproduce
The experiments were run on a fork with the help of the followings scripts:

to identify large files: https://stackoverflow.com/questions/10622179/how-to-find-identify-large-commits-in-git-history
to remove them from the git history: https://stackoverflow.com/questions/43762338/how-to-remove-file-from-git-history

Specifications

archive simulator/, experiments/ and web-client/ui_tests/ to the Cloud
example_training_data/ should be downloaded from the Cloud on demand
GIFs and .bin files should never be committed, former commits including such files should be rewritten

@martinjaggi @morganridel


Recommendations are almost completely useless

For most of the errors (e.g. 2312), the recommendation is just an even less useful rewording of the original uninformative error message.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: b57894dd-9bb6-0900-63c5-71c6b902abdf
Version Independent ID: 048a747c-7ac0-e9a1-2c36-8cdf82cfd143
Content: Troubleshoot Azure Data Factory - Azure Data Factory
Content Source: articles/data-factory/data-factory-troubleshoot-guide.md
Service: data-factory
GitHub Login: @nabhishek
Microsoft Alias: abnarain

Thanks for your dedication to our documentation. Unfortunately, at this time we have been unable to review your issue in a timely manner and we sincerely apologize for the delayed response. Though the scope of our feedback channel here on GitHub covers specific documentation fixes, we can help redirect you to the right support channel to get an answer to your question.  You can engage support directly at the Microsoft Support web site or through your Azure Data Factory portal page in Azure, at the bottom of the blade panel on the left, under Support & Troubleshooting.  Because this issue does not relate to documentation, we are closing this issue. #please-close


rasterize by a specified function and column

Hi there,
I was wondering if the Raster.jl package is able to rasterize by a specified function and using a specific column.
Thanks

This is a great idea
Maybe instead using fill for the column name as we currently do we can have a source keyword that takes e.g. source=:area and could also accept a function of the whole row, like source=row -> 1/GeoDataFrames.area(row.geometry)
Then for the function we should be more specific than R raster and call it reduce - as it has to be a reducing function that accepts a list and returns a scalar. The default would be last, which is what it does now by just writing over whatever was there before.
So something like:
rasterize(df; to=myraster, source=:mycolumnname, reduce=mean)

What do you think?
Getting this to be fast and light on memory is the problem, as we need to store the values from each layer for every cell for the reducing function.
One option for doing these reductions quickly but limit memory use is to break the raster into chunks, see which polygons overlap the chunk and calculate the vectors for each chunk. Then the memory can be much smaller and also be reused.
For sum, mean first and last we can write optimizations where we don't actually store all the values, so memory/chunking isn't such a problem. But I think running any arbitrary user-defined functions is more powerful than just using these basic functions.

Thanks,
This is very close to what I believe would be the most useful feature of the rasterizing function on the Rasters.jl package. The one feature I would also propose is that you also add the option to calculate the values of the raster cells on the touching polygons. This is because:
(1) in rasterize from the raster package you can only obtain a rasterization of polygons if the polygon crosses the center of the grid cell. The exception is if we use the getCover option, which then can only be done to one layer.
(2) fasterize only does sums and it doesn't have the function of touching polygons - it is, however, faster than rasterize but it is a one-purpose tool.
(3) the rasterize from the terra package does rasters based on polygon touches and is able to use different functions to calculate the values for the grid cells. What it doesn't do is both.
If this could be implemented in the Rasters.jl package it would be great.
Thank you,


Last commit not included in pypi

The PR #75 is merged in master but it's not present in the last version of pipy
Could you make that running
pip install django-nested-inline

will have this last change?
Thanks

0.4.3 released


test returned eval errors: 	invalid integer ''

After I upgraded fish to 2.7.0-481-g7d055a12 and started getting this error.
Agh this seems to be an issue with the metro theme, as it doesn't happen when I change to another theme.

Seems like a fish shell issue as this effect every theme I try.


Handle multiple FolderChooserDialog in same Activity

Hi,
Is there any way I can know which FolderChooserDialog called the callback onFolderSelection if there are more than one FolderChooserDialog builders in same activity ?
PS: I can do it by creating static member in my activity and changing it before creating any FolderChooserDialog but still I would like to confirm if there exists something in API which I am not aware of.

https://github.com/afollestad/material-dialogs/releases/tag/<IP_ADDRESS>

The above won't work until JitPack installs version 23.2.0 of the Google libs repo.

@afollestad Thanks for this addition!


fix: update BC example to use new BC integration

@migueloller There is a new BigCommerce integration that we are moving to that isn't 500'ing

I updated the 1pass, and updated the vercel env vars


weights loading error

When run the IEMOCAP task, the codes need to get wav2vev2-model-weight.
Probably it's because of the Net Connection at my machine.  How can I solve this by using an offline loading way(put the model in a dirpath by myself) to replace the original code(online way)?
I cannot find it.
Thanks for your help.
/home/test/anaconda3/lib/python3.8/site-packages/transformers/configuration_utils.py:348: UserWarning: Passing gradient_checkpointing to a config initialization is deprecated and will be removed in v5 Transformers. Using model.gradient_checkpointing_enable() instead, or if you are using the Trainer API, pass gradient_checkpointing=True in your TrainingArguments.
warnings.warn(
Downloading:   0%|                                                          | 510k/363M [05:00<328:10:23, 321B/s]("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer'))
OSError: Can't load weights for 'facebook/wav2vec2-base'. Make sure that:

'facebook/wav2vec2-base' is a correct model identifier listed on 'https://huggingface.co/models'

Hi, you can use git lsf to clone the HuggingFace repository locally.

thank for your advice. But my GPU is without internet connection. Now I have downloaded the files byhand. But still a new problem, like that:
#######
hparams = yaml.load(yaml_stream, Loader=yaml.Loader)
(Pdb) n
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /api/models/facebook/wav2vec2-base (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f174cd31f70>: Failed to establish a new connection: [Errno -2] Name or service not known'))

/home/test/anaconda3/lib/python3.8/site-packages/hyperpyyaml/core.py(182)load_hyperpyyaml()
########

Could you help to figure out how to revise the code ?
If I change the path in hparams/train_with_wav2vec2.yaml of "wav2vec2_hub:"facebook/wav2vec2-base". thx.

Right, this is most likely because the folder is not found. SpeechBrain tests like this: test the folder given as a model_hub, if it exists just proceed, if it doesn't, it will try to download from HF (hence triggering an error as you don't have itnernet).

In particular, it will 1. test if the folder exists; 2. test if the folder contains a .bin (which is the original HuggingFace saving format for checkpoints). If one of these test fails, it will try to download it

Hello,
Is there any news about this issue, please? Thanks.

Hello,
There is no more activity on this issue, so I am closing it.
If necessary, you can reopen this issue. Thanks :-)


More generic layers

Describe the problem related to your feature request.
Currently Layer are for entity and chunk, it's would be mildly impractical and casse pied if we start creating different layers for each api were we want layer to be use.
For all componant that impl a layer solution, we attache ourself to one of the two layers, but we need to use filter in our impl which is suboptimale.
What solution would you like?
I personally would see :
In the layer entity side ->

A LayerMarker componant that store a message queue (like the current one)
Some [...]LayerData componant

EntityLayerData store FxHashMap<ChunkPos, BTreeSet<Entity>>
BossBarLayerData store BTreeSet<Entity>
...

On the other componant side ->

A LayerId componant that store the id of the layer it is on

What alternative(s) have you considered?
We can use the EntityLayer and add the data componant.

I agree with this. After I finish some of my current work I'm going to give this a try.


Q: sesdion context usage guide or example

Dear contributors,
Could you help me how to use session context or any other way  to reference its starting initial  request or response mesage until the end of coversation ?
Exsmple code will be big help to me and others.
Appreviate!!!

Maybe you can checkout code in examples here: https://github.com/DarthPestilane/easytcp/tree/master/internal/examples/tcp

Great!  I found an example at, https://github.com/DarthPestilane/easytcp/tree/master/internal/examples/tcp/broadcast.
If we have a session level storage just like message and router, it might be more convenient for the usage scenario, referencing start/first message on the following message/conversation.
How about changing Unpack's io.EOF case logging level from ERROR to INFO or DEBUG for client closing case ?
Thanks!

@tkang007  can you show some code about the using case of session level storage?


test in linux and mac

[ ] test mac
[ ] test linux

so, apparently cannot make single exe builds from Tauri..

exe doesnt include some webview component, cannot embed webview into exe (only .msi installer builds) ref: https://github.com/tauri-apps/tauri/discussions/4774#discussioncomment-3259121


Remove duplicates in gff2json

In gff2json.py need to remove 'nmdc' from   'subject': f"nmdc:{feature_id}" and seqid = f'nmdc:{rec.id}' to avoid duplicate nmdc:nmdc labels in features.json and annotations.json.

Fixed


Undefined value of template function argument

Hello,
I've decided to report this issue here, not in nunjucks repository, mainly because the problem occured after I've upgraded gulp-nunjucks to 2.1.1, regardless of the version of nunjucks.
As the title says, when I'm invoking function with argument within template, the value of the argument is undefined. It works when I'm using<EMAIL_ADDRESS>I haven't tried anything between these two versions.
My first thought was to try switch nunjucks version, unfortunately with no effect.
Only downgrading gulp-nunjucks version helped.

Other than the Nunjucks bump, the only real changes since 1.0.3 were https://github.com/sindresorhus/gulp-nunjucks/commit/8e054d48ea4a4b046ae86438d4c1de27bfae6095 (by @d10) and https://github.com/sindresorhus/gulp-nunjucks/commit/dcd750ad7bef52fa0b2cd6c3f16ef732dab0846e (by @renanvaz).

@sindresorhus I have changed only one line of code in my commit (in compile method).
@pilaas It is a error of compile or precompíle?

Not too sure what you mean @pilaas :cry: could you provide some simple code that fails?

@renanvaz Precompile. I'll soon paste here some example code. "Hope" it will also fail.

My bad. I haven't upgraded browser nunjucks and it seems it wasn't working with an output of upgraded gulp-nunjuck. Sorry for the confusion.


Add full support for np.memmap in RasterData

Description
Currently, the RasterData attribute array refers to regular np.array. Aiming to speed-up all data array operations we need to use np.memmap arrays, taking advantage of pre-allocation memory spaces and concurrent writing in a single shared data structure.
This re-factoring must include:

skmap.io.read_rasters
skmap.io.RasterData.read
All skmap.io.process (Calc, TimeAggregate, etc)

Consider switching the group axis to the first array dimension, taking advantage of memmap.resize.


reload or scope per webspace

i changed from one thing to another and i had to refresh

heck yeah! done!


Server Restart can cause crashes

I've noticed that if the application doesnt shut down cleanly it will create a background thread that is hard to control.  The watchdog should handle server restarts better.

This has been substantially improved since 0.1