dash-mapd-demo application error

App name
dash-mapd-demo
Description of bug
https://dash-gallery.plotly.host/dash-mapd-demo/ application error
More information in application logs: https://dash-gallery.plotly.host/Manager/apps/dash-mapd-demo/logs
How to replicate the bug
Visit https://dash-gallery.plotly.host/dash-mapd-demo/
Other notes

Suggested resolution:

add a cached fallback
check if anything happened to the dB recently
add retry logic around the connection

check if anything happened to the dB recently

I checked some logs, and it seems every time we try to access the DB, it crashes the container leading to container restart. I suspect this could be because this DB has 7009728 records (7M+) and not enough resources to handle that level of data.
I would recommend coming up with a smaller dataset (or use postgres/sqlite if that works) for this app.

I suspect this could be because this DB has 7009728 records (7M+) and not enough resources to handle that level of data
@tarzzz why not allot more resources? (ie is this a pricing issue)
This app is supposed to demo the Omnisci DB connection so I don't think it quite resolves the problem to use postgres/sqlite

This app is supposed to demo the Omnisci DB connection so I don't think it quite resolves the problem to use postgres/sqlite

👍 . The top-comment ("add a cached fallback") suggested using postgres/sqlite so I thought that would be ok.

why not allot more resources? (ie is this a pricing issue)

The records are loaded to the DB on container creation, so increasing the number of containers will not help to decrease the load. Currently each running container in the cluster has 7M records stored in it, which is very inefficient.
IMHO it would be better to use a smaller dataset (easier to maintain and better performance-wise) unless the app requires to query (or use) the 7M records for its functioning..

@tarzzz is the omnisci database still running, or is it crashing?

Any chance we can get an update on the status of this one? If we don't have time to fix it properly I think @cldougl is right, let's just pay more and create an issue to cut costs later.

@bpostlethwaite The PR to use the smaller dataset is ready to be merged: https://github.com/plotly/dash-sample-apps/pull/339/
I am waiting on a 💃 on that one.

is the omnisci database still running, or is it crashing?

The old database is running, but it crashes as soon as a query is made on it. The new database (with more RAM and smaller dataset) is available now.. @ycaokris will update her app to use the newer database and we can monitor the performance then..

The PR has been merged. I will wait for @ycaokris to verify that her app is working okay now before closing the issue.

Thanks for the update @tarzzz !

@tarzzz  thanks for updating database. Confirmed that this table has already been added. 👍  I will make adaptations in the app.
I took a look at #339 and noticed that you've downgraded Omnisci Docker image to an older version(v4.5 was released 8 months ago and now it's 4.8).
This is not compatible with python client I'm using in the app and I have to downgrade. i.e. Downgrading pymapd to a matched version(0.11.4 - > <0.10.0) for v4.5 DB. You may find changes in https://github.com/omnisci/pymapd/releases stating this version incompatibility. Although I could still run my app, being limited to use an older python client skipped some features, for example,
Add ability to login using sessionid in v0.12.0,
Ensure execute() 'operation' argument trimmed before sending in v 0.16.0.
These are not must-have feature in my app, but for continuing follow up and maximizing possible errors in this app, I'd like to know is there a reason we have to use this Image version, not fixed at a more recent one?
This smaller dataset, flight_10k_2008, is still existing in the docker image you installed prior to #339 in os-cpu, so I'm confused why we change our image. Check
https://www.omnisci.com/platform/downloads/OS-installation-recipes?compute_mode=cpuonly&environment=docker

Updates for this app fix Nov 8:
#335 has done the following changes:

Use dataset from #339
Retry once if initial connection loses.
Close all db_connect() after every usage.
Return empty chart as one fallback solution if any individual connection fails, we'll get a valid app as following output:

I've thought about local cache but it might be better to just reveal empty chart to alert a db fail, rather than always leave a cached, usable app. @cldougl  Let me know how you find about this.
Thanks @tarzzz  for making db changes. After #335 has been merged/deployed,  I'd like another issue for performance follow-up(like resource usage, container stats) record for this new instance.

noticed that you've downgraded Omnisci Docker image to an older version(v4.5 was released 8 months ago and now it's 4.8).

Yes. Well, technically I did not downgrade it.. : ) I just pinned it to the one which we were using when the Omnisci DB was deployed for the first time..
I tried the docker image with the latest tag, and found it to be unreliable. The database server would hang during startup causing the test data not being loaded. I haven't investigated the issue with their official docker image, but if we do want to use it the next steps would be to log an issue with their org and work out on the resolution..
@ycaokris Please let me know if this version is ok with you (we can close this issue) or if you want me to look more into the upgrading.

This version works with me and app functionality isn't getting affected so far. That is, I don't need to upgrade for current demo.  Without a detailed information/log on how this database crashes I'd stay with what we have right now.
Just found out that Omnisci has a community forum from which we could further take a look if any database error occurs.

Updates for this issue:
Merged #335 for fallback adaptation to new instance. A valid app is able to run with same logic.

Any future connection error will leads to empty app layout and I'll set up an instance check up with @tarzzz at least one time after two weeks.
Push to gallery and restore on portal  https://dash-gallert.plotly.host/dash-mapd-demo/


introspection improvements

allow client authentication types other than client_secret_basic (by extracting the code used in oidcc_token)
include other values defined in https://datatracker.ietf.org/doc/html/rfc7662, as well as extra to include values outside the spec

I think this probably needs more test coverage, so keeping it as a draft for the time being.

Pull Request Test Coverage Report for Build 95

56 of 62 (90.32%)  changed or added relevant lines in 3 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.2%) to 92.949%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

src/oidcc_auth_util.erl
36
42
85.71%

Totals

Change from base Build 129:
0.2%

Covered Lines:
725

Relevant Lines:
780

💛  - Coveralls


GH84 swagger external endpoint for receiving a block

@velzevur Good enough for my tests and my work. Obviously there are some issues, but probably you are aware some parts aren't finished.
I pointed out what I have seen.

Also: please don't force push any of those commits. I merge those to my branch so I can use your code. Later we (I can do it) will clean-up the merge commits with some rebase for final PR.

I see that this PR introduces some Erlang auto-generated modules. FYI the auto-generated code may be automatically checked by CI - ref1 ref2.
This CI check can be deferred of course if it makes things slower now.

superseded by https://github.com/aeternity/epoch/pull/139


Getting plugin runtime environment variables within the swc plugin

Describe the feature
We have developed a swc plugin that expects to detect the environment variables of the current ci environment when the plugin is running, but the swc plugin as of now only accepts explicitly passed parameters from outside, and we want to implement this directly inside the plugin.
Babel plugin or link to the feature description
https://github.com/canyon-project/canyon/blob/main/plugins/babel-plugin-canyon/src/index.js#L24
Additional context
No response

cc @kwonoj Any opinion about this?

Currently the env I use for TransformPluginMetadataContextKind only gets NODE_ENV

We should allow env::var I guess, but I want to hear opinion of the core team about this. @swc-project/core-es

I know that the current WASM version of SWC doesn't support plugins.
However, if this feature is added, would it complicate the implementation of WASM SWC with plugins?

I recall whole env varables for the process could be quite verbose and passing it all would cause some overload.
If we have to pass something, I'd consider to have sort of allowlist can be configured and pass it through metadatacontext.

We don’t need to explicitly pass them I think, I think we can support env::var for Wasi

Isn't env::var eventually need to be serialized / deserialized its values into wasm's memory space? that's the one I'm worrying about. It is easily possible to see some proc have more than 20-30 vars or even ~100 depends on the usecase.

Oops. I expected wasi to have a feature for it, but well... https://docs.rs/wasmer-wasix/latest/wasmer_wasix/capabilities/struct.Capabilities.html
There's no capability to allow fetching the environment variables from os

There should be @kdy1 , I believe we support this on the wasmer-cli via --forward-host-env, so it should be doable to have it on the WASIX api. If you want, feel free to open an issue in the Wasmer repo and we can follow-up there

maybe this solution will solve your problem link


Warn if interpolator uses toString

Ports https://github.com/scala/scala/pull/10776
"I always forget how to use Scala 3."

The Scala 2 version of this will ship very soon (in 2.13.15).

@som-snytt may I ask you did you close this pr? I would love to use this flag 🙏


template delete recursive operation of templates instantiated as persistent does not remove images from the vcenter datastores

Author Name: Jaime Melis (@jmelis)
Original Redmine Issue: 5414, https://dev.opennebula.org/issues/5414
Original Date: 2017-09-28

Steps to reproduce:

Instantiate a template (template0) as persistent
Teminate the vm
A new template (template1) is created, with a copy of the images from template0
Note the IMAGE/SOURCE of these new images
Delete template0 with --recursive option
The images have disappeared from opennebula, but they still exist in vCenter (in the IMAGE/SOURCE path)

The problem is due to the fact that the images have the tag TEMPLATE/VCENTER_IMPORTED = "YES", and datastore/vcenter/rm does not operate on them.

I believe that this problem is the same reported in this post.
I have describe how to reproduce it
https://forum.opennebula.org/t/delete-image-vmdk-and-folder-wild-vms/6128

VCENTER_IMPORTED is used to avoid rm operation on TM delete, this attribute shouldn't be copied in a clone operation (persistency) at core level.


Added .gitkeep to unsolved data directory

OptaPlanner complains if it's not there. (Should we create it by default in OptaPlanner, instead of complaining?)

There are now files in unsolved, so closing this one.


Feature: Start service when device boots

Is it possible to start the foreground service when the devices boots?

Nice idea
I will add this option in the next update

Nice idea
I will add this option in the next update

I have more idea's, will create a issue for it ;)

I have more idea's, will create a issue for it ;)

I have more idea's, will create a issue for it ;)

shoot them at me ;)

I have more idea's, will create a issue for it ;)

shoot them at me ;)

I  published new update with this option
you can new set isStartOnBoot

I  published new update with this option
you can new set isStartOnBoot

@SayWut just to confirm. Does this also start the "task" automatically at boot?

@SayWut just to confirm. Does this also start the "task" automatically at boot?

@SayWut just to confirm. Does this also start the "task" automatically at boot?

yes
if you see any bug open a new issue :)

@SayWut just to confirm. Does this also start the "task" automatically at boot?

yes
if you see any bug open a new issue :)

@SayWut how does it handle when the phone is in "doze" mode? (Haven't tested it yet tho)
But maybe we need an option for this:
https://developer.android.com/reference/android/Manifest.permission.html#REQUEST_IGNORE_BATTERY_OPTIMIZATIONS

@SayWut how does it handle when the phone is in "doze" mode? (Haven't tested it yet tho)
But maybe we need an option for this:
https://developer.android.com/reference/android/Manifest.permission.html#REQUEST_IGNORE_BATTERY_OPTIMIZATIONS

@SayWut how does it handle when the phone is in "doze" mode? (Haven't tested it yet tho)
But maybe we need an option for this:
https://developer.android.com/reference/android/Manifest.permission.html#REQUEST_IGNORE_BATTERY_OPTIMIZATIONS

Here comes the receiver that I created.
If the OS kills the service the service will auto restart itself
you can see the onDestroy function in the service which handles this problem
https://github.com/SayWut/flutter_foreground_service_plugin/blob/b91463d4eb60835fea858a773c34c0b50a2fd665/android/src/main/java/com/saywut/flutter_foreground_service_plugin/FlutterForegroundService.java#L290

@SayWut how does it handle when the phone is in "doze" mode? (Haven't tested it yet tho)
But maybe we need an option for this:
https://developer.android.com/reference/android/Manifest.permission.html#REQUEST_IGNORE_BATTERY_OPTIMIZATIONS

Here comes the receiver that I created.
If the OS kills the service the service will auto restart itself
you can see the onDestroy function in the service which handles this problem
https://github.com/SayWut/flutter_foreground_service_plugin/blob/b91463d4eb60835fea858a773c34c0b50a2fd665/android/src/main/java/com/saywut/flutter_foreground_service_plugin/FlutterForegroundService.java#L290

@SayWut I'm testing it right now. What I notice is that when I'm using the perodic task with a duration of 15 minutes. It doesn't always run evry 15 minutes. Especially when the phone is locked. I thought maybe we can solve this by using the REQUEST_IGNORE_BATTERY_OPTIMIZATIONS?

@SayWut I'm testing it right now. What I notice is that when I'm using the perodic task with a duration of 15 minutes. It doesn't always run evry 15 minutes. Especially when the phone is locked. I thought maybe we can solve this by using the REQUEST_IGNORE_BATTERY_OPTIMIZATIONS?

@SayWut I'm testing it right now. What I notice is that when I'm using the perodic task with a duration of 15 minutes. It doesn't always run evry 15 minutes. Especially when the phone is locked. I thought maybe we can solve this by using the REQUEST_IGNORE_BATTERY_OPTIMIZATIONS?

I don't see this request should be in my plugin because it opens a dialog which request from the user to remove the current app from the battery optimize manually
I will test it and I will check if there is somthing that I can do with this 15 minutes duration

@SayWut I'm testing it right now. What I notice is that when I'm using the perodic task with a duration of 15 minutes. It doesn't always run evry 15 minutes. Especially when the phone is locked. I thought maybe we can solve this by using the REQUEST_IGNORE_BATTERY_OPTIMIZATIONS?

I don't see this request should be in my plugin because it opens a dialog which request from the user to remove the current app from the battery optimize manually
I will test it and I will check if there is somthing that I can do with this 15 minutes duration

@SayWut I'm testing it right now. What I notice is that when I'm using the perodic task with a duration of 15 minutes. It doesn't always run evry 15 minutes. Especially when the phone is locked. I thought maybe we can solve this by using the REQUEST_IGNORE_BATTERY_OPTIMIZATIONS?

I think I found a bug
open a new issue about this and post there your periodicTaskFun

@SayWut I'm testing it right now. What I notice is that when I'm using the perodic task with a duration of 15 minutes. It doesn't always run evry 15 minutes. Especially when the phone is locked. I thought maybe we can solve this by using the REQUEST_IGNORE_BATTERY_OPTIMIZATIONS?

I think I found a bug
open a new issue about this and post there your periodicTaskFun


Collect AKS engine logs - confusing

was going through this part and seems confusing at least for me.
Seems that command is not correct aks-engine --output-directory
as aks-engine get-logs has this switch "--output-directory"
also, it is not clear if this process do the same as next section for Collect Kubernetes logs, since its required parameters are below and they seem collecting logs using script from K8S nodes.
Flags:
-m, --api-model string               path to the generated apimodel.json file (required)
--control-plane-only             get logs from control plane VMs only
-h, --help                           help for get-logs
--linux-script string            path to the log collection script to execute on the cluster's Linux nodes (required)
--linux-ssh-private-key string   path to a valid private SSH key to access the cluster's Linux nodes (required)
-l, --location string                Azure location where the cluster is deployed (required)
-o, --output-directory string        collected logs destination directory, derived from --api-model if missing
--ssh-host string                FQDN, or IP address, of an SSH listener that can reach all nodes in the cluster (required)
Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 143ccfc6-64a1-f7d9-e9ec-7e0b313f1f15
Version Independent ID: e59d1050-1d82-0792-dd64-7f0fa9816605
Content: Troubleshoot the AKS engine on Azure Stack Hub - Azure Stack Hub
Content Source: azure-stack/user/azure-stack-kubernetes-aks-engine-troubleshoot.md
Service: azure-stack
GitHub Login: @mattbriggs
Microsoft Alias: mabrigg

@HassanAlmanasrah Thanks for the feedback! The Get-Logs part of aks-engine was added recently, and likely needs to be updated here as well. I have assigned the issue to the content author to evaluate and update as appropriate.

@@HassanAlmanasrah I'll check this. Thanks! #in-progress

@HassanAlmanasrah Thanks for calling out the missing command. I've double checked the aks-engine and we are missing the command get-logs in the instructions. I've updated. The logs with the command aks-engine get-logs, 'Collect logs and current cluster nodes configuration.' This is seperate process from the full range of info collected by the getkuberneteslogs.sh. Without this script, you would need to connect to each node in the cluster locate and download the logs manually.

Here is the PR with the fix: https://github.com/MicrosoftDocs/azure-stack-docs-pr/pull/4957

#please-close


[move-lang] Remove ability to assign values to named addresses in source code

This PR removes the ability to declare named address values in Move source code. Instead, all named address values need to be passed to the compiler -- today via the command line, but in the future this will be handled by the package system.
Nothing too interesting is happening in this PR, just a lot of plumbing. Probably the most interesting is that we now include the named address values in the metadata file that we have temporarily in the CLI.
Testing
Updated tests to make them all pass with the new syntax.

/land


Added education timeline & fixed navbar

[x] Formal Education: A card with the name of the College, Degree, A picture or Illustration relevant to it,Activities
#14

Adjust the size of cards, it is breaking out. We don't want a horizontal scroll balll

Remove the changes to the Nav Bar and give the rest as @sakshi1499 suggests. @Adyasha8105 is working on a common nav bar for all

@smaranjitghose sir, please review it.

Fix the merge conflicts

I'm closing this PR due to navbar issue...looking forward to create new pull request.
Closed #31


How do I send a single transactional email to one email address?

I understand this is a email marketing / campaign management system. But I see nowhere it can send a single email with a template. I just want to have a templated email for purposes like Forgot Email, Welcome mail, Order Created; these kinds of emails. I'm not sure how to fit this requirement in the mailcoach.
Was it intentional to keep this kind of thing outside the scope of this project? If so, why? If this is part of the mailcoach, then Mailcoach has the potential to become the complete email solution for a SaaS app.

This is not possible in the current stable version of Mailcoach.
In mailcoach v4 we'll add support for transactional mails and templating. Expected release Q1/Q2 2021


Giveaway reactions being removed in the first 30 seconds of people reacting

idk if its a bug with discord or this


Fix types for tflite micro

When build the tflite-micro for the stm32f746 with -Wall the build fails in several points because there are warnings about types and different signedness.
For example:
code-stm32f476-tflite/source/libs/tensorflow/lite/experimental/micro/micro_interpreter.cc: In member function 'TfLiteStatus tflite::MicroInterpreter::Invoke()': code-stm32f476-tflite/source/libs/tensorflow/lite/experimental/micro/micro_interpreter.cc:104:21: warning: comparison of integer expressions of different signedness: 'int' and 'flatbuffers::uoffset_t' {aka 'long unsigned int'} [-Wsign-compare]    for (int i = 0; i < operators_->size(); ++i) {
With this commit my cmake project that uses -Wall compiles without errors.

I signed it!

recheck?


Update audio samples for vad testing

This PR re-uses sample test/assets/SpeechCommands/speech_commands_v0.02/go/0a9f9af7_nohash_0.wav to produce stereo and mono samples for vad.

Although these files are small, if data are coming from existing file, I prefer to generate such data on the fly during the test. If we keep adding test assets, the size of repository increases, and that could be problematic at some point for downstream users.

Although these files are small, if data are coming from existing file, I prefer to generate such data on the fly during the test. If we keep adding test assets, the size of repository increases, and that could be problematic at some point for downstream users.

Agreed. Maybe this is something that can be mentioned in how to contribute along with the right way to manage temporary files in the test suite. unittest and pytest have different approaches, as far as I understand.

It also seems possible to maintain a small library of test data, if we think we can keep cover all uses cases with a sufficiently small collection.
Alternatively, pulling down datasets from a network location would be another option, but it introduces other complications that make unit tests more like integration tests.


Add security context transfer for feign client to hystrix command.

PR for issue #1053
Currently leverages on Command Hook registration of Hystrix. With this current implementation, users won't be able to register a custom Hook. Needs to be addressed. Waiting for project leads feedback.

I'm actually trying to figure out why the RestTemplateRetryTest test only crashes during maven build. I'm not encountering any error when running the full JUnit suite. Any guess ?

I get the same error on master.

Yeap, same here. I'm also surprised to see my new test on error. Going to dig on it but I don't have the same behavior than travis when running maven install.

If hooks are singular (as stated in https://github.com/spring-cloud/spring-cloud-security/issues/87), we would need an extension mechanism, so users can add their own hooks. Would they work as a composite (and the user can add one to the composite by configuring a bean)?
I'm not sure I understand the use case for this one yet though. What is there in the SecurityContext that is useful in a Feign interceptor? The tests show a header being sent with the current user name, but it seems somewhat artificial.

I'll give you that the use case is not quite obvious. Let me explain it to you.
I am interested in having access to the SecurityContext inside a Feign Interceptor so I can automatically inject custom headers or parameters required a backend service. In my case, the backend targeted by Feign requires a username inside the header for audit purpose for every endpoints. Rather than having to define the username as a parameter to every Feign endpoints, I prefer having a centralized interceptor for this.  This backend is secured with generic credential which is unrelated to the user logged inside my Security Context.
The test I contributed tries to reproduce this use case inside a single Web Service.

TestController represent a backend service which requires the username as part of the header.
ProxyTestController represent my service secured endpoint who uses Feign to call the backend service. It uses the Feign TestInterceptor to automatically inject the username header from the SecurityContext.
TestInterceptor injects the SecurityContext username. At the moment, it also inject a Basic Auth Header because the backend url is secured by the same filter than ProxyTestController. I'll change that. For my demonstration, the backend service does not need to be secured.

I'll go through your reviews comments and reply to them.
Hope I could be helpful with those explanations.

Difficulty resides in the fact that users might expect to directly registers their hook with Hystrix API without knowing about our pre registered one. A runtime exception with explanations could be triggered if we detect that our Spring Cloud hook was removed. Our hook could then make use of an optional bean providing extension capabilities. What do you think about it ?

I think if people want to use the raw Netflix API then they will forgo the opportunity to benefit from our customizations (i.e. don't worry about it).

Alright then ! I'll just at least provide provide an extension bean. By the way, how do you feel about this feature ? Have I made myself more clear on the use case ? If you are interested into integrating that feature, I'll prepare the doc into spring-cloud-netflix-docs.

I'm not sure yet. Probably something like this makes sense. I'm a little wary of adding 2 new filters to the stack, but maybe we can find a different way, or make them optional somehow, once we have the feature clearly defined.

I understand your concerns with the new filters. I'll think about other alternatives. I'm open to suggestion if you have any idea :) I'm guessing aop could be another way around but I'm not a big fan of overusing aspects. In the meantime. I could deactivate the filters by default and make them optional with a property.
Since this feature answer an edge case, deactivating it by default would make sense.

By the way, I am currently investigating the issue with the RestTemplateRestryTest. The problem comes from the retry handler of the ribbon configuration who gets overwritten when running the full maven build. the tests sets up a next server retry count to 10 but gets overwritten by the default handler. I'm close to finding out why it happens. I'll push try to push a PR once I identified to source. This will help to fix the travis build.
Regards

I am getting desperate with that PR :( I'll setup a travis build on my personal repo so I can stop polluting this PR.
INSERT GENERIC WORKS ON MY PC COMMENT

@daniellavoie have you rebased with master?

@spencergibb Yeap, I double and triple checked. Since you fixed master I am now able to successfully build locally. I'll play with travis and see what's wrong. My unit test is very elaborate. I'm making some web service-ception so that I can trigger the a feign client with a security context filed by Spring Security Filter.

I'm kinda lost. I have a travis build on my personal repo. My commit be60b08 was built successfully in my repo. The force push of this commit to my PR branch triggered the spring cloud netflix travis build 1301 who resulted in a merge with master (even tough the commit was already rebased on master). My personal travis builds without problem but the Spring Cloud travis instance crashes. I'm speechless :/ It feels like there is something I am not understand with Travis. Any idea ? Many thanks. Sorry for disturbing :/

Travis is a bit mysterious sometimes. Don't worry about it.

Victory ! I've been encountering some weird behavior on properties defined with @WebIntegration. So I moved them to application.yml. Can't tell why but Travis gave me different behavior than locally.
 Users only need to declare a bean implementing CustomCommandHook.

I'll rework that PR with the proper documentation within asciidoc sources.

I actually realized that this feature does not limit itseft to a feign hystrix command. It allows you to access the SecurityContext from any Hystrix Command. I'll rework PR description and package naming. Many people are complaning about not being able to access SecurityContext without using SEMAPHORE isolation.

I'm closing this PR since I had to renamed the branch. Replaced by PR #1093 .


fix: CreateConnectionThread that keeps endlessly reconnecting even after the data source has been properly closed

After calling the DruidDataSource.close() method, the interrupt status of the CreateConnectionThread is set to true. However, if the MySQL is configured with autoReconnect=true, it will trigger the MySQL reconnection mechanism, which includes a call to Thread.sleep(), resetting the interrupt status.
ConnectionImpl:connectWithRetries()

CreateConnectionThread：Due to the reset of the interrupt status, calling lock.lockInterruptibly() fails to throw an exception.

If the connection is always NULL due to constant exceptions, it will result in an infinite loop.

Here is the code for reproducing the issue：
DruidDataSource dataSource = new DruidDataSource();
Properties properties = new Properties();
properties.put("druid.url", "jdbc:mysql://<IP_ADDRESS>:3306/xx?autoReconnect=true");
properties.put("druid.username", "root");
properties.put("druid.password", "root");
dataSource.configFromPropety(properties);
new Thread(() -> {
    try (DruidPooledConnection connection = dataSource.getConnection()) {

    } catch (Exception e) {
        e.printStackTrace();
    }
}).start();

Thread.sleep(1000);
dataSource.close();
System.out.println("close success");
LockSupport.park();

@wenshao please check

有新代码实现了


Dynamic Custom Data loading

From https://github.com/microsoft/vscode-html-languageservice/issues/50.
I think we should do two things:

Offer an API for vscode-[html|css]-languageservice to load additional datasets to extends its catalog of tags/attributes etc.
Offer an extension API from extensions/[html|css]-language-features that allows extensions to contribute dynamically generated tags/attributes etc at runtime. This would make it possible to write extensions, such as a WebComponent extension, that would look into node_modules for WebComponents, analyze them and then add their tags to the html language server.

@aeschli What do you think?

I'd rather stick with custom data to be static.

Dynamic stuff should be done in the domain-specific extensions using the provider mechanism. (completion and hover providers) on a per-document basis.
I want to avoid an APIs for css & html as to

avoid tight coupling
allow the user to disable or replace the html -/ css-language-feature extensions

@aeschli So the suggestion for WC support extension would be:

Clone the whole html language server
Register all providers again
Try to avoid feature conflicts (completion, hover, folding, etc)?

This is a LOT to ask from an extension.

No, one would not replace and reimplement the HTML language server but have a server that adds additional proposals/hovers on top of it.

implement a server that provides a completion and hover provider. Register for HTML as well.
use the HTMLScanner from 'vscode-html-languageservice' to find out what location you are, or use the ICompletionParticipant*.
provide the proposals/hovers you want to add based on the additional context you have (e.g. WebComponents found in node modules, config files in the current files context)

An example for that is https://github.com/Microsoft/vscode/blob/master/extensions/npm/src/features/packageJSONContribution. package.json dependency proposals/hovers are added on top of the proposals coming from the JSON language server.
If we have good APIs in the languageservices it will be easy to implement such a server.
(*ICompletionParticipant could use some more methods..)

OK, closing as out-of-scope then.


Fixing comments from PR#135

This is a follow up from PR#135:

better validation of role outputs in molecule test
adds a retry on image push
other minor changes

This PR has:

[ ] Appropriate testing (molecule, python unit tests)
[ ] Appropriate documentation (README in the role, main README is up-to-date)

Follow up changes for https://github.com/openstack-k8s-operators/ci-framework/pull/135


How to use "Trim Key Prefix:" parameter when we pull settings from App Configuration

Hello,
In an Azure DevOps Pipeline, to get key-values from an App Configuration to use them in a yaml template, I use this yaml task :
    - task: AzureAppConfiguration.azure-app-configuration-task.custom-build-release-task.AzureAppConfiguration@5
      inputs:
        azureSubscription: 'ServiceConnectionName'
        AppConfigurationEndpoint: 'https://ressourcename.azconfig.io'
        KeyFilter: '${{ parameters.appConfigurationKeyFilter }}*'

But how to use the "TrimKeyPrefix:" parameter in the AppConfiguration task ?
If I use it, how to retrieve key-values in all environment variables ?
Now, I use this PowerShell task to use key-values retrieved from an App Configuration :
    - task: PowerShell@2
      inputs:
        targetType: 'inline'
        script: |

            # Get all key-values
            $keyValues = Get-ChildItem env: | where name -like '${{ parameters.appConfigurationKeyFilter }}*'

How to do otherwise ?

To use "TrimKeyPrefix", specify one or more prefixes that should be trimmed from App Configuration keys before setting them as variables.
Example is:
Key in App Configuration resource

- task: AzureAppConfiguration@5
  inputs:
    azureSubscription: 'ServiceConnectionName'
    AppConfigurationEndpoint: 'https://resource.azconfig.io'
    key: '*'
    TrimKeyPrefix: 'app:'

- task: PowerShell@2
  displayName: 'Show AppConfiguration values'
  inputs:
    targetType: 'inline'
    script: |
      echo "Test 1 = $(test1)"
      echo "Test 2 = $(test2)"
      echo "Test 3 = $env:test3"

After specifying the TrimKeyPrefix as "app:",  "app:" is trimmed from the key, and the available variables are test1, test2, and test3.
Please let me know if this helps.

Ok, but if we use the "TrimKeyPrefix", all key-values are added in environment variables without prefix.
So, impossible to get them without knowing key names !
Then, we need to hard coded all key names in our AzureDevOps yaml pipeline. And it is a problem to create a generic pipeline.
For example, if all key-values are App Settings to send to an Azure App service, I needn't to know key names.

Might you be referring to getting key names, after using "TrimKeyPrefix" without knowing the key names in advance?

Yes !

Am afraid that is not possible since the task is designed to pull key values from a configuration store and set them as environment variables. To get a key-value you'll have to know the name of the key-value. Please see Use key-values in subsequent tasks for more information. Please reach out in case you encounter any issues.


feat: Eirini persi tests

Fixes https://github.com/cloudfoundry-incubator/kubecf/issues/840
Also moves brain tests away from bosh releases, relates to https://github.com/cloudfoundry-incubator/kubecf/issues/1352
Needs https://github.com/SUSE/brain-tests-release/pull/19 merged before (and brains docker image pushed too) and probably adapt the CI workflow.
Motivation and Context
https://github.com/cloudfoundry-incubator/kubecf/issues/840
https://github.com/cloudfoundry-incubator/kubecf/issues/1352
How Has This Been Tested?
N/A
Screenshots (if appropriate):
Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[ ] My code has security implications.
[ ] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.

@mudler This draft PR has not been updated in 4½ months. Do you think you will work on getting it into a mergeable state, or should we close it for now?

@jandubois I think it's better to close it for now, I doubt it's still relevant. Happy to pick it up again if there is interest in it


[Bug]: mismatch data format (camelCase) between APIs/id_token

Preflight Checklist

[X] I could not find a solution in the documentation, the existing issues or discussions
[ ] I have joined the ZITADEL chat

Environment
Self-hosted
Version
v2.50.1
Database
PostgreSQL
Database Version
No response
Describe the problem caused by this bug
Hello,
I'm not sure if this is a bug.
When requesting any api from https://zitadel.com/docs/apis/apis, the returned data (json) are formatted as camelCase.

This does not align with the returned data/json from the userinfo endpoint /oidc/v1/userinfo as well as in the id_token which are in snake_case.

I've also noticed that the schema itself does not match, for example:

locale in the userinfo endpoint / id_token
preferredLanguage in all other APIs
Same goes for username (no idea what is preferredLoginName) vs preferred_username
...

I'm using the userinfo endpoint to create my user object in my Angular app.
Having different "cases" forces to have converters/boilerplate and add in complexity.
For example on Angular I can create query params from an object https://stackoverflow.com/a/65942191, having different case mean that we need a converted and 2 types.
This is probably a similar issue to the gender not having the proper format https://github.com/zitadel/zitadel/issues/7787
The real question is, should we rely on the id_token/userinfo to get information of the user?
I myself think that the answer is yes as it contain all other informations that we can get with the scopes, for example metadatas.
To reproduce

Call the userinfo endpoint /oidc/v1/userinfo (or decode the id_token)

it will return the gender as male, ...

Call any API from https://zitadel.com/docs/apis/apis

it will return the gender as GENDER_MALE

Screenshots
No response
Expected behavior
Same case format on all endpoints + id_token.
Operating System
No response
Relevant Configuration
No response
Additional Context
No response

Hey @Yberion
I can see the problem, but there's not much we can do about it, since different RFC / specification require different casing, formatting or even naming. And they might not represent the exact same thing.
For example the username all more or less the same meaning:

OIDC defines a preferred_username
OAuth (Introspection) defines the username
SCIM usesuserName
Since ZITADEL knows the concept of suffixed usernames, we currently call them loginnames.
Also similar to gender there are different formats for the "same" properties, e.g. dates in oidc are typically expressed as unix timestamps where our apis rely on date(time).

Regarding your question which to use:
There's no one rule fits all answer to that and depends on what you need.
If your application "only" requires authentication/authorization you could go with OIDC and use id_token / userinfo, resp. OAuth2 introspection on the API.
If you however also need to manage users in the same application / api, you will need to additionally use the proprietary endpoints and types.

Hello @livio-a, thanks for the answer, I can understand the constraints, I will manage it on my side. 😄


Can MethylDackel run for pbat?

Hi, I read issue #50. You mentioned there is a branch "pbat" in bwameth patched for it.
I was wondering, is it the suggested workflows to analyze the pbat dataset using bwameth.py as mapper (with -pat) then do the methylation calling with MethylDackel?  Do I need to exclude the reads mapped on the OT/OB using the nOT/nOB argument?
Thanks

It's been a number of years, but I recall that that should work. I don't recall needing to exclude anything.

It's been a number of years, but I recall that that should work. I don't recall needing to exclude anything.

Hi @dpryan79, I tested MethylDackel on bam files for PBAT libraries, and the wrong strand is reported in the output. Can I modify the argument to make MethylDackel detect the complementary strand?

@y9c As long as its only reporting the wrong strand and otherwise the output is good I'd suggest just swapping the strand with awk. It's been enough years since I've looked at PBAT data that I'm pretty hesitant to make any core code changes related to it at this point.

Thank you @dpryan79 .
I did swap the reads in PE mode, and reverse complement the reads in SE mode before before mapping. But it would be nice if there is a build in options in the tool.


Pf 15 extention for profile

https://mobil2b2.atlassian.net/browse/PF-15?atlOrigin=eyJpIjoiMDUyZGYzNzQyZDY3NDg3OWFkZDcxOWE3ZjBmNzc0NWMiLCJwIjoiaiJ9
It's all about profile, languages and gender
If have still a problem, I have to go to users first to update my state with the infos from the DB for the profile.
I'll fix this with useEffect

To discuss in next daily if necessary


Fix lookahead for effects specifiers in function types

We were failing to properly look past effect specifiers like async throws(X) in a function type starting with an attribute.

@swift-ci please test


Docs: Fix repo references in README and package.json

I'm aware that none of the links are actually broken and GitHub will happily redirect not-an-aardvark/eslint-canary.git to eslint/eslint-canary.git, but we might as well use the canonical URLs and avoid potential confusion.

I recently switched emails on my local GitHub. Per the above, I added the email to my GitHub account. Is there anything else I need to do to make the CLA pass?

It’s the email you have in your git client that gets checked. If you reset that and do a git commit —amend and then do a force push I think that’ll take care of it.

Thanks @nzakas! In my case, I did that step first and forgot to update the GitHub side. By doing that and closing and reopening the PR, it looks like the status check is now passing but the comment was just never updated.
I'm hoping the passing status check means this is mergeable from a CLA perspective. Please let me know if I need to fix anything else. Thanks!


mv command in merge r1 umi

Original bug report from Susanna Marquez:
I have just now started trying bcellmagic. I get the error below. Any suggestions? .command.sh simply has the same error message, about moving the files.

[14/b08493] process > get_software_versions      [100%] 1 of 1 ✔
[-        ] process > multiqc                    -
[a9/753701] process > output_documentation (1)   [100%] 1 of 1 ✔
Execution cancelled -- Finishing pending tasks before exit
[0;35m[nf-core/bcellmagic] Pipeline completed with errors
Error executing process > 'merge_r1_umi (HD07M)'

Caused by:
 Process `merge_r1_umi (HD07M)` terminated with an error exit status (1)

Command executed:

 gunzip -f "HD07M_R1.fastq.gz"
 mv "HD07M_R1.fastq" "HD07M_R1.fastq"
 gunzip -f "HD07M_R2.fastq.gz"
 mv "HD07M_R2.fastq" "HD07M_R2.fastq"

Command exit status:
 1

Command output:
 (empty)

Command error:
 mv: 'HD07M_R1.fastq' and 'HD07M_R1.fastq' are the same file

Work dir:
 /home/susanna/Documents/projects/collaborations/bcell-magic/work/e3/e7655ee3723008a802d5b887ea585a

I've solve this in my fork. Will include this in version 1.1.1 bug fix.


Systemd script not working

Systemd script is not working when trying to start the application packaged with distillery.
I got this error:
Active: failed (Result: exit-code) since lun 2017-01-23 12:10:53 CET; 3min 17s left
Process: 593 ExecStop=/opt/app/bin/app stop (code=exited, status=1/FAILURE)
Process: 487 ExecStart=/opt/app/bin/app start (code=exited, status=0/SUCCESS)
Main PID: 591 (code=exited, status=0/SUCCESS)
If I try to start the app with: /opt/app/bin/app start, it works, so the problem must be systemd script itself.

Hey there :)
I looks from your logs like the app did start up when systemd executed the command under ExecStart - can you verify that when you run "start " manually it doesn't start up? Could you should the logs for that as well?

When I start the app manually it starts, it responds to /opt/app/bin/app ping, then I stop with /opt/app/bin/app stop, and if i try to start it with systemd i got the failure. The app in this case is not starting, i can't reach it or see a pid.

@samuelebistoletti thank you for that PR! I have merged it and I will deploy a release as soon as I am able to.


Refine bid descriptions

@RalphLipe I noticed some NT descriptions show both HCP and points, e.g. "15-17 HCP, 15-18 points, balanced". Is this intentional?

@RalphLipe this is ready for another look. If you're happy with it I'll go ahead and merge.


Horizontal MultiBar Chart X ticks not aligniing

Hi,
So I am having a problem where the Xticks are not aligning properly with the bars themselves. I tired to find the option which lets me tweek the padding, but cant seem to find it.

+1


client EXIT: {shutdown, tcp_closed}

If i start the benchmark with 50K subscribers i receive after around thousandth clients the output
client EXIT: {shutdown, tcp_closed}, What is the reason.
My sysctl.conf
For binary values, 0 is disabled, 1 is enabled. See sysctl(8) and
sysctl.conf(5) for more details.
Controls IP packet forwarding
net.ipv4.ip_forward = 0
Controls source route verification
net.ipv4.conf.default.rp_filter = 1
Do not accept source routing
net.ipv4.conf.default.accept_source_route = 0
Controls the System Request debugging functionality of the kernel
kernel.sysrq = 0
Controls whether core dumps will append the PID to the core filename.
Useful for debugging multi-threaded applications.
kernel.core_uses_pid = 1
Controls the use of TCP syncookies
net.ipv4.tcp_syncookies = 1
Disable netfilter on bridges.
net.bridge.bridge-nf-call-ip6tables = 0
net.bridge.bridge-nf-call-iptables = 0
net.bridge.bridge-nf-call-arptables = 0
Controls the default maxmimum size of a mesage queue
kernel.msgmnb = 65536
Controls the maximum size of a message, in bytes
kernel.msgmax = 65536
Controls the maximum shared segment size, in bytes
kernel.shmmax =<PHONE_NUMBER>6
Controls the maximum number of shared memory segments, in pages
kernel.shmall =<PHONE_NUMBER>
#ipv6 support in the kernel, set to 0 by default
net.ipv6.conf.all.disable_ipv6 = 1
net.ipv6.conf.default.disable_ipv6 = 1
net.ipv4.tcp_fin_timeout = 30
fs.file-max = 5097152
net.ipv4.tcp_tw_recycle = 1
net.ipv4.tcp_tw_reuse = 1
net.core.rmem_default = 524288
net.core.wmem_default = 524288
net.core.rmem_max = 67108864
net.core.wmem_max = 67108864
net.ipv4.tcp_rmem = 4096 87380 16777216
net.ipv4.tcp_wmem = 4096 65536 16777216
net.ipv4.ip_local_port_range = 1024 65535
And here limits.conf
#
......

hard nofile 500000
soft nofile 500000
root hard nofile 500000
root soft nofile 500000

Hi @oedemis, the kernel parameters are right. It seems emqtt_benchmark did not connect to the broker successfully. Please check logs/emqttd_error.log or run './bin/emqttd_ctl listerners'

Hi, I'm testing the mosquitto mqtt broker

Please check mosquitto config and logs, 'tcp_closed' means the broker closed the TCP connection actively.

I have the same problem and the emqtt broker show this message in log
07:23:53.003 <0.416.0> [error] Failed to start connection on <IP_ADDRESS>:1883 - maxlimit


The text is disappear when I resize the window to minimum

This bug-tracker is monitored by Windows Console development team and other technical types.  We like detail!
If you have a feature request, please post to the UserVoice.

Important: When reporting BSODs or security issues, DO NOT attach memory dumps, logs, or traces to Github issues. Instead, send dumps/traces to<EMAIL_ADDRESS>referencing this GitHub issue.

Please use this form and describe your issue, concisely but precisely, with as much detail as possible

Your Windows build number:  10.0.18362.30

What you're doing and what's happening: Resize the terminal window to minimum, then resize the window to normal, the text will disappear.

The normal window size

Resize it to minimum

Then resize to normal, the text disappear

Scroll up the window

What's wrong / what should be happening instead: I don't know. Is this a bug?

Yea, I think resizing is a little funky right now.
Part of this has to do with how conpty deals with resizing, by repainting the window. So that's why there seems to be multiple Microsoft Wi bits.
I also don't think the new terminal is resizing with refolw currently, which is why the terminal seems to lose any of the old output.
There's definitely work to do in this space to make the experience more fluid.


⚠ Quirk Club Argentina (API endpoint) has degraded performance

In 791f41a, Quirk Club Argentina (API endpoint) (https://us-central1-quirkclub-dev.cloudfunctions.net/api/check/api) experienced degraded performance:

HTTP code: 200
Response time: 6194 ms

Resolved: Quirk Club Argentina (API endpoint) performance has improved in 6842e9c.


docs(README): add getting started section

resolves #56 and #55

Thanks for all the feedback @grampelberg @lachie83. This is ready for another round if reviews. :D

/lgtm


Use official django-customfield again

DD is using its own fork of djang-customfield. It looks like we did only one commit to make it compatible with django 2.x?
The official version now has support for django 2, so could we switch back to that and stay up-to-date with bugfixes, etc?
https://github.com/willseward/django-custom-field

wdyt @Maffooch

or we could remove it maybe as it looks like the CustomFieldValue stuff has been replaced by Dojo_Meta.

Works for me. I remember the build failed without making those changes. This was almost two years ago so a lot has changed.

Apologies if this isn't directly related but seeing the following on RHEL 7.9 & trying to figure out how to fix:
Downloading django-auditlog-0.4.7.tar.gz (11 kB) Collecting django-custom-field   Cloning https://github.com/DefectDojo/django-custom-field.git (to revision 4e095dd9119858e90fd21560e5618c6347e4ef1b) to /tmp/pip-wheel-thf29ykk/django-custom-field ERROR: Command errored out with exit status 128: git clone -q https://github.com/DefectDojo/django-custom-field.git /tmp/pip-wheel-thf29ykk/django-custom-field Check the logs for full command output. WARNING: You are using pip version 20.2.3; however, version 20.3.3 is available. You should consider upgrading via the '/usr/local/bin/python -m pip install --upgrade pip' command. ERROR: Service 'uwsgi' failed to build : The command '/bin/sh -c pip3 wheel --wheel-dir=/tmp/wheels -r ./requirements.txt' returned a non-zero code: 1

pip 20.3.3 from /usr/lib/python2.7/site-packages/pip (python 2.7)
pip 9.0.3 from /usr/lib/python3.6/site-packages (python 3.6)

update to 1.11.0

update to 1.11.0

Thanks.  I did a fresh clone this morning so it should be on 1.11.0 regardless.  When I try to just do individual builds against uwsgi or nginx, it still errors at the same point which refers to the aforementioned error.

On second thought it doesn't look related to the pip thing. Are you using Docker? Anything is not tested. Also looks like mixing python2 and 3? It looks like the git clone failed.

You could try to install the official customfields instead of our clone, will probably work just fine.

On second thought it doesn't look related to the pip thing. Are you using Docker? Anything is not tested. Also looks like mixing python2 and 3? It looks like the git clone failed.

Yes this is being done via 'docker-compose build'.  I've tested the clone for djagno-custom-field manually, even into /tmp/ where the script defaults & that works fine.
I have also tried just installing the official manually via PIP & that was fine also:
"Requirement already satisfied: django-custom-field in /usr/lib/python2.7/site-packages (3.0)"
$ git clone -q https://github.com/DefectDojo/django-custom-field.git /tmp/pip-wheel-dn2hbwzs/django-custom-field $ ls -laF /tmp/pip-wheel-dn2hbwzs/ total 12 drwxr-x---.  3 p_dkennedy domain users 4096 Dec 30 11:11 ./ drwxrwxrwt. 17 root       root         4096 Dec 30 11:12 ../ drwxr-x---.  5 p_dkennedy domain users 4096 Dec 30 11:11 django-custom-field/ $ ls -laF /tmp/pip-wheel-dn2hbwzs/django-custom-field/ total 60 drwxr-x---. 5 p_dkennedy domain users 4096 Dec 30 11:11 ./ drwxr-x---. 3 p_dkennedy domain users 4096 Dec 30 11:11 ../ drwxr-x---. 4 p_dkennedy domain users 4096 Dec 30 11:11 custom_field/ drwxr-x---. 8 p_dkennedy domain users 4096 Dec 30 11:11 .git/ -rw-r-----. 1 p_dkennedy domain users  232 Dec 30 11:11 .gitignore -rw-r-----. 1 p_dkennedy domain users 1067 Dec 30 11:11 LICENSE -rwxr-x---. 1 p_dkennedy domain users  247 Dec 30 11:11 manage.py* -rw-r-----. 1 p_dkennedy domain users   43 Dec 30 11:11 MANIFEST.in -rw-r-----. 1 p_dkennedy domain users 3372 Dec 30 11:11 README.md drwxr-x---. 2 p_dkennedy domain users 4096 Dec 30 11:11 screencaps/ -rw-r-----. 1 p_dkennedy domain users  924 Dec 30 11:11 setup.py -rw-r-----. 1 p_dkennedy domain users 1465 Dec 30 11:11 test_settings.py -rw-r-----. 1 p_dkennedy domain users  163 Dec 30 11:11 test_urls.py -rw-r-----. 1 p_dkennedy domain users  216 Dec 30 11:11 tox.ini -rw-r-----. 1 p_dkennedy domain users  252 Dec 30 11:11 .travis.yml
Pretty odd.  If this wasn't a managed RHEL VM I'd just use the bash setup despite it going EOL tomorrow.  Thanks for your thoughts.  I'll keep attacking this on my end to see what I can sort out.  Happy New Year!

I think you can just replace:
git+https://github.com/DefectDojo/django-custom-field.git@4e095dd9119858e90fd21560e5618c6347e4ef1b#egg=django-custom-field
with
django-custom-field
and rebuild with --no-cache


Silicon oredict issue

Issue description:
Unable to autocraft storage part with silicon, when there is more than one type of silicon, and not enough of one type. (Yes, pretty specific)
What happens:
I had just 2 EnderIO silicon and ~300 RS silicon in my RS. I created 4 patterns, with and without OreDict, and with EIO silicon and with RS silicon. Regardless of which pattern I used, when attempting to autocraft, the job detail showed EIO silicon and refused to proceed because I only had 2 EIO silicon available.
I crafted a 1k storage part manually which used up the 2 EIO silicon, and now it's happy to autocraft with the RS silicon.
What you expected to happen:
Steps to reproduce:

Have 2 EIO silicon in the RS and plenty of RS silicon
Attempt to autocraft a 1k storage part (fail)
Remove EIO silicon
Re-attempt autocrafting a 1k storage part (success)
...

Version (Make sure you are on the latest version before reporting):

Minecraft: 1.10.2
Forge: 2122
Refined Storage: 1.2.4

Does this issue occur on a server? [yes/]
If a (crash)log is relevant for this issue, link it here:
[pastebin/gist/etc link here]

I read the fix and stuff but im still getting the issue where it will pull from my storage but NEEDS ender io silicon :C

This? #1954


💥feat(sdk/elixir): return only :ok for any functions that returns Void type

This is #6868 but for Elixir, when found any function that return Void, instead of return {:ok, Void}, return just only :ok atom.
This requires #7667 to be complete first because this PR may break the runtime due to return_value return type change.

The runtime works as expected. :)

Waiting for https://github.com/dagger/dagger/pull/7667 as described.

Waiting for #7667 as described.

@wingyplus, that's been merged, let me know when this one is rebased and good to go.

@helderco It's all done. Waiting for CI to pass.

All checks green. :)


[Extensions] Migrate ADResultBulkAction/TransportAction and Multi-Entity real time analysis

Description
Migrates HCAD realtime analysis
Issues Resolved
https://github.com/opensearch-project/opensearch-sdk-java/issues/684
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@joshpalis build failed. Can you look into it?

@owaiskazi19 yes I just need to fix the failing test classes

LGTM other than the failing tests.


403

Always get 403 error, its works with CURL but Unirest is not working
i try from CLI and from WebServer
here is the code:
$response = Unirest\Request::post("https://community-neutrino-ip-info.p.mashape.com/ip-info",
array(
"X-Mashape-Key" => "XXXX",
"Content-Type" => "application/x-www-form-urlencoded",
"Accept" => "application/json"
),
array(
"ip" => "<IP_ADDRESS>",
"reverse-lookup" => true
)
);

this is now fixed in v3.0.0
PLEASE NOTE: v3.0.0 introduces API changes, please review the release notes and README for details

I don't know if it's fixed ... tested with version 3.0.0 of the lib and getting always 403 forbidden errors for Mashape :
require_once 'vendor/autoload.php';

global $url;
$url = $_GET['url'];

$response = Unirest\Request::post("https://savedeo.p.mashape.com/download",
  array(
    "X-Mashape-Key" => "e6PtbYC3OCmshFHUdKo0BucN29p9p1EE3idjsnRuyrQTgiLtJs",
    "Content-Type" => "application/x-www-form-urlencoded",
    "Accept" => "application/json"
  ),
  array(
    "url" => urlencode($url)
  )
);

Any idea ??

Ok... didn't read the new README ...
works with :
global $url;
$url = $_GET['url'];

$data =   array(
    "url" => $url
  );

$body = Unirest\Request\Body::form($data);

$response = Unirest\Request::post("https://savedeo.p.mashape.com/download",
  array(
    "X-Mashape-Key" => "KEY",
    "Content-Type" => "application/x-www-form-urlencoded",
    "Accept" => "application/json"
  ),
  $body
);

echo $response;

awesome :+1:

:rocket:


Matching of stereochemistry queries from complex atomic SMARTS is wrong

Description:
Here's a little demo:
In [5]: p = Chem.MolFromSmarts('[#6]-[#6,#7@](-[#17])(-[#35])-[#9]')

In [6]: print(p.GetAtomWithIdx(1).DescribeQuery())
AtomOr
  AtomAtomicNum 6 = val
  AtomAnd
    AtomAtomicNum 7 = val
    AtomNull

In [7]: ms = [Chem.MolFromSmiles(x) for x in ('CC(Cl)(Br)F','C[C@](Cl)(Br)F','C[C@@](Cl)(Br)F')]

In [8]: [x.HasSubstructMatch(p,useChirality=True) for x in ms]
Out[8]: [False, True, False]

I'm not sure how Daylight did stereochem queries in SMARTS, but I'm pretty sure that the above should return the same substructure search results as this:
In [9]: p = Chem.MolFromSmarts('[#6]-[#6](-[#17])(-[#35])-[#9]')

In [10]: [x.HasSubstructMatch(p,useChirality=True) for x in ms]
Out[10]: [True, True, True]

(i.e. the @ query only applies if the N matches).

@greglandrum , I was just about to file a ticket about this but had the good sense to search first. :-) We encountered at Schrödinger it while working on a bug report from a customer, so it's not just a theoretical issue.
I also don't know what Daylight did, but I agree with your interpretation, because the OR operator , has low precedence. FWIW, the two other toolkits that I had available also seem to agree.

@i-tub thanks for letting me know that this happens "in the wild".
Doing a bit of investigation: the underlying problem is that the substructure-search chirality handling is happening at the atomic (instead of the query) level. So at the moment the options are: "setting chirality on a subquery affects the whole atom match" or "setting chirality on a subquery has no effect at all". Clearly this is wrong, but we will need to do some refactoring of that code in order to get this working.


Small refactoring propose

Looks like no need to use list generators here, by reason that is not expected a list as result

It is common to use the comprehensions anyway and the compiler optimizes away the generated list so it is not an issue.

Nop, this is not a issue, just small propose

Hey @vkatsuba,
Thanks for your contribution! I would really love to see more of those...
However in this question I am more with @tsloughter. The list generators are faster, as well as they are optimized by the compiler.
To showcase the difference I would advise this small example:

And you can see the resulting code by running erlc -S t.erl

As you can see in the result the instructions for the foreach case are longer, but even more important thing is the expensive call_ext_last at the end of the foreach case.
9> List = lists:seq(1, 100000).
[1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,
 23,24,25,26,27,28,29|...]
10> timer:tc(fun() -> t:g(List) end).
{3842,ok}
11> timer:tc(fun() -> t:o(List) end).
{8475,
 [2,4,6,8,10,12,14,16,18,20,22,24,26,28,30,32,34,36,38,40,42,
  44,46,48,50,52,54|...]}

From one side it does not seem to be a big deal, as we're not operating with large lists, however in overall I don't see why to prefer the lists:foreach here, as it's slower and the readability related questions seems to be a matter of personal taste.. E.g. I would prefer foreach if the lambda function is not a one-liner..

@oltarasenko, @tsloughter  I will close this PR. Thanks.

Hey @vkatsuba

It's better not to generate list during the performance comparisons
I think the difference you see is related to the fact that the first test is printing results. Try this instead:

15> timer:tc(fun() -> _ = [X || X <- List], ok end).
{402181,ok}```

Hi @oltarasenko. Yep, that's right. Thanks.


Add force flag to bypass prompt on prune cmd

This commit adds the flag --force on prune command to bypass confirmation prompt.
Signed-off-by: Stavros Panakakis<EMAIL_ADDRESS>

thx @Stavrospanakakis ! keep em coming! :muscle:


feat: Run post-initialization method at the first server tick

Motivation
Certain features of CloudNet react to services updating and thus changing their state to "Running". In the current implementation, this update happens at the time the bridge module/plugin/extension is enabled. This timing is not ideal as a lot of time-consuming tasks, like generating or loading the worlds/dimensions and other modules/plugins/extensions may happen after that. This causes the other components, like the signs module or the NPCs module, to report those services as being already online and ready to join by players, whilst the opposite is actually the case.
Modification
All currently supported server software platform integrations are augmented, so that PlatformBridgeManagement#postInit is called in the first game tick. This tick is only called, once the server is actually initialized, loaded and running. This also means that the server is ready to accept players.
Result
Amongst other things, signs now show the server for joining only, once the server is actually ready to accept players.
Testing
This change has been successfully tested with servers running Paper, Fabric and Limbo.

The forced push fixes an issue where the method reference used as a Runnable is not removed from the list of tickable tasks in Fabric.

It is guaranteed that no player can join before the first server tick happens right? Because otherwise this might cause issues with fallbacks and some of our login checks

Or set a flag that denies all logins before the logic happens, which in turn also removes the flag. Would work on all platforms, no issues


All videos +15min length, pause randomly when playing on background (on android 11?)

The Issue
User has reported videos randomly pausing for every video which is at least 15 mins long.
Happens when app is on the background.
Doesn't matter if screen on/off
Doesn't matter if charging or not
Doesn't matter if floating mini player is on/off
Had stable and strong WIFI connection
"Enable background playback" and  "Keep the LBRY service running in the background..." are enabled
Didn't happen with any other app
User's device: Pixel 4A Android 11
I couldn't reproduce on android 10.
Link to the original issue: https://www.reddit.com/r/lbry/comments/om7eqh/lbry_keep_pausing_during_background_play/
Internal Use
Acceptance Criteria

Definition of Done

[ ]  Tested against acceptance criteria
[ ] Tested against the assumptions of the user story
[ ] The project builds without errors
[ ] Unit tests are written and passing
[ ] Tests on devices/browsers listed in the issue have passed
[ ] QA performed & issues resolved
[ ] Refactoring completed
[ ] Any configuration or build changes documented
[ ] Documentation updated
[ ] Peer Code Review performed

Perhaps its related to battery optimizatuon feature?
Exclude the app from it and see IF helps

The user said that was turned off. We think it may be related to Android 11.

LBRY Android/FDroid version?

LBRY android, installed from Playstore

Hello I'm the user who reported this issue. I can confirm that all the details keikari reported are correct. I'd be happy to help in any way I can

LBRY android, installed from Playstore

Latest one?

Yes, latest version.

I have experienced the exact same behaviour, on a Razer Phone 1 running Android 9 (Pie). That same phone is now running LineageOS 11, experiencing the same issue. I've been able to reproduce the behaviour from both the Play Store and F-Droid versions of the app.
One thing I will add too is that if a video was running via picture-in-picture, and I check back to find it has stopped playing, I find the floating window is showing the LBRY splash screen where the video would be. Maximising the window seems to make the app start up again and (usually) starts playing the video again from the same place it stopped.

Another report of this on Odysee app with:

Battery optimization disabled
Pixel 4A Android 11
Samsung Galaxy S9 with Android 10

This bug is independent of the Android version, as it is also reproduced on my device running Android 8.1.
Furthermore, problem only appears when app is not on picture-in-picture mode


Task - Admin - Status filter and search by title

Description
Depends on #2190 and #2189
Now that we're starting to have lots of job posters AND demo accounts are creating many more all the time, we need some new ways to sort/filter job posters.
Please make these changes to the table display of job posters:
Page: JobPosterCrudController.php

[ ] Allow filter by Status.

Add a dropdown or select2_multiple filter.

[x] change search to ONLY search English and French job poster "Title".

Add function to 'searchLogic` attibute to title column.

#2273 will resolve the sort/search.

"Allow filter by Status" is resolved by #2189


[PyTorch] Remove implicit padding and unpadding in GroupedLinear

Description
This PR removes implicit padding and unpadding in GroupedLinear to:

Match other layers (Linear/LayerNormLinear/LayerNormMLP) that throw an error when dims are not supported for FP8 GEMM, instead of doing implicit padding.
Avoid redundant padding/unpadding between multiple GroupedLinear layers. Users can do the padding and unpadding manually before and after the whole module if needed.

Type of change

[ ] Documentation change (change only to the documentation, either a fix or a new content)
[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Infra/Build change
[ ] Code refractor

Changes
Please list the changes introduced in this PR:

Remove implicit padding and unpadding in GroupedLinear

Checklist:

[ ] I have read and followed the contributing guidelines
[ ] The functionality is complete
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes

@phu0ngng Could you please take a look? This should be a minor fix. Thank you very much.

/te-ci pytorch


WIP: Transition to TypeScript

This is a great start! Appreciate you diving in so quickly :)

Just noting, this PR tracks issue #5

Thanks again for getting this going! Let's move forward with TS conversion file-by-file so we can continue making other improvements at the same time 👍 this PR will be a great reference as we do that


Updating Message Samples + MultiPoint

Updating message samples for planned events and icone datasets
Using geometry type "MultiPoint" for events without enhanced geometry

What are the files under experimental/prod_experimental_diff_20230522-140004/ used for?

What are the files under experimental/prod_experimental_diff_20230522-140004/ used for?

Those are an example a planned event being modified by the experimental_combination/icone script. The diff file shows exactly what was modified by the combination script, and the others are raw values for each input/output. I can add a README here to describe it

What are the files under experimental/prod_experimental_diff_20230522-140004/ used for?

Those are an example a planned event being modified by the experimental_combination/icone script. The diff file shows exactly what was modified by the combination script, and the others are raw values for each input/output. I can add a README here to describe it

Ah, yeah let's get a README in there, this is definitely useful addition

What are the files under experimental/prod_experimental_diff_20230522-140004/ used for?

Those are an example a planned event being modified by the experimental_combination/icone script. The diff file shows exactly what was modified by the combination script, and the others are raw values for each input/output. I can add a README here to describe it

Ah, yeah let's get a README in there, this is definitely useful addition

Just pushed this new README!


Update composer.json

Use laravel 5.5.* rather than 5.5.x-dev to avoid conflict with official laravel release.

duplicated


[header] Add ml-api-experimental.h header file

Add the header file consists of experimental APIs which would be included as regular APIs in future releases.

:memo: TAOS-CI Version: 1.5.20200925. Thank you for submitting PR #399. Please a submit 1commit/1PR (one commit per one PR) policy to get comments quickly from reviewers. Your PR must pass all verificiation processes of cibot before starting a review process from reviewers. If you are new member to join this project, please read manuals in documentation folder and wiki page. In order to monitor a progress status of your PR in more detail, visit http://ci.nnstreamer.ai/.


Update installation instructions for Alpine Linux

Coverage decreased (-0.1%) to 98.274% when pulling e9b7207819dc580cb8813bcf426f192a4a976c15 on julianklotz:patch-1 into 5692bdf8dac3581a0d5fb3c5aeb29be0ab6a54fc on python-xmp-toolkit:master.


Old react-router 0.13.x - be more React 15 targeted

Hello, I hope the title do not scary you to much. :)
I our app we still use old React Router 0.13. We recently upgrade React from 0.14 do 15. Hope we can soon try update React-router as well (and React go up to 16) but it is hard upgade whole big apps so quickly I would wish.
When we test out app with Jest, we receive a lot of typical React 15 post update warning (do not call React.createClass and use the package, do not call React.PropTypes and use the package atc).
The changes to solve warning are not big: https://github.com/natocTo/react-router/commit/b132c7715a704e2e78d377444185f2fc79444b06
There was just one problem with test "scrollTop", the y was not precisely 50. Do you have any clue why?
Maybe is to late to update so old library, is not it? But if it could be released as 0.14 I would have much better day. :)
The PR could not be sent because 0.13 is only tag and not branche.
Summary - proposal changes

peerDependencies - react - ^15.5.0 only
use "create-react-class" lib instead of "React.createClass"
use "prop-types" lib insteaf of "React.PropTypes"
remove "react-addons-test-utils" and use "react-dom/test-utils"
instead of "React.DOM.a" use "React.createElement('e')"

BTW: Congrats to version 5. 👍

So it look like it will not so easy. :/

Yeah, we don't maintain anything less than 3 (and not even 3 really) anymore. If you really need to stick with the version, I would recommend forking it and making local modifications.


All eager will converted into naiveEager when use mergeNaiveEager

Hi, is it possible to make only one relation that doing naive eager loading?
In my case I would use something like this
Job.query().
      .eager('[ \
        users(active) \
      ]')
      .mergeNaiveEager(mailing_lists(sortLatestVisit)')
      .modifyEager('mailing_lists(sortLatestVisit)', builder => builder.limit(100))

When I run the debug mode in that query, All of the eager relation is querying just like the naiveEager. I just want to make only one relation to querying like that. because the data is pretty big, and my server sometimes crash because of out of memory. I just read the docs and didn't found anything to help me. Thank you!

Unfortunately you cannot mix eager types. This API will be cleaner in 2.0.


[protocol] signData should return Result type

Expected Behavior
Return Result and handle it properly
Current Behavior
Returns a promise

Refactored, irrelevant


Update Shelly-Minimal_water_heating.js

some comments

Most changes will be taken in next merge.  But at least now I dont' want to make timer loop configurable as such.  That is to balance load on API calls when hour changes.


Fix Typha expected number of connections calculation.

Description

Do a once-and-for-all fix by passing the actual number of syncers.
Related issues/PRs

Fixes #5629
Todos

[ ] Tests
[ ] Documentation
[ ] Release note

Release Note

Fix that Typha would periodically disconnect clients in clusters with more than 100 nodes per Typha due to miscalculating the expected number of connections.

/merge-when-ready

OK, I will merge the pull request when it's ready, leave the commits as is when I merge it, and leave the branch after I've merged it.


replace all occurrences of migration class

Class was replaced only in definition of migration class.
In testGenerateDefaultMigration classname used in error message (https://github.com/yiisoft/yii2/blob/31cf978f385b1ffb16aaf3ff04175d5b65922948/tests/framework/console/controllers/MigrateControllerTestTrait.php#L188), so sometimes this test failed: https://travis-ci.org/quantum13/yii2/jobs/111687879

Thank you!


Allow searching datasets by bucket name

Scenario
I would like to be able to search for datasets by bucket name. When I find code that is using the same data that I want to use I don't have any references to data.all registration, but I do have a bucket name.
Solution
When searching datasets, if I provide the exact name of an s3 bucket used by a dataset I would like the search to return that, and only that, dataset.
I think that fuzzy matching or prefix matching might be a desirable extension to this. However those options should have a switch for administrators to disable, should the administrators wish to obfuscate their bucket naming schemes.

This is a very cool feature! Thanks @clayreimann for opening an issue. Do you have bandwidth to work on it? I believe it is a good first issue. Otherwise we can pick it up


[WIP] Fixes TileBrush transform handling

What does the pull request do?

What is the current behavior?

What is the updated/expected behavior with this PR?

How was the solution implemented (if it's not obvious)?

Checklist

[x] Added unit tests (if possible)?
[ ] Added XML documentation to any related classes?
[ ] Consider submitting a PR to https://github.com/AvaloniaUI/avalonia-docs with user documentation

Breaking changes

Obsoletions / Deprecations

Fixed issues

I went to see if maybe this PR also fixes https://github.com/AvaloniaUI/Avalonia/issues/11959 (unfortunately doesn't look like)
But additionally, it renders incorrectly again: before the commit More adjustments

(might be related to my screen dpi?)
After the commit the grid is completely gone:

Looks like there is no test coverage here. Can you provide me the brush definition that isn't working?

<DrawingBrush TileMode="Tile"
              DestinationRect="0 0 15 15">
    <DrawingBrush.Drawing>
        <GeometryDrawing Geometry="M0,0 L0,1 0.03,1 0.03,0.03 1,0.03 1,0 Z"
                         Brush="Red" />
    </DrawingBrush.Drawing>
</DrawingBrush>

even with no transform attached. It is completely blank after the latest commit. But it might be due to my screen scaling (macbook retina x2 scaling).

The PR currently does not handle all Stretch modes that might cause this. Thanks for the sample.


RFC: Override NRCS Data in the Sofie GUI

About me
This RFC is posted by SuperFly.tv on behalf of the BBC.
Use case
Background
Traditionally, the end users have not been able to modify or override any aspects of the rundown data. On behalf of the BBC, SuperFly.tv would like to add the ability for the GUI to modify aspects of the data coming from the NRCS. The initial set of features that we would like to add to Sofie can be described by the following four use cases, but we believe these need to be discussed with vested parties in order to find an optimal implementation strategy.
For this discussion, the term "override" will be used to indicate any data that doesn't have it's origin in the NRCS.
Use Case 1 – Editing Piece/Part/Segment Parameters
As a user I want to be able to interact with pieces/parts/segments in the GUI and override the following parameters:

Source Layer parameters

Timing parameters:

Start or end (the piece boundaries, editable by grabbing and dragging handles on either end of the piece).

Both start and end at the same time (preferably with a drag handle on the actual pieces).

In/out (for VT's and other types where the piece boundaries might not be identical to the content's in/outpoints). One UX idea here is to be able to set in/out point of a VT by marking them while hover-scrubbing.

Source Layer type (example: from a Camera to an AUX)

Mapping (example: Change Camera 1 to Camera 3). For certain types such as VTs, this will need to include a browser with search and filtering of some sort.

Setting the piece as one of Sofie's infinite types.

Deletion of a piece and possible even a part or segment.

Move piece to another part (either within the same segment, or freely using drag-handle).

The GUI for this will most likely be handles on the pieces in the views, in combination with some sort of Inspector panel that should probably live in the right Side Bar.
Upon push of MOS data from NRCS (e.g. due to the user saving the story) GUI-modified pieces and parts should revert to the NRCS version.
Options per source layer type should be configured via blueprints and be customisable per part / piece.
Use Case 1-specific Discussion Points

How does Sofie connect to and display the sources for parameters such as VTs which might be a list of thousands of results?

Should it be possible to multi-select and edit parameters of multiple items at once?

The current model for the Sofie GUI interaction is that you can't really change anything, so how do we avoid that a user inadvertently changes order and placement of pieces just by scrolling or moving the cursor of the GUI?

Could Duplication be a useful operation?

Use Case 2 – Locking Pieces/Parts/Segments
As a user I want to be able to prevent NRCS updates to selected pieces/parts/segments.
Where updates have been made to pieces or parts by manipulating them on the GUI, they should revert to the NRCS version upon a push of MOS data. This is desired behaviour, except sometimes during busy moments where the Sofie operator may have updated elements on the GUI, whilst the journalist is also resaving presenter scripts. We need a way for the operator to 'lock this element from NRCS update' and in doing this for the locked piece, part or segment to hold it's new/updated status, and to not revert to reflect the NRCS page upon a push of MOS data.
Locked items need to have their locked status displayed somehow, and their lock state needs to be editable in the GUI, most likely via the aforementioned Inspector panel.
Use Case 2-specific Discussion Points

Should it be possible to multi-select items to be locked/unlocked?

Use Case 3 – Create Pieces from MOS Plugin
As a user I want to be able to add a new piece in a Sofie playlist/rundown by dragging it from a MOS-plugin directly into the Sofie GUI.
Use Case 3-specific Discussion Points

As the GUI needs to give the user a good understanding of where the new piece will be created -- possibly including giving a preview of the duration of the new piece influences the existing parts.

Just like with the other use cases; how are updates from the NRCS handled when the segment is floated/unfloated?

Should it be possible to create new parts and/or segments, or only to add to an existing part?

What about replacing one piece with the new piece? If that is possible, are there any parameters of the old piece that should be retained, for example duration?

General Override Discussion Points

Where would these overrides be stored in Sofie, and how would the data model need to be changed?

What current assumptions in Sofie need to be revisited if we abandon the "NRCS is King" model?

Could overrides be limited to Sofie instances, and could/should we instance the entire playlist? If implemented for only the current and Next part, the implications and development time might be significantly lower.

How are overrides they persisted?

Is write-back to the NRCS something to consider, either short-term or long-term?

Could copy/cut/paste be an alternative to drag-and-drop?

How to handle dragging items where the target is not visible within the current viewport?

Should there be a way for a user to see if any overrides have been applied to a playlist? If so, would that be shown in the Lobby view, too?

How does a user cancel/remove all overrides to go back to a playlist that reflects only the data originating from the NRCS?

Proposal
We would like to initiate a discussion around these topics in order to be able to assess the amount of work required.
Process
The Sofie Team will evaluate this RFC and open up a discussion about it, usually within a week.

[x] RFC created
[ ] Sofie Team has evaluated the RFC
[ ] A workshop has been planned
[ ] RFC has been discussed in a workshop
[ ] A conclusion has been reached, see comments in thread

Thank you for submitting this RFC!
(If you haven’t already, please give our contribution guidelines a read.)
The Sofie Team thinks that this is a very interesting idea, it is something we've been discussing  internally before as well.
This type of change would likely affect a fairly large chunk of the ingest logic in Sofie, therefore we think that several workshops would be needed to make an implementation plan, to ensure we come up with something that works well and is  sustainable.
We propose a first workshop on Monday, January 22nd at 14:00 CET (13:00 GMT), where we can discuss the use cases and possible solutions.
Agenda, Workshop 1

Presentation of the RFC from BBC
Outlining of use cases
Discuss the use cases, ideate other use cases and potential edge cases/pitfalls.

Which would be required initially?
Which would be optional / for the future?

Initial (short) discussion of possible architectural solutions.
Planning of next workshop

If anyone else wishes to join the workshop, pleas email me at<EMAIL_ADDRESS>

Great to finally see our brand name in lights @hummelstrand - it's been a long-time coming (thinking back to those open CasparCG sessions in Birmingham and London in the previous decade!)

Hi - just joining this thread. Great meeting today, thanks all.

Meeting notes, Workshop January 22nd
Use cases
We discussed and listed various possible use cases
Editing Pieces

Change Piece from camera 1 to camera 2 (no side effects)
Change Piece from camera 1 to camera 2 (side effects)
Where the change has side effects on other Pieces, eg a studio light and mic is ON when on camera 2.
Change Piece from camera 1 to OS (“outside source”) 2
Side effect: mics
re-timing (or remove) a gfx Piece in a Part

using a MOS plugin
using dragging of the Piece in Sofie GUI

Trimming VT in/out points
Replace a VT with another
The new VT Piece should automatically get new timings according to the new VT.
Update spelling in a gfx
(possibly using a MOS plugin?)

Editing Parts

Move a Piece from a Part into another Part
Does this change things about the piece? I.e. is it also editing pieces?
Change Part from camera 1 to Full VT
Lock the (edited) contents of a Part from NRCS updates

Protect from changes
Protect from deletions

Moving a Part within a rundown
Changing a clip from a “package”/VT to “voice-over”
Side effect: mic levels
Delete a Part (and un-delete a previously deleted Part)
Make a Part “invalid”
(this is useful in order to skip a Part)

Creating new content

Insert/Create a new Part from “nothing” or “something”

Create a Part from a “piece” or mos-object (dragging in from NRCS)

Insert/Create a new Piece from “nothing” or “something”
Add/remove/edit Transitions
Add/remove/edit Adlibs

Editing the rundown

Dragging/moving Parts
Move/Add/edit/delete Segments
Add/remove/edit Global Adlibs

Initial Architectural thoughts
A VERY short discussion on possible solutions.
“Editing the Next PartInstance”
Easy implementation, but very limited useability, might be a short term solution?
“Instantiate the whole Rundown as PartInstances”
Hard to envision how it could work? Likely a dead end?
“Add manipulation stage(s) to the ingest data flow”
A large addition to the data flow.
Significant effort needed in implementing this, but possibly doable.
“Rework the ingest data flow to have fine grained reactions to every NRCS update”
A complete change in how we take in updates.
Significant effort needed in implementing this, but possibly doable.
“Write back changes to the NRCS”
Keeps the "single source of truth".
Likely to be a problem with some NRCSes that don't support write-back.
Other notes from the discussions

It should be possible to define “editing rules”, eg “user should not be able to change a cam1 to a VT”.
It would be good to define what is the scope of this work, to have a stopping poind and avoid feature creep.

Next workshop
Another workshop is planned for Monday, January 29th at 14:00 CET (13:00 GMT).
In preparation for next workshop
BBC and NRK will rank the use cases from blocker → important → later → not important
Agenda:

Architectural discussions
Relate solutions to use cases

If anyone else wishes to join the series of workshops, please email me at<EMAIL_ADDRESS>

Meeting notes, Workshop January 29th
Use case prioritizations
BBC's priorities are

Most important:

cases related to changing properties of Pieces (ie cam 1 to cam 3)
cases rekated to changing the type of Story (ie change a VT with full audio to "No audio"
Disable/Remove a gfx Piece

Nice-to-have

Update spelling in a gfx (eg using mos plugin)
change timing a gfx Piece

It was noted that side-effects (ie a mic fader changes due to a changed camera) are likely to happen in all relevant use cases.
MOS Plugin
Discussion on the subject of MOS Plugin support in Sofie to edit for example gfx Pieces.

Because the gfx Piece content is defined by the gfx system, it will be hard/unsafe to edit it directly in Sofie.
One solution could be for Sofie to support loading a MOS Plugin in an iframe which is used to edit the gfx Piece. The mos-protocol API for MOS Plugins (using iframe postMessage) could be used for this.
We should probably support both editing a Piece by using an internal inspector and/or a MOS Plugin to edit data.
Question: When implementing the inspector, what should the inputs support? Uploading images? Food for thought.

Implementation options
We discussed briefly the options brought up last week.
The two options

“Add manipulation stage(s) to the ingest data flow”
“Rework the ingest data flow to have fine grained reactions to every NRCS update”

seems to be the most feasible to continue thinking about. The other options where discarded.
Technical workshop
We concluded that the next step is to have an in-depth technical workshop on designing the architectural structures.
Questions to be answered by the technical workshop:

Does the proposed solution support all of the above mentioned use cases?
Can the proposed solution be implented in stages?
How small can an initial implementation be for a PoC or MVP?

The technical workshop will be held this week, joined by @nytamin, @PeterC89, @Julusian, @mint-dewit and @jstarpl .
Next workshop
Another workshop is planned for Monday, February 5th at 14:00 CET (13:00 GMT), have been sent to previous participants.
Agenda:

Presentation of the technical workshop
Implementation plan?

If anyone else wishes to join the series of workshops, please email me at<EMAIL_ADDRESS>

Note: The next workshop is moved to Thursday, February 8th at 14:00 CET (13:00 GMT).
If anyone else wishes to join the series of workshops, please email me at<EMAIL_ADDRESS>

Meeting notes, Workshop February 8th
Presentation from the technical workshop group
A series of technical workshops have been held during the past week, which have resulted in the following proposal (presented by @mint and @Julusian on behalf of BBC).
How Sofie works right now

INGEST STAGE
a. Data from NRCS is sent into Sofie Core via MOS Gateway (or another ingest gateway)
b. Sofie Core maintains a copy of the (NRCS) ingestRundown and applies MOS upates onto it.
c. Blueprints transforms the ingestRundown into Segments, Parts & Pieces.
PLAYOUT STAGE
a. Sofie Core: Play Parts and Pieces, using PartInstances & PieceInstances & generate the Timeline
b. Playout Gateway: Executes the Timeline

Our proposal
We propose to add a second stage on the ingest side, and add a new Blueprint method which can selectively choose how to update the SourceData, using the NRCS IngestRundown and user-edit-action as input.

INGEST STAGE
a. Data from NRCS is sent into Sofie Core via MOS Gateway (or another ingest gateway)
b. Sofie Core maintains a copy of the (NRCS) ingestRundown and applies MOS upates onto it.
c. Sofie Core maintains SourceData in the DB
d. Blueprints updates the SourceData selectively, using the ingestRundown and user-edit-action results as input.
CONTENT STAGE
a. Blueprints transforms the SourceData into Segments, Parts & Pieces.
PLAYOUT STAGE
a. Sofie Core: Play Parts and Pieces, using PartInstances & PieceInstances & generate the Timeline
b. Playout Gateway: Executes the Timeline

Note: The SourceData has the same type definition as the previous IngestRundown, so it'll be backwards compatible with Blueprints.
With this proposal, the Blueprints will now have full control of the rundown data and have the ability to e.g. split stories into segments, reject updates or insert data freely.
This change will be backwards compatible, as there can be implemented a simple fallback blueprint method with the functionality of simply "accept all data from the NRCS, and split stories into segments using the ";" delimiter".
Blueprint helpers
In order to make it easier to write blueprints, we propose that we eventually add a few "helper function", to be used by the blueprints for common operations such as "basic editing of properties", "move a Part", "invert change/undo/redo". Not needed initially though.
User Actions
Blueprints will now be able to define user-edit-action manifests on Parts and Pieces, allowing the Sofie GUI to provide the user with editing capabilities to match.
The exact types of user-edit-actions and their UX is not handled in this RFC, but some potental ones are:

Edit propterties in a web form (defined by a schema)
Display a MOS Plugin to edit something
Display drag-handlers to be able to drag Pieces, or Parts
Drop MOS objects into the GUI to insert Parts/Pieces

When a user makes an user-edit-action, the result is sent into 1.d step above, and so the Part will be regenerated downstream.
Future

After this change, we could potentially replace the blueprint.getSegment with a blueprint.getPart instead. Allowing for a finer update granularity, resulting in better performance.

Questions

Q: Does this mean that we could potentially have more than one data source to generate the Rundowns from?
A: Yes, that could be a natural continuation after this has been implemented.
Q: So how would the default helper functions work? How do we decide what is a default functionality?
A: We'll begin by implementing it all in blueprints-only to begin with. Then, when we've gathered knowledge and proven the concepts, we'll start looking into moving the some of the blueprint code into Sofie Core functionality and exposing it as "helper functions".
Q: How would Mos active/inactive (and reloading NRCS data) work?
A: It would be possible to distinguish between changed data vs just a reload (for example by using modified timestamp), so the blueprints would be able to intelligently handle this situation.
Q: Should the blueprints be able to reject a "removed rundown" input?
A: Yeah, probably. That would be a good use  case to take into account.

Next steps
We consider the discussions on this RFC to be concluded for now.
If anyone else have any opinions or questions regarding this, feel free to post questions in this thread, or contact me at<EMAIL_ADDRESS>

The proposed GUI for this functionality will be developed in stages, with a Properties panel being the first step, and direct piece/part/segment manipulation (i.e. drag-and-drop and similar interactions) at a later stage.
We're intending to implement it as an extended Sidebar panel where all sourceLayer properties can be displayed/edited.

This branch has the basic proposed implementation:
https://github.com/bbc/sofie-core/tree/feat/blueprint-processIngestData

Thanks for the update!
Let's set up another workshop, where you can present your current plans and we can have a discussion regarding the GUI side of things.
I propose that we have the workshop Wednesday, October 23rd at 13:00 CEST, I'll send calendar invites.
If anyone else wishes to join the workshop, please email me at<EMAIL_ADDRESS>

I suggest we open up a new RFC for the UI/UX of the Overrides.

Closing this RFC as concluded. This will be handled in the PR https://github.com/nrkno/sofie-core/pull/1293


Send Message with a fake e-mail address

Issue Description
Hi;
i wanted to know if it's possible to send phishing email with a fake e-mail address
ex: send email with<EMAIL_ADDRESS>and a fake email address<EMAIL_ADDRESS>will appear on email  ( to test users attention )
if it's possible please tell me how to do it with KP

Yes it is possible, just change the corresponding fields and hope it doesn't get picked off as spam.

i've change the corresponding fields ( SMTP, MIME)  but the original ( gmail ) email address appear and not the fake email , is there any solution for this ??


Fonts not working

i am fairly new to this so changing the fonts inside fonts.ts is not really changing the fonts for my environment
i have tried to set it directly inside the layout.tsx directly but it still does not work that properly.

in tailwind.config.js, you need to extend the fontFamily in tailwind.config.js.
  theme: {
    extend: {
      fontFamily: {
        sans: ["var(--font-sans)"],
        mono: ["var(--font-geist-mono)"],
      },
    },
  },


(major) Restrict number of newlines

zero padding newlines at top of file
zero padding newlines at bottom of file
disallow multiple consecutive newlines in file

This will require a major version bump.

approved assuming this doesn't impede the requirement to have a newline at the end of a file

In my tests it did not. I think it's zero empty lines at the end of the file, where a newline character is attached to the line previous.

approved

approved


Change editor's size

Resolves #1.
This time it should work perfectly :)
Screenshot:

Thank you for your help :)

No problem :) i learnt how this stuff works because i didn't really look into django before. was fun ^.^


pretrained model serving

I'm wondering if there is an intention to serve pretrained models directly through the API? It seems to me readily available pretrained models (eg large-scale trained molecular representation models) would be of great utility for many users and generally reduce waste.
See the huggingface transformers library as an example. There is vast demand for this type of interface...

Hi! Yes, we are considering this as a part of our future release. May I know what pretrained models you would prefer to have?

I'm not an expert in this field but I work adjacent to it. So I don't have a great grasp on SOTA models that would serve folks best. Papers with code has a drug discovery task leaderboard.
I think any reasonably well-benchmarked models trained on the largest datasets available would provide the most utility. Then again there are other non-graph based representation learning models that work quite well. Would be happy to continue the conversation.

Thanks! The leaderboard seems to be a good place to find SOTA models.
We would probably start from existing pretraining models in this platform, try to pretrain them on large datasets, and then move on to newer models.

I think that is a good place to start. It would be interesting and useful to get a benchmark going with the models right here. I would be interested to see the effect of dataset & model scaling for the available methods. I'm sure some of the methods have done these experiments but nonetheless in this new era of pretrained models it is useful information.

Hi!  Any updates in this regard?