storage: measure the read duration for scheduler commands

What is changed and how it works?

Issue Number: ref #12362
What's Changed:

This commit measures the read duration spent on reading (e.g. write
conflict checks). This fixes the missing part of scheduler commands
and may help diagnosis when scheduler reading takes a long time.

This commit also changes some now_coarse to now. now_coarse
has a precision of 10ms on many systems, so it may not meet our
precision requirement. Instant::now is fast enough to be called in
these cases.

Under Scheduler - *

Check List
Tests

Manual test (add detailed scripts or steps below)

Release note
None

/merge


data drop / fifo overrun

Are there any plans to offer any thing like just latching in the last value on the ports, or somewhat equivalently, a FIFO that replaces the oldest value when it overflows?
Would be useful when you are processing data live. The specific use case I'm looking at is using it to prototype opencv filters.

There are actually. This is similar to the leaky fifo issue. There is an implementation of the fifo interface already there tray will do most of what we want. It was created a long time ago for testing. Needs to be dusted off and to have hooks added to the allocator factories.
Will push that higher in the work queue unless you would like to volunteer? I'm happy to hand out member keys to commit to the project.
-Jonathan
Sent from my tiny screen, powered by ARM awesomeness.

On Mar 12, 2017, at 05:02, jdavidberger<EMAIL_ADDRESS>wrote:
Are there any plans to offer any thing like just latching in the last value on the ports, or somewhat equivalently, a FIFO that replaces the oldest value when it overflows?
Would be useful when you are processing data live. The specific use case I'm looking at is using it to prototype opencv filters.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

I looked into some of the code that was there and wasn't sure what the intention was for some of that.
Are you thinking this should be a run-time parameter you can set on the FIFO -- something like setOverflowBehavior -- or as a separate implementation type entirely put in the const_map for port_info?

If you check out the dev branch, the intention would be to set a stream modifier for the indented behavior for that link. I'm rebuilding the template parser at the moment. The code is largely there. Need to fill in the templates. Basically I've ended up making a DSL using the templates to express graphs. I realized the previous parser had a few extensibility limitations so I spent some time making it easier to read and use.
For the behavior you describe raft::manip would likely be the perfect place.
-Jonathan
Sent from my tiny screen, powered by ARM awesomeness.

On Mar 12, 2017, at 16:20, jdavidberger<EMAIL_ADDRESS>wrote:
I looked into some of the code that was there and wasn't sure what the intention was for some of that.
Are you thinking this should be a run-time parameter you can set on the FIFO -- something like setOverflowBehavior -- or as a separate implementation type entirely put in the const_map for port_info?
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or mute the thread.

I checked out dev; seems like a lot is ifdef'ed out for the refactor so I couldn't trace through it while running.
It seems like overrun behavior should be settable on the port and not the kernel. So would the syntax look something like:
M += s["0"] >>  raft::manip< raft::fifo::drop_overrun  >::value >>  l;
to set the fifo to drop overruns for s["0"]?
That seems to imply that this is a run-time settable attribute on the FIFO -- by the time any of the stream operators kick in, the ports are already made -- so would a PR where you can set the behavior directly on the FIFO be helpful until the refactor with more manip functionality is done?

This one will be added into the improved parser over my current vacation :).
I'd rather not create yet another syntax option that would fragment the environment. The only problem with the runtime settable version is creating more than one way of doing things...which isn't a problem in and of itself, but does make it harder for people to learn.


Can see some profile information in my Windows GUI application, but editing within the application updates the website and not the text in the Windows GUI

This is an update on a previous bug I logged, at https://github.com/keybase/client/issues/5090.
Proof: https://i.imgur.com/Aw4I3jg.jpg
As anyone can see, I fixed a spelling and word choice error, and added some grammatical conventions.
This updated alright on the website, but not the Windows GUI. (I also did quit and restart the GUI).
Hoping this can be one of the small improvements to be seen.
Using Windows 10 Pro... (same as the other bug, and I did update today to the latest version.)

Hold up, a RESTART of the machine seems to fix this issue. Maybe something to put in the help documentation, but it may not need any code editing to fix then.


Feature Request | ig goes activated on import statement.

Hi @kristijanhusak!
I was wondering if it would be possible to make <Leader>ig also go to the definition if it's pressed over the include statement.
For example, if I have the cursor somewhere on over import or anywhere on that line and I hit <Leader>ig, it would open the lib file buffer.
imp|ort { MyComponent } from './components/lib'

I introduced passing custom word to the import/goto commands, so this is something you can do yourself. Basically:

Get the current line and parse the word you want to jump to
Execute the command with that word, in this case it would be :JsGotoDefinition lib

@kristijanhusak when I trued something JsGotoDefinition lib it says trailing characters. As if it's not expecting to have an argument. Is this already implemented?

That's odd. Is lib a folder?
What happens if you write down lib into the buffer and try to go to definition in the old way?

That's odd. Is lib a folder?

Nope.

What happens if you write down lib into the buffer and try to go to definition in the old way?

It goes there fine.

I can't reproduce it. Does it happen for some other words?
Also, do you have any more files or folders that are called lib?
I would appreciate if you would debug this. Here are the steps:

Find plugin in your plugins directory, open autoload/jsfileimport.vim, and comment out all lines that are try/catch. So basically line 28, and lines from 61 to 66. Then try to reproduce this. It should give more uglier but detailed error.

I would appreciate if you would debug this.

Anytime. I commented them out, but they were on different lines for me: 58, 106 and 143.
Error is still the same. Nothing changed. I verified that the comments took effect by causing other errors and I see more detailed errors for the other valid errors.
Let me know if you need further debugging.
-Nash

How are the lines different? When did you do an update last time?
Can you test with some other words?

It seems to work after the latest update. Awesome, thanks, I'll figure out how to make it detect import line and go to imported file!

@kristijanhusak how can I call JsGotoDefinition(filename) in vimrc with the context of the current buffer?
The pseudocode for what I'm thinking:
function! LoadImportFileUnderCursor(currentLine)
"parse out the path from currentLine
"assign to somevar
JsGotoDefinition a:somevar
endfunction

Assuming your line looks something like this:
import MyComponent from './components/MyComponent';

Something like this should do the trick:
function! GotoDefinition()
  let current_line = getline('.')
  let matches = matchlist(current_line, '^import \(\w\+\) from .*$')
  if empty(matches)
    return
  endif

  exe 'JsGotoDefinition '.matches[1]
endfunction

nnoremap <Leader>g :call GotoDefinition()<CR>

Haven't tested it though, so adjust accordingly if needed.

Thank you so much! I'll give it a try later.


[Feature] state:modified consider external table column name changes as changes

Describe the feature
Hey, external tables column changes aren't considered as a change when we run:
 dbt ls --select "state:modified"

I believe that this happens because it's a source definition.
Is it possible to include column changes to state:modified for external tables?
Additional context
This is very similar to this issue. The difference is that columns' definition for regular sources can't really break downstream models, unlike columns' definition for external tables' columns.
Who will this benefit?
Anyone who wants to run CI tests, build downstream models each time external tables' columns were changed, and catch a wrong reference problem before production run.

I ran into the same problem. Until this feature is added to DBT, you can use a python script and the module dictdiffer to detect changes in sources. The output of this script can be used for DBT's select arg. This script will also mark a source as modified if only the description changed. While that's fine for me, you may want to design something more elaborate.
import json
import dictdiffer

with open('target/manifest.json') as f:
    target_sources = json.load(f).get('sources', {})
for s in target_sources:
    target_sources[s].pop('created_at', None)

with open('workspace/prod_state/manifest.json') as f:
    prod_sources = json.load(f).get('sources', {})
for s in prod_sources:
    prod_sources[s].pop('created_at', None)

modified_sources = [
    s for s in target_sources
    if bool(next(dictdiffer.diff(prod_sources.get(s, {}), target_sources[s]), False))
]
if modified_sources:
    print("+ ".join(modified_sources)+"+")


ensure token refresh before checking repo validity

Description
Ensure that the bitbucket token is refreshed before using it for checking whether a user has access to a repo (this was buried amongst the rate limit failures)
Also turns out our bitbucket tests had one user using another's workflows, so also added permissions on bitbucket (is not visible in this PR)
Issue
Follow-up on https://github.com/dockstore/dockstore/commit/2bc18666e6e52b6c71d556b7a7e1b4a64a725a9d
Please make sure that you've checked the following before submitting your pull request. Thanks!

[x] Check that you pass the basic style checks and unit tests by running mvn clean install
[x] Ensure that the PR targets the correct branch. Check the milestone or fix version of the ticket.
[x] Follow the existing JPA patterns for queries, using named parameters, to avoid SQL injection
[x] If you are changing dependencies, check the Snyk status check or the dashboard to ensure you are not introducing new high/critical vulnerabilities
[x] Assume that inputs to the API can be malicious, and sanitize and/or check for Denial of Service type values, e.g., massive sizes
[x] Do not serve user-uploaded binary images through the Dockstore API
[x] Ensure that endpoints that only allow privileged access enforce that with the @RolesAllowed annotation
[x] Do not create cookies, although this may change in the future

hmmm, new format for codecov message


Fix bug in Stage Macro when sequence/include_source_columns is defined but it is empty

In the Stage macro the if statement with "is not none" only works if the sequence is not defined at all, so when it is defined and it is empty it will lead to compilation error due to printing "as edwSequence" without an input before.  Using the macro datavault4dbt.is_something() fixes this issue.
Also the if include_source_columns will lead to a compilation error if the parameter is passed as empty. This issue is fixed in the general dispatcher Stage macro.

for me it looks fine, but @tkirschke pls give the final approval


Fix for rename issue

Context: https://docs.gitlab.com/ee/user/project/repository/index.html#what-happens-when-a-repository-path-changes

Fixes https://github.com/xetdata/xethub/issues/3899
The is_repo call was using the existence of branches on a repo as the test. In the case of repo renames, it was following redirects which caused it to return true when the repo had been renamed.
Testing done:

Built a local pyxet using maturin with this change
Confirmed that these two commands worked back-to-back

xet repo rename xet://port8080/Repo xet://port8080/Repo-edited
xet repo rename xet://port8080/Repo-edited xet://port8080/Repo


Feedback for Tableau Embedding API Team based on Tableau Server 2022.3 Release today

Feedback 1 :
In the following web page, we are rendering two visualizations.. Initially, It will render both the visualizations when our web server is up and serving tokens.. However, when our web server is down and failed to send token on web page refresh, there is no token and the first visualization will throw an error like 10084 which is perfectly fine and then second visualization is rendering using previous session cookies that were stored earlier… I think, you might have clear cookies or session tokens on page refresh. As there is no way to control cookies in Javascript for an Iframe as far as I know.
Check following screenshot.. Happy to connect and provide more information on this if required. It would be great, if you could release a some patch fix in Tableau Embedding API.

Feedback 2:
There should be some kind of event or hook to get the HTTP status  code of API request that TableauViz component is sending.. currently, There is no way to get this information due to cross-origin policy of iFrame. As you already have ‘firstinteractive’ hook. Is it possible to add some event to get this status code information ?
Feedback 3 :
It’s okay for developers to see these black screens with error code. But, our customers or users don’t know what they mean.. Either you could provide some fallback component or HTML element or implement feedback 2.. so, developers can handle these error messages differently based on HTTP Status Code.
Feedback 4 :
We are using only single token to render both the visualizations. Sometimes,  one of the visualization will throw “Sign in to Tableau Server”.. If it’s token issue, It should throw for both the visualizations right ? as it is a single session. This is an intermittent issue happen once in a while.  Don’t know why it happens. Same here also, I want my customers or users to see this “Sign in to Tableau Server”… I would handle it differently if we would have “Feedback 2” implemented.

Please consider this feedback.. Let me know, If there is anything I can provide here.
It would be really great,, If you could fix or provide some solutions to all these issues and release a patch version of Tableau Embedding API sooner..

@illonage Closing this issue and created separate issues.


E2E test for non-default namespace

We should add test coverage to ensure we can install the operator in non-default namespaces.

We've had some bugs (e.g. #169) so it would be good to have tests to prevent regressions.

/priority p2


'precision=16' doesn't change GPU memory consumption

Hello,
I'm trying to do FP16 training by enabling 'precision=16' but it doesn't seem to reduce my GPU memory consumption, which is my main goal.
The code I ran was from this article:
https://towardsdatascience.com/from-pytorch-to-pytorch-lightning-a-gentle-introduction-b371b7caaf09
All I did was change the parameter 'precision' to 16/32 to see if there's any difference in memory. I checked the memory consumption via 'nvidia-smi' and there was no difference at all.
I also tried it on a model I have which is a fully connected neural network that takes about 9GB with regular FP32 training and there's no improvement in 'precision=16' (in some cases the memory even increased in FP16 compared to FP32).
I have pytorch 1.6 with native amp. RTX 2080 Ti GPU.
Thanks.

As a random citizen that delved into such matters lately, I see two possible issues:

Following this reply (Nov '19) from PyTorch folk:

If you are checking the used memory via nvidia-smi, note that you might see the cached memory as well.
torch.cuda.memory_allocated() might give you a better number.

16-bit precision utilizes PyTorch's Autocast instead of actual 16-bit precision.  Have a look at this list to see what ops use what precision.
Depending on your model's sizes and ops, this might impact the size reduction you experience.


WFLY-12716 Upgrade Narayana to 5.10.0.Final

https://issues.jboss.org/browse/WFLY-12716
Component upgrade of Narayana
This new release of Narayana resolves 10 miscellaneous issues: https://issues.jboss.org/projects/JBTM/versions/12342779

@tomjenkinson ok with you?

It is. Approved it now, thanks


⚠ ClamAV has degraded performance

In 7e9dd35, ClamAV (https://spamassassin.apache.org/) experienced degraded performance:

HTTP code: 200
Response time: 91 ms

Resolved: ClamAV performance has improved in 5d6112a after 7 minutes.


Finalize Bill of Materials for Frog Sensor Version 1

I believe the BOM is complete now for version one of the sensor. It's located here.


How to enable any kind of debug?

Would you be so kind and update the wiki or documentation about how to enable enough debug to be able to determine why the lib is not working (in my case I try to register for "fielddetection" events from a NVR but get no events ) as expected? I tried setting debug level using:
_LOGGING.setLevel(logging.DEBUG)
but this had no effect at all.

The library will attach to whatever logger you define in your program.  As an example:
logging.basicConfig(filename='out.log', filemode='w', level=logging.DEBUG, format='%(asctime)s - %(levelname)s - %(message)s', datefmt='%m/%d/%Y %I:%M:%S %p')
I will also add a basic usage code example to github.

See here for a full example of usage:
https://github.com/mezz64/pyHik/blob/master/examples/basic_usage.py


puppet: Catch when a comma is left out of puppet_classes.

With two space-separated classes in puppet_classes, the second one
is silently ignored.  With three of more, puppet generates the
following very opaque error message:
Error: Could not parse for environment production: This
Name has no effect. A value was produced and then forgotten (one or
more preceding expressions may have the wrong form)

Catch when this has happened, and give an error message to the user.
Fixes #18992.
Testing plan: Test applied.

Another option is to split on \s*,\s*|\s+ and thus make this just DTRT.  This is the only place that we actually parse the list of values, so it's not like this would make things notably more complex.

I think probably it's better  to be strict than allow a range of formats, since that'll make future automatic transformation easier to manage if we need to do that in the future.  And this is a relatively rare thing to manually configure, so I think this is the right design.
Feel free to merge and backport once CI passes.

Merged and backported to 4.x.  Since the failure mode of two puppet classes is silent, I think it's likely that this will lead to some installs suddenly picking up some classes they intended to have applied, but weren't being, so the upgrade may be slightly more exciting than expected for those folks.


Verification from url doubles the interactions

When I run my verification against a file at a pact-broker url, I see my interaction verifications are being doubled in the output:
docker run --network host pactfoundation/pact-ref-verifier --broker-url http://our-broker-url.com/ --provider-name test-service --provider-version 79585f6 --publish --hostname localhost --port 9090 --state-change-url http://localhost:9090/_pact/provider_states --url http://our-broker-url.com/pacts/provider/test-service/consumer/test-consumer/pact-version/ec2d7c72983e94b6828ab309ec7bb203fa0a3361
Unable to find image 'pactfoundation/pact-ref-verifier:latest' locally

latest: Pulling from pactfoundation/pact-ref-verifier
df9b9388f04a: Pulling fs layer
693c4ebb3692: Pulling fs layer
5a58c549801e: Pulling fs layer

693c4ebb3692: Verifying Checksum
693c4ebb3692: Download complete
5a58c549801e: Verifying Checksum
5a58c549801e: Download complete
df9b9388f04a: Download complete
df9b9388f04a: Pull complete
693c4ebb3692: Pull complete

5a58c549801e: Pull complete
Digest: sha256:67352a82c661afba247dfd4d33293c0beb0df81e28571c30c182366a019ca950
Status: Downloaded newer image for pactfoundation/pact-ref-verifier:latest
  Given all test services have no bugs
  Given test service has no bugs
  Given all test services have no bugs
  Given test service has no bugs

20:30:37 [WARN]

Please note:
We are tracking events anonymously to gather important usage statistics like Pact version and operating system. To disable tracking, set the 'PACT_DO_NOT_TRACK' environment variable to 'true'.

Verifying a pact between test-consumer and test-service

  a request asking if the provider has bugs
    returns a response which
      has status code 200 (OK)
      includes headers
      has a matching body (OK)

  a request asking if test-service has bugs
    returns a response which
      has status code 200 (OK)
      includes headers
      has a matching body (OK)

Verifying a pact between test-consumer and test-service

  a request asking if the provider has bugs
    returns a response which
      has status code 200 (OK)
      includes headers
      has a matching body (OK)

  a request asking if test-service has bugs
    returns a response which
      has status code 200 (OK)
      includes headers
      has a matching body (OK)

This is in contrast to when I run this same contract by using an environment selector, like so:
docker run --network host pactfoundation/pact-ref-verifier --broker-url http://our-broker-url.stage.project44.com/ --provider-name test-service --provider-version 79585f6 --publish --hostname localhost --port 9090 --state-change-url http://localhost:9090/_pact/provider_states --consumer-version-selectors { 'environment': 'master' }
Unable to find image 'pactfoundation/pact-ref-verifier:latest' locally
latest: Pulling from pactfoundation/pact-ref-verifier
df9b9388f04a: Pulling fs layer
693c4ebb3692: Pulling fs layer
5a58c549801e: Pulling fs layer
693c4ebb3692: Verifying Checksum
693c4ebb3692: Download complete
df9b9388f04a: Download complete
df9b9388f04a: Pull complete
693c4ebb3692: Pull complete
5a58c549801e: Verifying Checksum
5a58c549801e: Download complete
5a58c549801e: Pull complete
Digest: sha256:67352a82c661afba247dfd4d33293c0beb0df81e28571c30c182366a019ca950
Status: Downloaded newer image for pactfoundation/pact-ref-verifier:latest
  Given all test services have no bugs
  Given test service has no bugs
20:20:39 [WARN]

Please note:
We are tracking events anonymously to gather important usage statistics like Pact version and operating system. To disable tracking, set the 'PACT_DO_NOT_TRACK' environment variable to 'true'.

The pact at http://our-broker-url.com/pacts/provider/test-service/consumer/test-consumer/pact-version/ec2d7c72983e94b6828ab309ec7bb203fa0a3361 is being verified because the pact content belongs to the consumer versions matching the following criteria:
    * latest version of test-consumer that has a pact with test-service (c3299fd)
    * consumer version(s) currently deployed to master (c3299fd)

Verifying a pact between test-consumer and test-service

  a request asking if the provider has bugs
    returns a response which
      has status code 200 (OK)
      includes headers
      has a matching body (OK)

  a request asking if test-service has bugs
    returns a response which
      has status code 200 (OK)
      includes headers
      has a matching body (OK)

You can confirm that the contract being pulled by the second code snippet is using the same contract url as the first code snippet.

What is the expected behaviour here - that the CLI automatically de-duplicates the pacts?
The reason why it is running two sets of tests, is because you've configured it to both (1) fetch pacts dynamically from the broker (this delegates the contract selection to a remote service) and (2) specifying an exact pact file to verify.

It might be an ordering issue with the provider states.

@jbecker44 can you run docker run --network host pactfoundation/pact-ref-verifier --version on the same host and provide the output?

Actually, I worked out what is happening. The verifier is designed to verify all the sources you give it. You are giving it two, one pointing to the Pact broker and provider --broker-url http://our-broker-url.com/ --provider-name test-service --provider-version 79585f6, this will query the Broker for matching files to verify.
You are also giving it a URL, so it will fetch that and add it to the list of things to verify. It just happens that the URL points to the same file as what the first source is returning.
If you are using the URL option, just remove the --broker-url

Actually, I worked out what is happening. The verifier is designed to verify all the sources you give it. You are giving it two, one pointing to the Pact broker and provider --broker-url http://our-broker-url.com/ --provider-name test-service --provider-version 79585f6, this will query the Broker for matching files to verify.

2 steps ahead of you Ron 👉   https://github.com/pact-foundation/pact-reference/issues/198#issuecomment-1142970477


Moment.js should support HTML5 inputs like datetime-local

Moment.js should support out of the box HTML5 inputs datetime-local, date, time, week, month.
Instead of writing:
<input type="datetime-local" value={start.format('YYYY-MM-DDTHH:mm')} />
<input type="date" value={start.format('YYYY-MM-DD')} />
<input type="time" value={start.format('HH:mm:ss')} />

something like:
<input type="datetime-local" value={start.toHtmlInput_datetime_local()} />
<input type="date" value={start.toHtmlInput_date()} />
<input type="time" value={start.toHtmlInput_time()} />
<input type="week" value={start.toHtmlInput_week()} />
<input type="month" value={start.toHtmlInput_month()} />

=> more explicit, less error-prone (ss vs SS, local vs UTC, yyyy vs YYYY...)
datetime-local expects "yyyy-MM-ddThh:mm" followed by optional ":ss" or ":ss.SSS" format
date expects "yyyy-MM-dd"
time expects "HH:mm", "HH:mm:ss" or "HH:mm:ss.SSS"
week expects "yyyy-Www"
month expects "yyyy-MM"
(taken from error messages given by Chrome 57. Yes Chrome speaks yyyy and dd instead of YYYY and DD, see #1603)

I think the way we've been thinking about these is to create constants of the form moment.DATETIME_LOCAL = "YYYY-MM-DD" and letting you just moment().format(moment.DATETIME_LOCAL). That seems like a good way to help with this without adding a whole bunch of new functions.

I think we can up-for-grabs this one. Those kinds of constants are simple enough.

I like the constants approach better than my original proposition.
Would love to see these constants added to Moment.

Hi, I want to contribute in fixing this issue. This is going to be my first PR. I have forked and setup the project locally. It would be helpful if you guys provide some specific pointers for me to get started.

Is this still open?

@cmdrwebdev yup!


the standard vespa packages should not require 'perf'

@baldersheim please review
@aressem FYI

made a couple of PRs to add perf in base docker images


Genie slide in jelly and scale pop up notification effects

Article checklist
Formatting and structure checks

[x] Have you used the correct folder and file structure? - see Contribution Guidelines

[x] Is your article properly formatted in Markdown? - see Github Markdown guide

[x] Have you used our preferred heading structure? - H3 (###) and up

[x] Does your article follow any of the suggested structure formats? - see example formats

[x] Is your article over 750 words? - Tool: Wordcounter.net

[x] Is the article you are submitting an in-depth and unique article? Does it go beyond what is in the official docs and what is covered in other blog sites. See these articles as examples.

[x] Does your article provide enough value and detail about your topic? - Articles should be clear, accurate, and fully explained.

[x] Can your article be understood by beginners? - Assume the audience is smart but has no prior exposure to the common terminology in your article.

[x] Have you included a hero image that is 600x400 pixels and have the copyright to use it? - Tools: Pixlr Image Editor for resizing and Unsplash for Creative Commons images

Grammar & plagiarism checks

[x] Have you spellchecked and grammar checked your article? - Tools: Write&Improve - ProWritingAid - Grammarly
[x] Please place your article through a 3rd party plagiarism checker. We suggest using Quetext, this tool is free and has a daily limit. We typically accept articles with 10% or less.
[x] Have you checked your article for readability? - Tool: Hemmingway
[x] Have you added sources for quotes and images that aren't yours?

Technical checks

[x] Are your code snippets properly formatted for syntax highlighting - see Syntax guide
[x] Have you checked your code runs correctly and you've highlighted all necessary dependencies for installation?
[x] Are the software programs and packages you're highlighting in your article up to date, using current versions and not deprecated?

Topic suggestion this closes
This closes #3247

@adrianmurage @LinusMuema I have done the revisions, can you check them, please.

Hey @prograte 👋🏽 First things first, welcome to EngEd!
The article is a very interesting read. Good job! Just a few things I'd like to point out:

I noticed that you had a lot of places where you would use the list notation - some info when the content was not necessarily a list. Kindly note that this isn't advisable and we do not expect to see this in future articles from you.
Go through how I've formated your headings and carry this formatting forward with you.

Other than the above-mentioned things, I think this was a great first article! 🥳
When you have completed making the recommended changes kindly @ me.
In case of any question or clarification (currently or in the future), do not hesitate to reach out via Slack or my personal email (adrianmurage21@gmail.com). I am ALWAYS here to help.

Thanks and will surely do if any!!! 🚧

@adrianmurage its done, looks all good

@adrianmurage thanks :rocket: :balloon:

jumping on this one

Please review any edits I may have done to improve future articles and reviews.
@prograte
cc @adrianmurage


Add language change tab

Is your feature request related to a problem? Please describe.
If someone does not know English then he can not use the website.
Describe the solution you'd like
We can add a section on the navbar with some language options and then when user selects a particular language, we can translate the page to that language
Describe alternatives you've considered
No alternatives.
Additional context
No response

@devwasim Please assign me this issue under JWOC if you think the issue is reasonable.

Will keep you updated on the progress.

I want to work on this issue under jwoc

I want to work on this under JWOC

@wasimreja I was testing the feature on a separate page. I am not able to remove the prompt at the top. I used inspect page and tried to hide the class this prompt belongs to with css but could not do it. Any suggestions on how to remove it.

Using google translate API here.

I want to work on this issue under JWOC


unrecognized arguments error

What version of fMRIPrep are you using?
fMRIPrep v20.1.1
What kind of installation are you using? Containers (Singularity, Docker), or "bare-metal"?

Yes, I checked through online BIDS tool.
Did fMRIPrep generate the visual report for this particular subject? If yes, could you share it?

No.
Can you find some traces of the error reported in the visual report (at the bottom) or in crashfiles?
fmriprep: error: unrecognized arguments:
fMRIPrep: Please report errors to https://github.com/poldracklab/fmriprep/issues
Analysis_fmriprep_singleSubj.sh: line 3: --participant-label: command not found
Analysis_fmriprep_singleSubj.sh: line 4: --skip-bids-validation: command not found
Analysis_fmriprep_singleSubj.sh: line 5: --md-only-boilerplate: command not found
Analysis_fmriprep_singleSubj.sh: line 6: --fs-no-reconall: command not found
Analysis_fmriprep_singleSubj.sh: line 7: --no-submm-recon: command not found
Analysis_fmriprep_singleSubj.sh: line 8: --output-spaces: command not found
Analysis_fmriprep_singleSubj.sh: line 9: --ignore: command not found
Analysis_fmriprep_singleSubj.sh: line 10: --random-seed: command not found
Analysis_fmriprep_singleSubj.sh: line 11: --nthreads: command not found
Analysis_fmriprep_singleSubj.sh: line 12: --stop-on-first-crash: command not found
Analysis_fmriprep_singleSubj.sh: line 13: --write-graph: command not found
Analysis_fmriprep_singleSubj.sh: line 14: -w: command not found
Analysis_fmriprep_singleSubj.sh: line 15: --fs-license-file: command not found

Are you reusing previously computed results (e.g., FreeSurfer, Anatomical derivatives, work directory of previous run)?
No

Sorry the label of this post was wrong, in fact it's a question.

Indeed it is, thank you very much for the help!


Manually update dates of albums

Is your feature request related to a problem? Please describe.
I have quite a few albums where the created/changed date is incorrect, due to the files having been moved around several times between drives/SD cards/clouds. Because of this, the album dates mentioned in the app are incorrect, which is very annoying and messing up the order of the albums. I have about 10 years of albums, so it's very tricky to find something at the moment.
Describe the solution you'd like
I'd like to be able to manually change the dates related to an album, independent of the creation dates of the pictures themselves.
Describe alternatives you've considered
I've tried updating the dates of the files with using touch and the file name (IMGyyyymmddhhmmss, etc) in the lespas folder on the server, removing the json files, so they have to be recreated. Sadly, this still messes up some of the dates for some reason.
Additional context
I have been using Lespas for quite some time now, and I really like it, so keep up the good work!

I still prefer the auto detection of album start/end date from it's photos. I understand the frustration you are facing, I believe many others suffer this too. I had do some research before on a way to detect photo taken date from it's name, afterall, many camera manufacturers encode their output using some timestamp scheme, but sadly, there seems no widely agreed way to do it.
Thanks for this issue, I make up my mind to do it in a Les Pas way. I will make a patch in the next release to honor the naming scheme of IMGyyyymmddhhmmss as the photo creation date if the 'taken date' info can't be retrieved from photo's EXIF

Thanks, that patch would help.
Don't get me wrong, I think the automatic timestamp detection is great, but it would be nice to have some override when needed.
By the way, I noticed my pictures have a syntax like yyyymmdd_hhmmss, with sometimes a prefix (like IMG_) and/or suffix (_HDR) added. I think that's the standard for most smartphone cameras.


Warnings generated by units tests

Running unit tests produce the following warnings. In an ideal world, we wouldn't see any warnings:
========================================================================================== warnings summary ==========================================================================================
tests/unit_tests/test_simulator.py::test_make_resources_report
  /usr/local/lib/python3.10/dist-packages/numpy/core/fromnumeric.py:3504: RuntimeWarning: Mean of empty slice.
    return _methods._mean(a, axis=axis, dtype=dtype,

tests/unit_tests/test_simulator.py::test_make_resources_report
  /usr/local/lib/python3.10/dist-packages/numpy/core/_methods.py:129: RuntimeWarning: invalid value encountered in scalar divide
    ret = ret.dtype.type(ret / rcount)

tests/unit_tests/corsika/test_corsika_output_visualize.py::test_kernel_plot_1D_photons
  /workdir/external/simtools/simtools/corsika/corsika_output_visualize.py:238: RuntimeWarning: More than 20 figures have been opened. Figures created through the pyplot interface (`matplotlib.pyplot.figure`) are retained until explicitly closed and may consume too much memory. (To control this warning, see the rcParam `figure.max_open_warning`). Consider using `matplotlib.pyplot.close()`.
    fig, ax = plt.subplots()

tests/unit_tests/utils/test_general.py::test_convert_2D_to_radial_distr
  /workdir/external/simtools/simtools/util/general.py:852: RuntimeWarning: invalid value encountered in scalar divide
    histogram_1D[i_radial] = np.sum(hist_sorted[indices_to_sum]) / weights[i_radial]

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

Some of them are related to the simulated (@orelgueta), some to the corsika output (@VictorBarbosaMartins )

We always had a warning on something deprecated so I didn't notice these new ones. I will fix them (and the deprecated ones).

I agree there should be no warnings being raised in tests. @orelgueta, please let me know when you are done and I will fix the corsika_output part

This is solved in #591. There's a new warning now, but it's the result of a specific version of matplotlib, so I suggest to close this and hope that it is resolved by them soon. If not, we can open a new issue in the future to deal with.


WebAssembly support

First, congrats and thanks for creating such ambitious project!
It seems to me that there is no current effort for supporting JVM -> WebAssembly, which is likely to be the future for gaming/high performance applications on the browser. Do you have any plan to support generating WASM bytecode?

Thanks :)
Actually, i think that lime supports generating emscripten (which is used un both: gdx-backend-jtransc, and jtransc-media). And since it also can generate c++ already, it can for sure generate WASM too using emscripten. But didn't tried yet.

Interesting, thanks ! Based on this tweet, I guess we can also expect WebAssembly support in Haxe when it will support GC (sadly not planned for the MVP).
I know that's not necessarily the curent focus, but do you think it could make sense from a technical POV to generate directly WASM bytecode using Jtransc AST if somebody want to contribute it?

Yeah I think it will happen sometime.
As far as i know it could be pretty complicated/expensive implement a GC on top of that, since you don't have direct access to the call stack. I didn't think too much about this, so maybe there are workarounds. But there is no much documentation about GC on emscripten, asm.js or wasm.
It would be easier to do ARC just as j2objc does: http://j2objc.org/docs/Memory-Management.html
Just marking fields as Weak. That memory management should be compatible with (W)ASM.JS, but it would require extra effort marking fields as Weak, not just the application ones but marking fields in external libraries. Also some libraries could lead to leaks without small modifications.
I think it would be even more useful to just generate LLVM assembly instead of directly WASM, so you can reuse it in other places. Also LLVM allows you to define memory management strategies. And it would work directly with emscripten and allow to benefit from all the LLVM optimizers.

Indeed, on WASM side there is only this documentation about GC.
I also thought about generating LLVM assembly. I saw some limitations mentioned in this LLVM mailing list thread, do you think Jtransc could help to mitigate some of them?

Compiling haxe to c++ and finally to emscripten/asm.js seems to work fine.
Since emscripten can also emit WASM it should be possible to compile haxe to WASM.

I think is could be done already. As far as I know Unity's il2cpp uses boehm GC too and seems to work with emscripten. So with C++ target, we could do this.
I think we can add support for the emscripten toolchain and do some example calling JS like webgl and so.

I'm currently working on integrating bdwgc, but bdwgc is currently broken for emscripten https://github.com/ivmai/bdwgc/issues/163
Running without gc already works but I'm not sure how the interface should look.
E.g.
One mainTarget cpp and the subTarget emscripten?
Special emscripten target?

Yes, the idea is to use subtargets. We can also add defines/macros to subtargets. Actually I would like to change the "subtarget" name to something else. Maybe toolchain? So you have target C++ and toolchain emscripten? ./gradlew distcpp:emscripten or something like that.
I forgot the references:
https://blogs.unity3d.com/es/2015/07/09/il2cpp-internals-garbage-collector-integration/

Also soon will be able to use plain threads here:
https://v8project.blogspot.com.es/2017/06/v8-release-60.html
http://kangax.github.io/compat-table/es2016plus/#test-shared_memory_and_atomics


mssqldb module enhancement

Changelog

Azure SDK for GO

Update from v10.3.1-beta to v11.1.0-beta

mssqldb

Provisioning

Allow to enable TDE

Updating

Allow to change service plan

Test
Provisioning
Covered by lifecycle.
Updating
Test updating service plan with CLI:

create a MSSQL instance with Basic plan

$ go run contrib/cmd/cli/*.go -H localhost -u username -P password provision -sid fb9bc99e-0aa9-11e6-8a8a-000d3a002ed5 -pid 3819fdfa-0aaa-11e6-86f4-000d3a002ed5 --param location=eastus --poll

Provisioning service instance 720ea58a-5dab-4b3b-b40e-2d7b3b689464

.........................

Service instance 720ea58a-5dab-4b3b-b40e-2d7b3b689464 has been successfully provisioned

update the instance with S0 plan

$ go run contrib/cmd/cli/*.go -H localhost -u username -P password update -sid fb9bc99e-0aa9-11e6-8a8a-000d3a002ed5 -pid 2497b7f3-341b-4ac6-82fb-d4a48c005e19 -iid 720ea58a-5dab-4b3b-b40e-2d7b3b689464 --poll

Updating service instance 720ea58a-5dab-4b3b-b40e-2d7b3b689464

............

Service instance 720ea58a-5dab-4b3b-b40e-2d7b3b689464 has been successfully updated

Check the pricing tier on Azure Portal
The pricing tier is S0.

Ps. Is it time to add updating test to lifecycle?

Closed via https://github.com/Azure/open-service-broker-azure/pull/118.


[7.1.0] For second testing

Forked from #488

Cherry-picked in https://github.com/iancha1992/bazel/pull/494


After configured editor.tokenColorCustomizations , editor rolling type perception error

Does this issue occur when all extensions are disabled?: Yes

VS Code Version: 1.94.2(user setup)
OS Version: Windows NT x64 10.0.19045

Steps to Reproduce:
After configured editor.tokenColorCustomizations , editor rolling type perception error
"editor.tokenColorCustomizations": {
    "textMateRules": [
      {
        "scope": ["comment", "constant", "storage", "keyword", "function", "entity.name.type", "entity.name.function"],
        "settings": { "fontStyle": "italic" }
      }
    ]
  }

Gif example

I found that this problem will only occur when the editor is split
https://github.com/user-attachments/assets/f3bb248a-c2fd-4641-bc73-b6ea8a5ee5b9

Unfortunately, without the file that this happens on, I cannot reproduce the bug.


Camera callbacks replaced by the events

based on the discussion here: https://github.com/playcanvas/engine/pull/7151
The callbacks on the CameraComponent:
onPreRender
onPreRenderLayer
onPostRender
onPostRenderLayer
onPreCull
onPostCull

where replaced by matching events fired on Scene to allow multiple subscribes.
The callbacks were removed, and the user get an error when they try to access them, suggesting a replacement.

Please search for @event in the codebase. Generally speaking, the standard format for event name strings in the codebase is all lower case (rather than camel-case). There are instances of name:subname which I'm not averse to in some situations.

The string is used directly.

Maybe we should consider changing it, as that's not consistent with all other constants engine exports that users use.
But that's a separate discussion / PR.

The string is used directly.

Maybe we should consider changing it, as that's not consistent with all other constants engine exports that users use. But that's a separate discussion / PR.

Well, it's consistent with the event documentation at least. 😄  Honestly, take a look.


Map Generation Functions

Created functions for map generation. These include generate_map_info, save_map_info, and load_map_info. save_map_info is called within generate_map_info if the argument save_map is set to True (it is true by default). In save map info, a new directory is created in the user's current working directory called "pyrorl_map_info" where information for different map generations are stored. Each generation is stored in its own subdirectory which is named based off of the map size and percent of the map that is populated. If there are multiple generations where this information is the same, the index at the end is increased for each generation for distinguishing purposes. Within the subdirectory are pickle files for the paths array, populated areas array, paths to pops array, and a list containing the numbers of rows, columns, and percent of the map that is populated. To load in this information, the path to the subdirectory is passed into load_map_info which returns all the information that was saved in save_map_info.

Welcome to Codecov :tada:
Once you merge this PR into your default branch, you're all set! Codecov will compare coverage reports and display results in all future pull requests.
Thanks for integrating Codecov - We've got you covered :open_umbrella:


Pipfile: shell variable assignment from environment variables AND allow defaults

Is your feature request related to a problem? Please describe.
We have wish to have PIP_INDEX_URL default to pypi for our developers on their local machines, but when we run it through our CI we wish to replace the value for PIP_INDEX_URL to point to our private index (corporate).
Describe the solution you'd like
./Pipfile
[[source]]
name = "home"
url = "${PIP_INDEX_URL:-https://pypi.org/simple}"    # Allow shell-like variable assignment
verify_ssl = true

Once a repo is cloned locally by a dev, the isolated python environment can be created by with a simple command:
pipenv install --dev

Within a CI pipeline, the env var PIP_INDEX_URL will be set to the corporate package index and will "just work" as well.
Describe alternatives you've considered
Local developer machine
.env
PIP_INDEX_URL=https://pypi.org/simple

Pipfile
`./Pipfile`
```sh
[[source]]
name = "home"
url = "${PIP_INDEX_URL}"
verify_ssl = true

To install:

pipenv shell

pipenv install --dev

Additional context
Add any other context or screenshots about the feature request here. It may be a good idea to mention that platform and Python version you are on.

Please run $ pipenv --support, and paste the results here. Don't put backticks (`) around it! The output already contains Markdown formatting.
If you're on macOS, run the following:
$ pipenv --support | pbcopy

If you're on Windows, run the following:
> pipenv --support | clip

If you're on Linux, run the following:
$ pipenv --support | xclip

@adriantorrie this issue is pretty old at this point, but latest pipenv has support to read from the pip.conf/pip.ini -- perhaps this would resolve this issue for the time being.


Updated Horreum schema version to 0.2

@andyuk1986 Thanks Anna for this change, Does the schema itself it have any changes? or are we going to do that retroactively for the old datasets?

Hey Kamesh, the schema 0.2 doesn't contain the persistentSessionsEnabled variable, based on which I was filtering data in horreum. I have also updated the result jsons generated singe August 13 to have schema 0.2 version and updated that data in Horreum. So this PR is needed for newly uploads.


Add RSpec

Install RSpec via bin/rails generate rspec:install.
See https://github.com/pulibrary/rails-template/pull/13 for reference.

Question: This currently generates .rspec, spec/rails_helper.rb, and spec/spec_helper.rb, but the original rails-template commit also adds spec/support/system_specs.rb and spec/system/root_spec.rb. Is there an RSpec command for generating spec/support files, or is this something to add/copy over manually?

@taylor-yamashita Yes, spec/support is our local stuff, doesn't come with rspec, so we'll want to bring that over manually. It's in its own commit on that project, https://github.com/pulibrary/rails-template/pull/13/commits/694da5b14f139ac816bf6a98b1dfb95c88239368. Probably the spec/system/root_spec.rb is just so there's something that CI can run. It's probably still nice to have that, if we comment it as like an example that should be changed or removed, so that someone could check CI for their new project.


How do I arrange my SamplePlugin and configure my Dev Plugin Locations to load my plugin without using DevPlugins?

There's a bit of confusion over how to handle this, especially with the json. Might link into https://github.com/goatcorp/SamplePlugin/issues/9.

The JSON should be in the project folder, and there should be no copy directives in the csproj. DalamudPackager 2.1.7 will generate a correct JSON for debug and release builds from that file.


Migrating ExoPlayer to androidx.media3.exoplayer

So effectively Google has killed off ExoPlayer as it currently stands in favor of Media3 now that Media3 has been fully released. Which means now the question would come of should ExoPlayer in this repository effectively be archived (Due to namespace changes and such) and a new repository be setup for Media3 or should it be continued in this repository?
CC: @martijn00
Former issue(s): https://github.com/Baseflow/ExoPlayerXamarin/issues/148

Personally I would prefer if there is a way to migrate media3! If any help of any sort is needed for the same from my end i would love to take up a task!

@martijn00 Since I saw you accepted my PR, did you have a chance to look at this issue yet?

I think Microsoft should really do this, but since they don't have any resources or attention to Xamarin I doubt it is going to happen any time soon. The best thing to do for any .NET MAUI or Xamarin developer would be to move to Flutter. The reason not to do that would be if you have to support legacy apps still on Xamarin.
For Exoplayer users looking to migrate to Media3 the best would off course be a smooth transition. It could be done in this repo I think, to ensure that transition. Any thoughts on how to do it?

I think it could be possible for this repository to migrate to Media3 (Especially since for Microsoft it would essentially take another decade to create this library) however the current NuGet package structure would be invalid in this repository and would not match the one that's now existent in Maven (https://maven.google.com/web/index.html#androidx.media3) which would probably require Baseflow to make new packages on NuGet.
I've already been toying with bindings for Media3 and it seems most of our current Transforms still apply and work after having their namespaces changed.

Ok, lets do it on the branch: media3 that i've just created. If you can PR to that with those changes, I can get the nugets out and everything

Alright, so I've taken a break from migrating this library from ExoPlayer to Media3 for a little bit since (re)opening this issue and having the bindings pretty much sit at 55% completion.
I see Microsoft still has not made that much progress binding up Media3, so I've completed the all of the bindings over here  and they're pretty much ready to merge apart from a few more things to work out.
One of those things would be for how we push this on NuGet, I'd personally propose we make new packages using a new namespace, and then make a new branch of the current 'develop' so we can still release updates for ExoPlayer (MAUI/Xamarin) if need be. Maybe to include the migration guides to Media3 as all classes in ExoPlayer are now marked deprecated (As of 2.19)
I also would personally prefer ruling out any support for Xamarin.Android with Media3 so that ExoPlayer 2.19 is the last version on that regard, while it is technically possible it's much of a hassle for a platform that people should really be moving to MAUI or other frameworks for.
As for the last thing, I've cleaned up the Metadata of all things Media3 and enabled errors for warnings where the metadata is invalid.. Personally I'd prefer if these warnings as errors stayed as it prevents the clutter that our previous Metadata files were having though it can be a bit annoying when porting the bindings to a newer version.

We can use this library now Media3 ExoPlayer SDK for .NET for Android
`
Anjo.Android.Media3.ExoPlayer (>= 1.1.1)
Anjo.Android.Media3.Common (>= 1.1.1)
Anjo.Android.Media3.Container (>= 1.1.1)
Anjo.Android.Media3.Database (>= 1.1.1)
Anjo.Android.Media3.DataSource (>= 1.1.1)
Anjo.Android.Media3.Decoder (>= 1.1.1)
Anjo.Android.Media3.Extractor (>= 1.1.1)
`

We can use this library now Media3 ExoPlayer SDK for .NET for Android
` Anjo.Android.Media3.ExoPlayer (>= 1.1.1) Anjo.Android.Media3.Common (>= 1.1.1) Anjo.Android.Media3.Container (>= 1.1.1) Anjo.Android.Media3.Database (>= 1.1.1) Anjo.Android.Media3.DataSource (>= 1.1.1) Anjo.Android.Media3.Decoder (>= 1.1.1) Anjo.Android.Media3.Extractor (>= 1.1.1)
`

Are you the one who created them?

We can use this library now Media3 ExoPlayer SDK for .NET for Android
[Anjo.Android.Media3.ExoPlayer](https://www.nuget.org/packages/Anjo.Android.Media3.ExoPlayer/) (>= 1.1.1) [Anjo.Android.Media3.Common](https://www.nuget.org/packages/Anjo.Android.Media3.Common/) (>= 1.1.1) [Anjo.Android.Media3.Container](https://www.nuget.org/packages/Anjo.Android.Media3.Container/) (>= 1.1.1) [Anjo.Android.Media3.Database](https://www.nuget.org/packages/Anjo.Android.Media3.Database/) (>= 1.1.1) [Anjo.Android.Media3.DataSource](https://www.nuget.org/packages/Anjo.Android.Media3.DataSource/) (>= 1.1.1) [Anjo.Android.Media3.Decoder](https://www.nuget.org/packages/Anjo.Android.Media3.Decoder/) (>= 1.1.1) [Anjo.Android.Media3.Extractor](https://www.nuget.org/packages/Anjo.Android.Media3.Extractor/) (>= 1.1.1)

Are you the one who created them?

Yes

Media3.ExoPlayer doesn't even contain the correct bindings, it still references to the old ExoPlayer (2.19.1)
Why bother when all the work is practically already done here? https://github.com/Baseflow/ExoPlayerXamarin/pull/166 (And no I'd rather not see this PR published under a different NuGet) If you need Media3 so badly you can just take it from that PR and use it for your projects.

@ArchangelWTF Do we have a plan or something as to when we will be actually releasing a NuGet for that PR?

@FreakyAli If it were up to me it would already be published due to me already using said bindings in internal projects that I have for apps at the company I work for, but since I only have triage rights for this repository I cant say for certain when they'll get approved and everything will be public.

@ArchangelWTF the reason I ask is because, I wanna create a Videoplayer control for Maui, for both iOS and Android right now so I don't have to wait later on when we actually have a use for it. It will make our lives easier tbh if there is an open source control out there that just works and has features, I kinda don't like the one that community toolkit has it's pretty dull.
Anyway maybe @martijn00 could help us here?

Media3.ExoPlayer doesn't even contain the correct bindings, it still references to the old ExoPlayer (2.19.1)

Why bother when all the work is practically already done here? #166 (And no I'd rather not see this PR published under a different NuGet) If you need Media3 so badly you can just take it from that PR and use it for your projects.

yes, right it this mistake, I will fix it and again release.

we can check the new update for Media3.ExoPlayer <IP_ADDRESS>
@ArchangelWTF

@ArchangelWTF I guess this can be closed now...


[shell] must get back option to define datasource manually inside the program

Right now it must be defined up front.

you can now configure the properties the same way as the other services. in /opt/freeacs-shell/config/application-config.properties


Change colour of progress bars when at 100% completion of a module or dojo

Just a small request for visual clarification, but it would be nice if the progress bars under dojos switched colours when 100% complete i.e. from the current teal to maybe the hacker green that's seen in the rest of the theme.
I was mildly affected by this when I thought I had finished Linux Luminarium but didn't get the badge, and realized I had missed 1 exercise in 1 module, which would've been easier to spot if the colours changed upon completion.

Hi @adamdoupe! I noticed you're already assigned to this issue, but I was wondering if there’s anything I could do to assist or contribute. I’d be happy to help and open a PR if that’s okay with you!


Add Treatment

Proposed Changes
The treatment component for entering and displaying a patients treatment details have been added.

Adding new treatments

Multiple Treatments can be created together. A description for the individual treatments can also be added.

Active Treatments

The treatments currently undertaken by the patient are displayed below. The treatment can also be stopped by the user.

Treatment History

The treatment history of a patient can be viewed.

(Note: The UI will be changed later)
Merge Checklist

[x] Add specs that demonstrate bug / test a new feature.
[x] Check if route, query, or mutation authorization looks correct.
[x] Update docs, where applicable.
[x] Add development seeds for new tables.

@Sandra3657 Can you remove conflicts and also make some changes as I have mentioned in review to merge it in main?


webpack 5 migration guide missing devtool validation changes

Hi!
Trying out webpack 5, I encountered:
  Error thrown in test:

  ValidationError {
    baseDataPath: 'configuration',
    errors: [
      {
        children: Array [ … ],
        data: 'inline-sourcemap',
        dataPath: '.devtool',
        keyword: 'oneOf',
        message: 'should match exactly one schema in oneOf',
        params: Object { … },
        parentSchema: Object { … },
        schema: Array [ … ],
        schemaPath: '#/properties/devtool/oneOf',
      },
    ],
    headerName: 'Webpack',
    message: `Invalid configuration object. Webpack has been initialised using a configuration object that does not match the API schema.␊
     - configuration.devtool should match pattern "^(inline-|hidden-|eval-)?(nosources-)?(cheap-(module-)?)?source-map$".`,

This particular neutrinojs/neutrino preset was using 'inline-sourcemap' rather than 'inline-source-map' - which previously worked fine (even though it's not in the form mentioned in the webpack docs).
The validation error appears to be from webpack/webpack/pull/9689 however isn't mentioned here:
https://github.com/webpack/changelog-v5/blob/master/MIGRATION GUIDE.md
It would be great to add it to the migration guide :-)

added

Thank you :-)


Improve the formatting of grafana.dashboards.data

How to categorize this PR?

/area monitoring
/kind enhancement
What this PR does / why we need it:
When reviewing #7889, I noticed that it is challenging to follow the nested control structures in this golang text templating helm function.
A bit of indentation inside the curly braces does not change the generated output and improves the readability a bit.
Verify it with
helm template . 2>/dev/null
in charts/seed-monitoring/charts/grafana
Which issue(s) this PR fixes:
Fixes #
Special notes for your reviewer:
/cc @rickardsjp
Release note:

NONE

Thank you!
/approve


MD: Make deprecated functions not inline

In 2.7.0, we replaced a number of MD functions with deprecated inline
versions. This causes ABI compatibility issues, as the functions are no
longer guaranteed to be callable when built into a shared library.
Instead, deprecate the functions without also inlining them, to help
maintain ABI backwards compatibility.
Testing done:

Running all.sh (ongoing)
Passed Oulu CI
Built with MBEDTLS_DEPRECATED_REMOVED

@gilles-peskine-arm This needs your re-review.

#insert my usual grumble about rebasing, especially sneaky rebasing

Created #1388 to track the pre-existing defect regarding mbedtls_aes_xxcrypt.


Go back to hex or base32 peerids

I think the current way of using base64 for peerids is very unergonomic when using the command line.

You can usually not just select the strings with a click, since due to the special chars they are not a single word
If you are extra unlucky you will get a peer id that starts with a -.

E.g. I got a peer id -C7yIPRL4Eoy51QS6p6uMyxUsGMkgSWJUmh7gHbqALU and found it really hard to pass this as an argument to e.g. get.
❯ ~/projects_git/iroh/target/release/iroh get --peer -C7yIPRL4Eoy51QS6p6uMyxUsGMkgSWJUmh7gHbqALU --auth-token stigZsDPpuDU-yBld8fAy9EwE0RjfKBy7Z4T3LNxxbM bafkr4iafyu5wgg4em5tz5bxyyxfiqypktgdd4t4ukzwztpbf2c4i5pzove
error: unexpected argument '-C' found

  note: to pass '-C' as a value, use '-- -C'

Usage: iroh get [OPTIONS] --peer <PEER> --auth-token <AUTH_TOKEN> <HASH>

For more information, try '--help'.

🙄
The concern of these strings being too big for the QR code should be addressed in a different way.

Yes, this is a real problem and I couldn't figure out how to pass such a PeerId when I had this.  @Arqu also complained about this in the past.  Base32 is a bit smaller than hex, so maybe prefer that?

how about those good ol Qm... or bafy... multihashes :P
Either way, while I've worked around it, it is very annoying to me personally. Just feels not right when you encounter those. Don't have a strong preference on what exact encoding to use but anything without special chars would be great.

I don't see what is wrong with hex. Everybody understands it, and it's not like 5 bits per char vs 4 bits per char is going to make a difference. I am not going to type those strings anyway...

We now use base32 in all CLI output


Bad Request error on upload photo

Which client are you using? - app (instagram_private_api/)
The upload_photo method returns "Bad request" error.
Error message:
instagram_private_api.errors.ClientError: Bad Request
Code:
image = open(r'img\e1.jpg', 'rb')
image_read = image.read()
i2 = base64.b64encode(image_read)
res = api.post_photo(photo_data=i2, size=(720, 720))
print(res)

Error/Debug Log:
D:\users\Kavindu\Documents\fiverr\25 - Inster API\v8\venv\lib\site-packages\instagram_private_api\endpoints\upload.py:397: UserWarning: This endpoint has not been fully tested.
  warnings.warn('This endpoint has not been fully tested.', UserWarning)
Traceback (most recent call last):
  File "D:\users\Kavindu\Documents\fiverr\25 - Inster API\v8\venv\lib\site-packages\instagram_private_api\endpoints\upload.py", line 446, in post_photo
    response = self.opener.open(req, timeout=self.timeout)
  File "C:\Users\Kavindu\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 531, in open
    response = meth(req, response)
  File "C:\Users\Kavindu\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 641, in http_response
    'http', request, response, code, msg, hdrs)
  File "C:\Users\Kavindu\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 569, in error
    return self._call_chain(*args)
  File "C:\Users\Kavindu\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 503, in _call_chain
    result = func(*args)
  File "C:\Users\Kavindu\AppData\Local\Programs\Python\Python37\lib\urllib\request.py", line 649, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 400: Bad Request

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "D:/users/Kavindu/Documents/fiverr/25 - Inster API/v8/main.py", line 29, in <module>
    res = api.post_photo(photo_data=i2, size=(720, 720))
  File "D:\users\Kavindu\Documents\fiverr\25 - Inster API\v8\venv\lib\site-packages\instagram_private_api\endpoints\upload.py", line 450, in post_photo
    ErrorHandler.process(e, error_response)
  File "D:\users\Kavindu\Documents\fiverr\25 - Inster API\v8\venv\lib\site-packages\instagram_private_api\errors.py", line 141, in process
    raise ClientError(error_msg, http_error.code, error_response)
instagram_private_api.errors.ClientError: Bad Request

Instagram closed off the endpoint, pretty sure someone abused the endpoint and they decided to take it away from all of us.

Is there some other way to do this? I mean, there should be some product that allows you to automate this process

I'm having the same issue

too bad this clean way wont work anymore... but i have coded a ruff upload automation with chromedriver
`from selenium import webdriver
import time
import autoit #for automating windows explorer
import os
chrome_options = webdriver.ChromeOptions()
#chrome_options.add_argument('--headless')
#chrome_options.add_argument('--disable-gpu')
chrome_options.add_argument('--user-agent="Mozilla/5.0 (Windows Phone 10.0; Android 4.2.1; Microsoft; Lumia 640 XL LTE) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.135 Mobile Safari/537.36 Edge/12.10166"')
driver = webdriver.Chrome(chrome_options=chrome_options)
def login_mobile(username, password):
driver.get('https://www.Instagram.com')
time.sleep(5)
driver.find_elements_by_xpath('//*[@id="react-root"]/section/main/article/div/div/div/div[2]/button')[0].click()
time.sleep(5)
driver.find_element_by_name('username').send_keys(username)
driver.find_element_by_name('password').send_keys(password)
driver.find_elements_by_xpath("//div[contains(text(),  'Anmelden')]")[0].click()
time.sleep(10)
driver.find_elements_by_xpath('//*[@id="react-root"]/section/main/div/div/div/button')[0].click()
time.sleep(5)
try:
    driver.find_elements_by_xpath("//button[contains(text(),  'Abbrechen')]")[0].click()
except:
    print('errorcode=1')
    pass

def login_pc(username, password):
driver.get('https://www.Instagram.com')
time.sleep(5)
driver.find_element_by_name('username').send_keys(username)
driver.find_element_by_name('password').send_keys(password)
driver.find_element_by_xpath("//div[contains(text(),  'Anmelden')]")[0].click()
time.sleep(10)
driver.find_elements_by_xpath('/html/body/div[4]/div/div/div[3]/button[2]')[0].click()
time.sleep(5)
print('logged in successfully')

def Upload(file_name, caption, caption_status, resize_status):
absolute_file_path = os.path.abspath(file)[:-12] + 'media\unposted\' + file_name
print(absolute_file_path)
driver.get('https://www.instagram.com/')
time.sleep(5)
driver.find_element_by_xpath("//button[contains(text(),'Jetzt nicht')]").click()
time.sleep(5)
driver.find_element_by_xpath('//*[@id="react-root"]/section/nav[2]/div/div/div[2]/div/div/div[3]').click()
time.sleep(1.5)
autoit.win_active("Öffnen")
time.sleep(2)
autoit.control_send("Öffnen","Edit1",absolute_file_path)
time.sleep(1.5)
autoit.control_send("Öffnen","Edit1","{ENTER}")
time.sleep(10)

if bool(resize_status) == True:
    print(bool(resize_status))
    time.sleep(10)
    driver.execute_script("window.scrollTo(0, document.body.scrollHeight);")
    time.sleep(1)
    driver.find_element_by_xpath('//*[@id="react-root"]/section/div[2]/div[2]/div/div/div/button[1]').click()
    time.sleep(1)
       //*[@id="react-root"]/section/div[2]/div[2]/div/div/div/button[1]
       //*[@id="react-root"]/section/div[2]/div[2]/div/div/div/button[1]/span
       //*[@id="react-root"]/section/div[2]/div[2]/div/div/div/button[1]
    print('Resized')
else:
    print('Not resized')

driver.find_element_by_xpath("//button[contains(text(),'Weiter')]").click()

time.sleep(1.5)
print(caption_status)

if bool(caption_status) == True:

    driver.find_element_by_xpath('//*[@id="react-root"]/section/div[2]/section[1]/div[1]/textarea').send_keys(caption)
    driver.find_element_by_xpath("//button[contains(text(),'Teilen')]").click()
    print('posted sucessfully.')
    print('caption: ' + caption)

else:

    driver.find_element_by_xpath("//button[contains(text(),'Teilen')]").click()
    print('posted sucessfully.')
    print('caption: none')

`

Instagram closed off the endpoint, pretty sure someone abused the endpoint and they decided to take it away from all of us.

but I have used c# library and it works. It has the same endpoint.
(https://github.com/ramtinak/InstagramApiSharp)

Instagram closed off the endpoint, pretty sure someone abused the endpoint and they decided to take it away from all of us.

but I have used c# library and it works. It has the same endpoint.
(https://github.com/ramtinak/InstagramApiSharp)

Really? Then there is something wrong with this project and I was wrong.  Usually a bad request means the endpoint is closed off. But since the c# API works, it looks like I know what I've gotta do next.

Hey,
I might have a solution to this problem. The colleagues from this repo have found out that the Instagram has made some changes in sending the password using a custom prefix tag. I did not have time to find this missing piece in this repo, but it could be worth a shot.
Here is the link to the reply.
https://github.com/jlobos/instagram-web-api/issues/118#issuecomment-629834968
Cheers,
Chris


some details

Thanks for your code.
I'm trying train faster rcnn based mobilenet on caffe. But the mAP is low.(about 50% while this version is about 60%.) I use py-faster-rcnn code as my experiment code. I use first 11 layers in rpn network and freeze first 5 layers by setting lr to 0 and use last 2 layers with ave pooling as the second stage of faster rcnn. ＲＯＩＰooling layer may be not good as tf.image.crop_and_resize，but I think this may not cause such gap.  Can you give me some advice? Thanks.

check the current code i have, i try to follow the description at https://arxiv.org/abs/1611.10012. there may be some minor difference though.


Handshake inactivity timeout

{ [Error: Handshake inactivity timeout]
code: 'PROTOCOL_SEQUENCE_TIMEOUT',
fatal: true,
timeout: 10000 }
I get this error when I try to run the app as is.
My PC resides behind secure proxy.

Hey @harshu108, I unfortunately cannot reproduce this issue and believe that it is not an issue with the example itself. I will close for now, but please re-open the issue and mention me if you believe that there can be a change in the example to get it working for you.

Having the same issue now.
@harshu108  Did you find a solution?


How effective is IMU data for odometry?

I am trying to make the Kimera_vio on a mobile robot with Intel D435i. Everything works fine for me as far as mesh generation and 3d reconstruction with kimera_semantics is considered. However, I notice that whenever I try to "slowly" move robot where there are no features in front of the robot or just plain grey floor in sight of the camera, the rviz would show that there is no motion at all. Only when I would have some features, everything works perfect. So my question here is, does IMU not play any significant role here?
Also, I have tested semantics for 3d reconstruction as well and the issue I face there is that if I don't move my robot at all, the semantics package goes to "updating mesh" message alone. I see some complimentary messages "input pointcloud queue getting too big, droping pointclouds" as well. After this, I lose all my frames and only the "world" and "map" frame remains in rviz.

The IMU should be pushing the backend to report motion but if the vision frontend is reporting no movement then it becomes a matter of which factors the backend trusts more. If you have an accurate noise model for the imu then it should work. Check if you are using use_2pt_ransac or use_1pt_ransac or similar in the frontend params, this will cause the vision frontend to use the imu for the ransac relative pose estimation and can cause the backend to rely on the imu more.
The second problem sounds like you're running out of memory because the point clouds are getting too big, or there is a slowdown getting messages to the queue. Would recommend opening an issue on the Kimera-Semantics repo with more information (printout of messages, info on your sequence, etc) so we can debug.


Throw error if scraper returns a captcha form

Given that too many requests have been made to oscn and there is a captcha shown or invalid content shown
When the scraper gets the html of the page
raise a custom exception (so that the html is not saved or parsed).
You will need to update this project as well as the oscn project to complete end to end testing.
End to end testing:

Ensure there is a lockout by hitting 15 or more pages within a minute (if you have already filled out the captcha it may take up to 1000 to trigger it again)
Run a scraper in sidekiq
Confirm that the job fails in sidekiq with the correct error message
Confirm that the html is not saved to an html table

Notes:

Many tutorials on exceptions talk about catching errors, but there should be no need to catch this error (It should bubble up)
You should also ensure that any response from the server that's not a 200, 201 throws an exception

Sample html

	<meta name="viewport" content="width=device-width, minimum-scale=1, initial-scale=1">
    <title>reCAPTCHA demo: Simple page</title>

    <form action="/recaptcha/recaptcha.aspx" method="POST">

      <input type="submit" value="Submit">
	  <input type='hidden' id='source_uri' name='source_uri' value='L2RvY2tldHMvR2V0Q2FzZUluZm9ybWF0aW9uLmFzcHg/ZGI9dHVsc2EmbnVtYmVyPVRSLTIwMjItNzQzOQ=='>
	  </script>
    </form>


Planets missing from selector

With the last few versions where I only see Earth and our moon is earth as well.  I do not have a custom planets xml or anything like that so I am not sure where it is pulling that from.  I used to have moon, mars, and other planets (I think).  I have your latest version of libvulpes and the AR mod.

If you generate a new world does this still occur?  And can you send me a copy of the world/advRocketry/temp.dat?

Attached is the temp.dat in zip format (GitHub made me zip it).  I haven't tried a new world.
temp.zip

Looks like somehow only the Earth exists as a planet, the moon looks like the earth because if the planet data can't be found it just uses the overworld data.  I see 3 options to fix this:  Delete the temp.dat and let it regen, but you'll lose the satellites and space station.  You could make a backup of the temp.dat and let it regen and try to merge the two, or three, leave it as is.
How long has it been like this, and if you can find a time period, it would be helpful to grab logs from that area of time.  There's probabyl an IO error of some kind.  Did you shut down the game in a non-standard fashion (like task manager->kill)?

It has been like this for 3+ months I think.  I really don’t know.  Ill create a backup of the dat and regen and possibly merge if needed.
From: zmaster587<EMAIL_ADDRESS>Sent: Sunday, September 4, 2016 11:31 PM
To: zmaster587/AdvancedRocketry<EMAIL_ADDRESS>Cc: Mitchell J. Skurnik<EMAIL_ADDRESS>Author<EMAIL_ADDRESS>Subject: Re: [zmaster587/AdvancedRocketry] Planets missing from selector (#197)
Looks like somehow only the Earth exists as a planet, the moon looks like the earth because if the planet data can't be found it just uses the overworld data. I see 3 options to fix this: Delete the temp.dat and let it regen, but you'll lose the satellites and space station. You could make a backup of the temp.dat and let it regen and try to merge the two, or three, leave it as is.
How long has it been like this, and if you can find a time period, it would be helpful to grab logs from that area of time. There's probabyl an IO error of some kind. Did you shut down the game in a non-standard fashion (like task manager->kill)?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHubhttps://github.com/zmaster587/AdvancedRocketry/issues/197#issuecomment-244667951, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AJmZO3_F_PlF5-hNku3EJldBZPPrYy5gks5qm7dBgaJpZM4J0vrb.

OK.  It looks like it generated the dat file correctly with Earth having a child of Luna but as yo you can see, it is showing up as a duplicate again but I can see the moon sticking out of the right of the planet.  The other planets seem to work however so I am not sure what is going on.  Just to confirm, I am on version "0.7.0d".

Temp data file as requested
temp - new.zip

After seeing this, if you close the game completely an reopen it, is there still the second Earth?
I've tried dropping the data file into one of my instances and everything looks fine to me, granted it is a slightly newer version, but planet map code nor planet loading code has not be touched.

closing due to inactivity and inability to replicate


Reinstate support for remote and local Zarr and N5 image format in Mastodon

With the recent update in mobie-io and pom-sciajava 37.0.0, Mastodon lost its ability to open remote images stored on a S3 storage, using Zarr file format. Let's put it back and extend it.

[x] Support for creating new Mastodon projects based on a local Zarr images.
[x] Support for creating new Mastodon projects based on a local N5 images.
[x] Support for creating new Mastodon projects based on a remote Zarr images without login / password.
[x] Support for creating new Mastodon projects based on a remote N5 images without login / password.
[x] Support for creating new Mastodon projects based on a remote Zarr images with login / password.
[x] Support for creating new Mastodon projects based on a remote N5 images with login / password.

Done by Ko in #328


land_detector detects takeoff/landing with motors disconnected

Hello,
As I'm preparing for my first flight, I'm trying to check as many things as I can and I've stumbled upon this issue.
Worth mentioning is that propellers are not attached.
If I do commander arm, raise the throttle, then land_detector detects takeoff, and landing when I lower the throttle.
Log here: http://logs.px4.io/plot_app?log=3381ef1b-73e3-4cc7-afa6-a24028f7dabc
16_34_54.zip
Update 1: Here is another log, outside, with GPS, only one IMU+MAG enabled (mpu9250): http://logs.px4.io/plot_app?log=5e54e3d1-ff68-421b-b189-3100a0b199f4
17_13_43-mpu9250-gps.zip
Any ideas?

Manual input is a factor for manual modes.
https://github.com/PX4/Firmware/blob/master/src/modules/land_detector/MulticopterLandDetector.cpp#L207

This is not really a bug. The system assumes that it's taking off because it has no other feedback to make a decision with. GPS isn't accurate enough to make that decision either.

Can't we use the accelerometer somehow?

Having a false positive in the takeoff detector is not a big problem. However, a detection with an accelerometer (in addition to the manual input) might lead to some false negatives which are much more unwanted. A proper tuning of the takeoff thrust value is then a good conservative solution.

This all works as designed.


[Sema] Improved error message for static functions on existential metatypes

What's in this pull request?
This improves the error message produced when static members are looked up on existential metatypes.
protocol P { }
extension P {
    static func staticMethod(a:Int) { ... }
}

_ = P.staticMethod(a:) // error: static member 'staticMethod(a:)' cannot be used on instance of type 'P.Protocol'

Now the compiler emits the warning error: static member 'staticMethod(a:)' cannot be used on protocol metatype 'P.Protocol'. This reflects much better on why this is forbidden—the protocol cannot provide the static member.
This addresses some FIXMEs in test/expr/unary/selector/selector.swift.
The compiler still emits the correct error messages for lookups on the P.Type and P.Protocol cases and no new cases are diagnosed as errors.
_ = P.Type.staticMethod(a:) // error: type 'P.Type' has no member 'staticMethod(a:)'
_ = P.Protocol.staticMethod(a:) // error: type 'P.Protocol' has no member 'staticMethod(a:)'

Before merging this pull request to apple/swift repository:

[ ] Test pull request on Swift continuous integration.

Triggering Swift CI
The swift-ci is triggered by writing a comment on this PR addressed to the GitHub user @swift-ci. Different tests will run depending on the specific comment that you use. The currently available comments are:
Smoke Testing
    Platform     | Comment
    ------------ | -------------
    All supported platforms     | @swift-ci Please smoke test
    OS X platform               | @swift-ci Please smoke test OS X platform
    Linux platform              | @swift-ci Please smoke test Linux platform

Validation Testing
    Platform     | Comment
    ------------ | -------------
    All supported platforms     | @swift-ci Please test
    OS X platform               | @swift-ci Please test OS X platform
    Linux platform              | @swift-ci Please test Linux platform

Note: Only members of the Apple organization can trigger swift-ci.

@swift-ci test

@swift-ci test


I think it would be better if getFileUrl were placed in RecordModel.

So let’s say I have an internal model with an imageUrl in it.
That look like this:
class Post {
  Post({
    required this.text,
    required this.imageUrl,
  });

  static Post fromRecordModel(RecordModel model, PocketBase base){
    final text = model.getStringValue('text');
    final imageName = model.getStringValue('imageUrl'); // it returns only the name
    final imageUrl = base.getFileUrl(imageName, model);
    return Post(text: text, imageUrl: imageUrl);
  }

  final String text;
  final Uri imageUrl;
}

it has a fromRecordModel constructor.  The only way to do it now is to pass pocketBase as an argument.  But this feels wrong.
Wouldn’t it be better if I could call getFileUrl directly from the model something like this:
static Post fromRecordModel(RecordModel model){
    final text = model.getStringValue('text');
    final imageName = model.getStringValue('imageUrl'); // it returns only the name
    final imageUrl = model.getFileUrl(imageName);
    return Post(text: text, imageUrl: imageUrl);
  }

I tried to implement it by myself but it seems to be an issue with baseUrl, its accessible only in pocketBase instance.
This is what I thought about (but it doesn’t feel right).
First, I tried to pass the baseUrl into responseData but then I realized that someone could use a field named baseUrl, and by using it to pass baseUrl will override it.
Then I add it as an argument to RecordModel.fromJson(json, baseUrl) method, and this also feels wrong.
So the last idea is to have a singleton in which I will write baseUrl when PocketBase is initiated. And then I thought why would not we add a singleton for the entire PocketBase class as I saw in other packages? My question is how would be better?

We can't move the getFileUrl() into the RecordModel because the RecordModel is just a DTO and as you noted it doesn't have access to the client instance and base url address.
We can add a helper to return a relative file url but I'm not sure how useful that would be (especially with Dart).
One way to reuse the PocketBase.getFileUrl() method could be also to extend the RecordModel.

And then I thought why would not we add a singleton for the entire PocketBase class as I saw in other packages? My question is how would be better?

I'm sorry. I don't understand the suggestion.
It is up to the developer how they'll structure their code. The SDK is intended to be a generic Dart package to help interacting with the PocketBase API a little bit easier.
Feel free to open a PR if you think there is a better/simpler way to handle it.


when RNN including LSTM or GRU will be supported?

Platform (like ubuntu 16.04/win10):
Python version:
Source framework with version (like Tensorflow 1.4.1 with GPU):
Destination framework with version (like CNTK 2.3 with GPU):
Pre-trained model path (webpath or webdisk path):
Running scripts:

@zhenglei0102 , thank you very much for the feedback.


JSON schema out of date

Component
other
Describe the bug
Since https://github.com/woodpecker-ci/woodpecker/issues/1948 was fixed (yesterday), the json schema for .woodpecker is out of date, but that issue was locked so I can't comment  there.
This is possible so that the logs show "clone" (as it was before the fix) instead of "git":
clone:
  clone:           # can be any word: "clone", "git" or whatever
    image: woodpeckerci/plugin-git:2.0.3
steps:
  build:
    # ...

But the schema only allows "git". If I use "clone" then I get an error in vscode: Property clone is not allowed..
I couldn't submit a PR because I'm unsure how to fix it - I can't just change "git" to "clone" as both are valid, as well as any other word.
(I'm willing to try fixing it if someone has an idea how to specify "any word"?)
System Info
version next
vscode

Additional context
No response
Validations

[X] Read the Contributing Guidelines.
[X] Read the docs.
[X] Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.
[X] Checked that the bug isn't fixed in the next version already [https://woodpecker-ci.org/faq#which-version-of-woodpecker-should-i-use]
[X] Check that this is a concrete bug. For Q&A join our Discord Chat Server or the Matrix room.

#2063

Well I'm not aware of how we should version tje schemastore ... so it can only bee about making sure it's about latest stable ...


Ensure Checkstyle suppression for dependency-reduced-pom.xml on Windows

Motivation:
mvn package on Windows fails if there are some dependency-reduced-pom.xml files generated by the previous build.
mvn clean package does not help because it does not remove those files at the clean phase.
Modification:
Use the correct file pattern for the suppression filters.
Result:
Following mvn package runs well on Windows.

Maven log of the failure:
[INFO] Scanning for projects...
[INFO] ------------------------------------------------------------------------
[INFO] Detecting the operating system and CPU architecture
[INFO] ------------------------------------------------------------------------
[INFO] os.detected.name: windows
[INFO] os.detected.arch: x86_64
[INFO] os.detected.version: 10.0
[INFO] os.detected.version.major: 10
[INFO] os.detected.version.minor: 0
[INFO] os.detected.classifier: windows-x86_64
[INFO] ------------------------------------------------------------------------
[INFO] Detecting the operating system and CPU architecture
[INFO] ------------------------------------------------------------------------
[INFO] os.detected.name: windows
[INFO] os.detected.arch: x86_64
[INFO] os.detected.version: 10.0
[INFO] os.detected.version.major: 10
[INFO] os.detected.version.minor: 0
[INFO] os.detected.classifier: windows-x86_64
[INFO] ------------------------------------------------------------------------
...

Audit done.
[INFO]
[INFO] --- maven-checkstyle-plugin:3.1.0:check (nohttp-checkstyle-validation) @ netty-parent ---
[INFO] There is 1 error reported by Checkstyle 8.29 with nohttp-checkstyle.xml ruleset.
[ERROR] common\dependency-reduced-pom.xml:[2,161] (extension) NoHttp: http:// URLs are not allowed but got 'http://maven.apache.org/maven-v4_0_0.xsd'. Use https:// instead.
[INFO] ------------------------------------------------------------------------
...
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  7.339 s
[INFO] Finished at: 2020-12-27T22:27:41+09:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-checkstyle-plugin:3.1.0:check (nohttp-checkstyle-validation) on project netty-parent: You have 1 Checkstyle violation. -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <args> -rf :netty-parent

@delegacy can you sign our ICLA ?
https://netty.io/s/icla

Done

Thanks

Thanks


jobs: use internal hostname for image

Signed-off-by: Steve Kuznetsov<EMAIL_ADDRESS>

/lgtm
Works around bug in publicDockerImageRepository not being set transiently (still debugging why), and the local image should always be available.

/refresh


Move All Enums into Separate Module

What does this PR do?

[ ] Documentation
[ ] Code changes

How did you verify your code works?
Run cargo test to verify that these changes did not break anything.

Next order of business is to clean up some duplicate enumeration variants that got generated due to the IEEE's poor XML file layout (and just terrible enumeration definitions overall).


Added UNCC (University of North Carolina at Charlotte) to listed edu domains

Standard email format is, for example -<EMAIL_ADDRESS>

@dpklinge I have to close this request without merging, because you requested to add a non-existent domain to this repository: Host charlotte.charlotte.edu not found: 3(NXDOMAIN) Please ensure that you are familiar with this repository rules located at the bottom of this page and submit a new request with the correct information. Thank you for your understanding!


Loading weight file containing 217 layers into a model with 3 layers

Hello Guys! I have trained a Yolov4 model and I got the .weights file back. I am trying to convert the file into .h5 but there is my first Problem.
This is the error message that I get back when trying to convert to .h5. Does anybody know why this might occur?
"ValueError: cannot reshape array of size 4554552 into shape (1024,512,3,3)"
Anyways I found another way to get my file into the .h5 format. But is there the possibility that the 2 different converters are returning different results since I now get this error when trying to create a YOLOv4 Model:
"ValueError: You are trying to load a weight file containing 217 layers into a model with 3 layers."
This is the code that threw the error:
model = YOLOv4(     input_shape=(HEIGHT, WIDTH, 3),     anchors=YOLOV4_ANCHORS,     num_classes=1,     training=False,     yolo_max_boxes=50,     yolo_iou_threshold=0.5,     yolo_score_threshold=0.5, )
As you can see I have changed the number of classes but nothing else.
Might the other used converter be the reason for this problem or is there something that I am missing?
Please help me out :D

have you been able to solve this issue? if not...
I had the same problem... turns out that for some reason, yolov4 wieghts have to be placed in home directory, also you need to flag explicitly how many classes are there as shown in image, I have only one class so "-n 1" at the end...
i converted them using gpu on colab and also a vmware virtual machine with ubuntu 18/python 3.6.


config false positive: git is up to date or not installed

A user reported that this test failed repeatedly after disabling it.

On El Capitan it's not possible to move "git", "openssl" or "curl" without booting in to Recovery mode - more info on https://ohthehugemanatee.org/blog/2015/10/01/how-i-got-el-capitain-working-with-my-developer-tools/
So the current "fix" doesn't work. Perhaps checking "which git" and ensuring the non-default is not returned is a sufficient check?

@hypn dang, that's inconvenient. Thanks for the info.
The goal for this check is to make sure that, when the user runs "git" from Terminal, they run an up-to-date version of it. Aside from renaming apple's git, it seems the only other way to ensure that homebrew's git installation is prioritized is to move brew installations (/usr/local/...) earlier in the PATH environment variable than /usr/bin/, but that seems difficult to do programmatically.
Reference: http://apple.stackexchange.com/questions/93002/how-to-properly-update-git-on-mac#93179

To do this programmatically, we can target a file that holds paths information and use this sed template to do the insertion (with sudo privs if necessary, depending on the file we target):
http://unix.stackexchange.com/questions/121161/how-to-insert-text-after-a-certain-string-in-a-file#121173
Files to choose from (Reference: http://superuser.com/questions/69130/where-does-path-get-set-in-os-x-10-6-snow-leopard ):

/etc/profile
~/.bash_profile
~/.bash_login   (if .bash_profile does not exist)
~/.profile      (if .bash_login does not exist)
/etc/paths
/etc/paths.d

I'm not clear on how precedence works for this yet. All /etc/* locations would require sudo privs and impact all users.

http://apple.stackexchange.com/questions/93002/how-to-properly-update-git-on-mac#93179
adding
export PATH="/usr/local/bin:$PATH"
to the end of  ~/.bash_profile
might do the trick, but we should verify first that /usr/local/bin path is not already in a good spot via regex and remove all instances of it in bad spots before prepending it to PATH. Also, need to make sure that this will not require a reboot in order to take effect for the user.


Knapsack Problem Java

Information about Algorithm

Want to add Knapsack problem with greedy approach in java.
Have you read the Contributing.md and Code of conduct

Yes

Other context

@ming-tsai Assign me this task and please add hacktoberfest 2022 label 🙌

@riteshyadav27 Kindly assign this to me.

@riteshyadav27 Can you please assign this issue to me ?? Thanks.

Hi @riteshyadav27,
For the hacktobertfest please read this issue #968

@ming-tsai There is no folder which is strictly dedicated for algorithms in Java. So may I create it or add this knapsack problem in arrays section ?

Plz assign me to do this issue sir i want to this ..

@ming-tsai There is no folder which is strictly dedicated for algorithms in Java. So may I create it or add this knapsack problem in arrays section ?

Sorry for late, but please check this path


docker: version 20.10.2, using --host=fd:// gives socket error

Describe the bug
Apparently this bug was already caught in the original PR https://github.com/NixOS/nixpkgs/pull/108960, but for some reason the fix got later reverted in https://github.com/NixOS/nixpkgs/pull/109447?
The error message from systemd is:
Feb 01 16:20:16 asd dockerd[21349]: time="2021-02-01T16:20:16.197031255+01:00" level=info msg="Starting up"
Feb 01 16:20:16 asd dockerd[21349]: failed to load listeners: no sockets found via socket activation: make sure the service was started by systemd
Feb 01 16:20:16 asd systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE

To Reproduce
  virtualisation.docker.enable = true;

Expected behavior
docker should start
Additional context
--host=unix:// fixes it
Notify maintainers
@mikroskeem @roberth
Metadata
Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.
 - system: `"x86_64-linux"`
 - host os: `Linux 5.4.91, NixOS, 21.03pre265130.f217c0ea7c1 (Okapi)`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.3.10`
 - channels(exfalso): `"nixos-21.03pre265130.f217c0ea7c1"`
 - channels(root): `"nixos-21.03pre265130.f217c0ea7c1"`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixos`

See reason for the fix: https://github.com/NixOS/nixpkgs/pull/109418#issuecomment-760935552. This issue was originally caused by build misconfiguration (Moby build flags in wrong place perhaps).

Unable to reproduce this on my system with following configuration:
virtualisation.docker.enable = true;

 - system: `"x86_64-linux"`
 - host os: `Linux 5.4.93, NixOS, 21.03pre267299.5ff6700bb82 (Okapi)`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.3.10`
 - channels(root): `"nixos-21.03pre267299.5ff6700bb82"`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixos`

Just tried with an explicit systemctl start docker.socket, this fixes the issue. Looking at logs of docker.socket:
Feb 01 16:17:44 asd systemd[1]: docker.socket: Socket service docker.service already active, refusing.
Feb 01 16:17:44 asd systemd[1]: Failed to listen on Docker Socket for the API.

This happened the first time it tried to start docker. I think this is a race in startup, docker starts before the socket, prevents docker.socket from starting, then docker.socket start fails with this error.
According to systemd docs:

No implicit WantedBy= or RequiredBy= dependency from the socket to the service is added. This means that the service may be started without the socket, in which case it must be able to open sockets by itself. To prevent this, an explicit Requires= dependency may be added.

So perhaps we just need to add a Requires=docker.socket line to docker.service?

Seems like this is exactly the case.


GOSW22- Creation of contact us table in database

Features to work on:

Create a table in db to save all the details from Contact us page.

Always note this:

Use comments for better explanation of your code.
Try to resolve conflicts in the package.json files before submitting the PR.

where to create a table?

@nanda-mik , can I work on this issue simultaneously with GOSWB1 because I just need to do some changes in that component to insert contact us details to firestore ?


[BUG][PPL] NPE when running head 10 | stats count() by span(timestamp, 1h)

What is the bug?
Getting NPE when calling stats with span
How can one reproduce the bug?
Steps to reproduce the behavior:

create test index

POST /test/_doc
{
  "observedTime": "2024-12-02T21:19:50Z"
}

run query to see error

POST /_plugins/_ppl
{
  "query": "source = test | head 10 | stats count() by span(observedTime, 1h)"
}

{
  "error": {
    "reason": "Invalid Query",
    "details": "Cannot invoke \"java.lang.Comparable.compareTo(Object)\" because \"k1\" is null",
    "type": "NullPointerException"
  },
  "status": 400
}

Note that without head 10 it works correctly, maybe some issue with span when running in memory?
What is the expected behavior?
should not have NPE and should return results correctly
{
  "schema": [
    {
      "name": "count()",
      "type": "integer"
    },
    {
      "name": "span(observedTime,1h)",
      "type": "timestamp"
    }
  ],
  "datarows": [
    [
      1,
      "2024-12-02 21:00:00"
    ]
  ],
  "total": 1,
  "size": 1
}

What is your host/environment?

OS: [e.g. iOS]
Version [e.g. 22] 2.17
Plugins

Do you have any screenshots?
If applicable, add screenshots to help explain your problem.
Do you have any additional context?
Add any other context about the problem.

Took a look, it's already fixed by https://github.com/opensearch-project/sql/pull/3079
This was working in 2.15, not working in 2.17/2.18, and should be working again in 2.19


USDT volume in markets table

The Chore
This doesnt look very nice and causes text wrap issues.

I suggest we use the same two line / lower in grey option as we use here.

I also think we should do the same with Open Interest ... and I wonder if we can add the basis points to the spread?

Tasks

[ ] Drop the  24h volume into a two line format with contracts on top and USDT value beneath
[ ] Do the same with OI ... contracts on top and USDT equivalent beneath
[ ] For the spread show the basis points below ... so spread / mark price * 10000

Additional details / background info

Will cover this under overhaul ticket