PythonCall in sysimage

I'm trying everything to get startup down, and now:
https://github.com/petvana/AutoSysimages.jl
It works for me. First the good news:
julia> @time using PythonCall
  0.010378 seconds (8.97 k allocations: 565.888 KiB)

and with -O0:

julia> @time using PythonCall
  0.003670 seconds (8.97 k allocations: 565.888 KiB)

Some (but not all, since 5.7 sec otherwise) of the startup-cost has been shifted to startup of Julia itself with the sysimage:
$ hyperfine '~/julia-1.9-DEV-b01fd3367b/bin/julia -J /home/pharaldsson/.julia/asysimg/1.9.0-DEV.1694/30JkAN/asysimg-2022-10-30T22-32-01.991.so -e ""'
Benchmark 1: ~/julia-1.9-DEV-b01fd3367b/bin/julia -J /home/pharaldsson/.julia/asysimg/1.9.0-DEV.1694/30JkAN/asysimg-2022-10-30T22-32-01.991.so -e ""
  Time (mean ± σ):      3.116 s ±  0.031 s    [User: 3.791 s, System: 1.184 s]
  Range (min … max):    3.067 s …  3.151 s    10 runs

And 1.91 sec. for -O0.

I believe some work on the package could improve this, with or without a sysimage. The sysimage is 185 MB vs 209 MB for Julia's own 1.9 sysimage (sys.so, not sure why it's larger) vs a 75 MB sysimage I made for other reasons (to cut startup of Julia in half for benchmarking/scripting reasons).
AutoSysimages is really easy to use (at first I used build_sysimage() directly which likely is incorrect), just follow the docs, then for me this worked:
$ PATH=/home/pharaldsson/.local/bin/:$PATH asysimg

Julia 1.9 alone seems a bit faster than 1.8, at least julia -O0:
julia> @time using PythonCall
  3.970856 seconds (2.55 M allocations: 170.295 MiB, 3.47% gc time, 81.35% compilation time: <1% of which was recompilation)

A question related to it, I got 1.9-DEV to try, and it should also work with PythonCall.jl (and does, on its own), but is this expected:
  Prefix: /home/pharaldsson/.julia/environments/v1.9/.CondaPkg/env

  Updating specs:

   - conda-forge::libstdcxx-ng[version='>=3.4,<11.4']
   - conda-forge::python[version='>=3.7,<4',build=*cpython*]

  + _libgcc_mutex           0.1  conda_forge         conda-forge/linux-64     Cached
  + _openmp_mutex           4.5  2_gnu               conda-forge/linux-64     Cached
  + bzip2                 1.0.8  h7f98852_4          conda-forge/linux-64     Cached
  + ca-certificates   2022.9.24  ha878542_0          conda-forge/linux-64     Cached
  + ld_impl_linux-64       2.39  hc81fddc_0          conda-forge/linux-64      778kB
  + libffi                3.4.2  h7f98852_5          conda-forge/linux-64     Cached
  + libgcc-ng            12.2.0  h65d4601_19         conda-forge/linux-64      954kB
  + libgomp              12.2.0  h65d4601_19         conda-forge/linux-64      466kB
  + libnsl                2.0.0  h7f98852_0          conda-forge/linux-64     Cached
  + libsqlite            3.39.4  h753d276_0          conda-forge/linux-64      822kB
  + libstdcxx-ng         11.3.0  h239ccf8_19         conda-forge/linux-64        4MB
  + libuuid              2.32.1  h7f98852_1000       conda-forge/linux-64     Cached
  + libzlib              1.2.13  h166bdaf_4          conda-forge/linux-64       66kB
  + ncurses                 6.3  h27087fc_1          conda-forge/linux-64        1MB
  + openssl               3.0.5  h166bdaf_2          conda-forge/linux-64     Cached
  + pip                    22.3  pyhd8ed1ab_0        conda-forge/noarch          2MB
  + python               3.11.0  ha86cf86_0_cpython  conda-forge/linux-64       38MB
  + readline              8.1.2  h0f457ee_0          conda-forge/linux-64      298kB
  + setuptools           65.5.0  pyhd8ed1ab_0        conda-forge/noarch        787kB
  + tk                   8.6.12  h27826a3_0          conda-forge/linux-64        3MB
  + tzdata                2022e  h191b570_0          conda-forge/noarch        121kB
  + wheel                0.37.1  pyhd8ed1ab_0        conda-forge/noarch         32kB
  + xz                    5.2.6  h166bdaf_0          conda-forge/linux-64     Cached

I see issue here related to libstdcxx-ng, and I believe maybe you don't need to download it, at least soon (work almost done on julia master).
Good to see Python 3.11.0 is done and getting it with your package. It's not a huge deal to trim the list above, but is e.g. tk, readline, ncurses, libgcc-ng, libsqlite really needed or basically all of it? Is pip redundant with conda/mamba, i.e. as you use it?
Have you looked at CircuitPython/MicroPython? I suppose that can't work with your package (JuliaCall), though maybe StaticCompiler.jl.

About your use of libstdcxx maybe it's related to:
https://github.com/JuliaLang/julia/issues/46345
See its (still open) linked issue fixing (I believe that PR done, except for some minor Windows holdup).

I've been experimenting and believe I can reduce the startup time by 1-2 seconds quite easily. Watch this space!
The libstdcxx-ng dependency is there not because it needs to be downloaded, but because we need to ensure that any packages which require libstdc++ are compatible with the one used by Julia.
All those other packages are just what Conda installs when you ask for Python, I can't do anything about those.
Feel free to reopen if you've more questions.


Consider update to graphiql v0.9.1

In v0.9.0 landed super useful feature:
Hover tooltips over any term in a query and ctrl-click to jump-to-documentation
Will be nice if graphql-ide will supports it too.
Thanks for your awesome work!!!

Hi @nodkz, thanks for letting me know. Will update to latest graphiql in upcoming release.


Pilight test_call_rate_delay_throttle_enabled failing intermittently

Pilight test is failing intermittently. It looks like it's time sensitive, so the test may need to be adjusted or re-worked.
https://travis-ci.org/home-assistant/home-assistant/jobs/193855754#L240
Traceback (if applicable):
tests/components/test_pilight.py ✓✓✓✓✓✓✓✓✓✓✓✓✓                   19% █▉
―――――― TestPilightCallrateThrottler.test_call_rate_delay_throttle_enabled ――――――
self = <tests.components.test_pilight.TestPilightCallrateThrottler testMethod=test_call_rate_delay_throttle_enabled>
    def test_call_rate_delay_throttle_enabled(self):
        """Test that throttling actually work."""
        runs = []
        delay = 5.0

        limit = pilight.CallRateDelayThrottle(self.hass, delay)
        action = limit.limited(lambda x: runs.append(x))

        for i in range(3):
            action(i)

        self.assertEqual(runs, [])
    m
        exp = []
        now = dt_util.utcnow()
        for i in range(3):
            exp.append(i)
            shifted_time = now + (timedelta(seconds=delay + 0.1) * i)
            self.hass.bus.fire(ha.EVENT_TIME_CHANGED,
                               {ha.ATTR_NOW: shifted_time})
            self.hass.block_till_done()
>           self.assertEqual(runs, exp)
E           AssertionError: Lists differ: [0] != [0, 1]
E
E           Second list contains 1 additional elements.
E           First extra element 1:
E           1
E
E           - [0]
E           + [0, 1]
tests/components/test_pilight.py:391: AssertionError
------------------------------ Captured log call -------------------------------
selector_events.py          53 DEBUG    Using selector: EpollSelector
core.py                    445 INFO     Bus:Handling <Event homeassistant_stop[L]>

I seems not to fail frequently, otherwise it would break travis unit tests and this issue would have a lot of response. You think something should be fixed here? Do you still get this issue when running unit tests?

I gave the code a closer inspection, and everything seems to be done correctly. I'm just going to close this for now. If we see it again we can try and recreate it.


Cast unique validation exclude id to integer

I have this quite complex validation rule and I use with mongodb:
unique:mongodb.responses,RY7bC4VBFdzFWBS3.age,123,visitor_id,survey_id,564ce591c560ca2c6a8b4568
The problem occurs that in MongoDB where = 123 and where = '123' are two different queries, where in MySQL there is no difference.
Therefore I really need to cast ID attribute to integer to have it return the correct count for unique validation and  I suppose that it can only be done from here.

I may be wrong, but if you add integer it does the cast?

integer | unique:mongodb.responses, ...

@gpedro Would be great if it worked. But your suggested solution adds validation to the field, but does not  cast the except in unique:table,column,except,idColumn  rule definition.

Thanks @GrahamCampbell for updating title, didn't knew to which branch (5.1 or 5.2 or 5.3) to tag this PR.

What if someone is using UUIDs?

@taylorotwell Well, if its really a string, then do not cast it and leave like it is?
I've added conditional check to check if it is really an integer.
if (filter_var($id, FILTER_VALIDATE_INT) !== false)

I see thanks.

Thanks @taylorotwell !!!


feat(lanelet2_extension): added localization landmark

Description
Added localization landmark.
This new lanelet2 definition is related to the landmark_based_localizer in autoware.universe.
https://github.com/autowarefoundation/autoware.universe/tree/main/localization/landmark_based_localizer
Related pull request https://github.com/autowarefoundation/autoware.universe/pull/5803
Tests performed
It has been confirmed that the logging_simulator with pose_source:=artag runs with the same accuracy as before on AWSIM data with GT.
Effects on system behavior
There is no effect except for ar_tag_based_localizer, and there is no change in the behavior of ar_tag_based_localizer. Just moved the definition code.
Pre-review checklist for the PR author
The PR author must check the checkboxes below when creating the PR.

[x] I've confirmed the contribution guidelines.
[x] The PR follows the pull request guidelines.

In-review checklist for the PR reviewers
The PR reviewers must check the checkboxes below before approval.

[ ] The PR follows the pull request guidelines.

Post-review checklist for the PR author
The PR author must check the checkboxes below before merging.

[ ] There are no open discussions or they are tracked via tickets.

After all checkboxes are checked, anyone who has write access can merge the PR.

@mitsudome-r friendly ping.


RDKDEV-168: Refactor ever running parent scripts which take up memory.

RDKDEV-168: Refactor ever running parent scripts which take up memory.
Reason for change: Refactor ever-running parent script startXdial.sh. which doesn't get exited after spawning gdial-server.
Test Procedure: Refer RDK wiki.
Risks: Low
Signed-off-by: fasil kv<EMAIL_ADDRESS>

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.5 out of 7 committers have signed the CLA.:white_check_mark: acheri988:white_check_mark: honglh:white_check_mark: zrash:white_check_mark: apatel859:white_check_mark: Balajims88:x: Hong Li:x: kvfasilHong Li seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.

https://jenkins.code.rdkcentral.com/job/github-triggered/11211/ started

https://jenkins.code.rdkcentral.com/job/build-component-rdk-next/38922/ started.

https://jenkins.cmf.code.rdkcentral.com/job/github-triggered/6057/ started

https://jenkins.cmf.code.rdkcentral.com/job/build-component-rdk-next-platform/13495/ started.

Smoke tests for ['build-brcm-refboard'] added.
https://jenkins.cmf.code.rdkcentral.com/job/test-components-flow/95997/

Smoke tests for ['build-rpi-hybrid-wpe-rdk-next'/'build-rpi-mc-wpe-rdk-next'] added.
https://jenkins.cmf.code.rdkcentral.com/job/test-components-flow/95999/

Smoke tests for ['build-rpi-hybrid-refapp2-rdk-next'] added.
https://jenkins.cmf.code.rdkcentral.com/job/test-components-flow/95998/

'['build-rpi-hybrid-wpe-rdk-next'/'build-rpi-mc-wpe-rdk-next']' Smoke Testing voting skipped due to regressions under investigation . , investigation pending.
Flash MC [SUCCESS]
Flash HYB [SUCCESS]
MC - Video Test [FAILURE]
Video HLS gst-launch [FAILURE]
Video Streaming using aamp-cli [FAILURE]
Video local using gst-play-1.0 [SUCCESS]
Video Streaming using rmfApp [SUCCESS]
HYB - Video Test [FAILURE]
Video HLS gst-launch [FAILURE]
Video Streaming using aamp-cli [FAILURE]
Video local using gst-play-1.0 [SUCCESS]
https://jenkins.cmf.code.rdkcentral.com/job/test-rdkv-raspberrypi-flow/28578/


Getting Started with the SAP Web IDE Full-Stack Version (Trial)

Tutorial URL: https://developers.sap.com/tutorials/webide-innovation-beta.html
Link to "Try It Out: 3 Easy Steps to Get You Started With the Cloud Foundry Environment" in step 4 doesn't work.

Agreed, the link in Step 4 (https://help.sap.com/viewer/65de2977205c403bbc107264b8eccf4b/Cloud/en-US/e3d82674bd68448eb85198619aa99b6d.html?q=Get a Trial Space on the Cloud Foundry Instance) returns this: https://saphelp.hana.ondemand.com/page-not-found.html

Hi all,
The link in Step 4 has been updated and is working.
Thanks,
Shira


kubeadm: add TS guide note about CoreOS read-only /usr

making this change after seeing a number of similar reports from users facing the issue.
xref https://github.com/kubernetes/kubeadm/issues/2031
/sig cluster-lifecycle
/cc @rosti
cc @skycastlelily2

/assign @jaredbhatti

@sftim i added a commit with your second title suggestion.


Add set_input() to the Model onboarding process

Let's add a set_input part to model onboarding, also if we're in a situation where the FeatureSet doesn't exist we need to think of a marker/flag that means the model knows it doesn't have access to the FeatureSEt.

done


Add corn as a PHONY target (predicative branch)

Otherwise, make corn won't always run make in the corn directory.

Superseded by #8


[Live] - Holdings avg. price vs. current price can be mismatched depending on data feed

Expected Behavior

The holdings acquired price remains at the same scale as the current price
Actual Behavior

Sometimes, when switching between Interactive Brokers and QC data feed (using IB as the brokerage), the scales changes for holdings vs. current price:

^^^ Might only apply to ZC futures

Another related finding. This Futures Options' contract's holdings value is off the charts, but might be real because of contract multiplier -- might be a different issue altogether.
Potential Solution

N/A
Reproducing the Problem

Unsure if this will 100% replicate, but place an order in the QC data feed (using IB as brokerage) for ZC contracts. Then, switch to IB data feed and compare the prices the contracts were bought at vs. current holdings
System Information

N/A, cloud
Checklist

[x] I have completely filled out this template
[x] I have confirmed that this issue exists on the current master branch
[x] I have confirmed that this is not a duplicate issue by searching issues

[x] I have provided detailed steps to reproduce the issue

I think this might relate to the ContractDetails.PriceMagnifier field in IB - for ZC and several other futures this is set to 100 as the prices are quoted in cents rather than dollars on the exchange.
From what I can see InteractiveBrokersBrokerage passes through prices for ticks and order fills in cents, and expects to receive limit orders etc with the cent price.  (Current holdings are given a dollar price at startup though.)
So, a potential fix would be to fetch the ContractDetails for each symbol subscribed to (at least for futures, don't know if this field is used for other contracts), and adjust prices coming in and out, consistent with the fix for #5297.
Not sure what your plans are for this, but happy to help if I can?

Hey @spdjudd!

happy to help if I can

Sounds great, ty! I think the first step here is to have some repeatable steps for the reproduction of the issue to determine and assert what are the parts affected too, which will determine the scope of the fix (adjust holdings/orders/etc) 👍 do you mind going through this?

So, a potential fix would be to fetch the ContractDetails for each symbol subscribed to (at least for futures, don't know if this field is used for other contracts), and adjust prices coming in and out, consistent with the fix for #5297.

yes, believe the brokerage already has a cache of _contractDetails and a method to request it if not present

Sure, I'll go through it next week and provide steps

Awesome @spdjudd 💯

So when InteractiveBrokersBrokerage downloads the current holdings at startup the price is given correctly in USD, giving a correct holdings cost of $26.2k. All other interactions - Trade/QuoteBars, OrderEvents etc pass through the cent price as USD, meaning HoldingsCost for a position that was opened in the current session is 100x too big (shown as $2.62M above). Limit orders are clearly assuming the provided limit price is in cents.

Sounds good 👍.  Posting a potential solution bellow to be called on each use case normalizing into Lean (dollars) or IB (cents) expected prices
/// <summary>
/// Helper method to normalize a provided price to the Lean expected unit
/// </summary>
private decimal NormalizePriceToLean(decimal price, Contract contract, Symbol symbol)
{
    // which other security type should be normalized: FOPs?
    if (symbol.SecurityType == SecurityType.Future)
    {
        return price / GetContractPriceMagnifier(contract, symbol);
    }
    return price;
}

/// <summary>
/// Helper method to normalize a provided price to the brokerage expected unit, for example cents
/// </summary>
private decimal NormalizePriceToBrokerage(decimal price, Contract contract, Symbol symbol)
{
    // which other security type should be normalized: FOPs?
    if (symbol.SecurityType == SecurityType.Future)
    {
        return price * GetContractPriceMagnifier(contract, symbol);
    }
    return price;
}

/// <summary>
/// Will return the price magnifier for the requested symbol
/// </summary>
private decimal GetContractPriceMagnifier(Contract contract, Symbol symbol)
{
    var uniqueKey = GetUniqueKey(contract);
    if (!_contractDetails.TryGetValue(uniqueKey, out var contractDetails))
    {
        contractDetails = GetContractDetails(contract, symbol);
        if (contractDetails == null)
        {
            Log.Error("");
            return 1;
        }
    }
    return contractDetails.PriceMagnifier;
}

Looks good!
There are a couple of other changes required to have the contract and symbol available at the point each conversion needs to happen, specifically in HandleCommissionReport()/HandleExecutionDetails() for generating order fills, ConvertTradeBar() in the history query and HandleTickPrice().
I've tested the version attached here and it successfully addresses all the issues from my previous test:
InteractiveBrokersBrokerage.cs.txt
Haven't been able to test the history query as I don't have a working market data subscription for IB right now (only delayed data)

Hey @spdjudd!

I've tested the version attached here and it successfully addresses all the issues from my previous test:

Nice! do you mind going ahead opening the PR with the current changes 👌 + any // TODO comments so we can tackle/review it from there?

Sure - I've opened #5930 but will need a bit more time to sort out testing.  I've run tests using algos as described above, and existing unit tests pass, except for the History request ones that I can't run because I don't have IB market data.  There are also a couple of tests that restart the IB connection that are failing, but that seems to be because of a difference with the newest IB Gateway rather than my changes.


Add Fedora updates-archive repository for kernel headers download

What type of PR is this?
/kind bug

Any specific area of the project related to this PR?
/area pkg
What this PR does / why we need it:
Add repository for older kernel updates (see #351).
I also added a warning log to make it easier to debug future similar problems.
Which issue(s) this PR fixes:

Fixes #351
Special notes for your reviewer:
Does this PR introduce a user-facing change?:

NONE

Thanks for your pull request. Before we can look at it, you'll need to add a 'DCO signoff' to your commits.
:memo: Please follow instructions in the contributing guide to update your commits with the DCO
Full details of the Developer Certificate of Origin can be found at developercertificate.org.
The list of commits missing DCO signoff:

fce8218 fix(pkg/driverbuilder): add fedora updates-archive
6fa9032 chore(pkg/driverbuilder): log warn if no download script was generated

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by: acidghost
Once this PR has been reviewed and has the lgtm label, please assign lowaiz for approval. For more information see the Kubernetes Code Review Process.
The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Welcome @acidghost! It looks like this is your first PR to falcosecurity/driverkit 🎉

LGTM label has been added.  Git tree hash: ba28f0804af80e3b6ae4ec305b9d28c1328b0cc2

[APPROVALNOTIFIER] This PR is APPROVED
This pull-request has been approved by: acidghost, FedeDP
The full list of commands accepted by this bot can be found here.
The pull request process is described here

Needs approval from an approver in each of these files:

OWNERS [FedeDP]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment


fix: variable passing

:tada: This PR is included in version 1.0.4 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Windows stuff

because Windows won't let us have nice things (like forward slashes as path separators)

On Erlang the slash always /, I think it would be good to use that convention on JS too.


Facet Total incorrect with multiselect field.

Hi,
I am hoping this is a config issue or search issue.
I have managed to get the facets return data and worked really well and quite easy to get setup.
I then noticed that some of the totals were not correct.
I tracked this down to my facet field is a multiselect selecting form Umbraco nodes I use for taxonomy.
I noticed that if only one item (category) was selected this gets included in the total.
If I selected more than one item (category) then both of the selected values are not included in the total.
So for example I have 5 blog articles
Blog 1 - Category  = 'Test Blog Category 1'
Blog 2 - Category  = 'Test Blog Category 1'
Blog 3 - Category  = 'Test Blog Category 2'
Blog 4 - Category  = 'Test Blog Category 3'
Blog 5 - Category  = 'Test Blog Category 1 and Test Blog Category 2'
The facet total for 'Test Blog Category 1' would be 2 when it should be 3.
The facet total for 'Test Blog Category 2' would be 1 when it should be 2.
Because the data in Blog 5's category selection would not be included in the facet search results.
Here is my search code. I am hoping there is an extra setting I can enable to make this function as required.
var facetCriteria = facetSearcher.CreateQuery(IndexTypes.Content, BooleanOperation.And);
var facetQuery = facetCriteria.NodeTypeAlias("blogDetailsPage");//considering blog pages only in the search
facetQuery.And().Facet("categories");
var facetResults = facetQuery.Execute().GetFacet("categories");

Kind Regards
David

Hello @DavidArmitage,
Thanks for using Examine Facets! 😊
Facets are calculated based on the tokens for each field in your index. Put simply, in default configuration, whitespace is used to determine where each term starts and ends.
For example, a field with the value "Category-1 and Category-2" would create 2 facets "Category-1","Category-2" ("and" is ignored as a stop word. Without the dashes, the numbers would be ignored - e.g. "Category 1 and Category 2" would create 2 facets "Category","1","2". You can manipulate your fields to get them into the right shape at index time.
If you are using Umbraco, I highly recommend installing my Facet Extensions and Search Extensions projects. These include a super clean way way to index pickers into a searchable and facetable format.
Hope this helps!
Cheers,
Callum

Hi @callumbwhyte
Thanks for the information.
Yes I am using Umbraco 8. I will try and implement these tomorrow.
One question.
So you are saying I can create a custom field in the search index that can be used for the facet searching rather than reply on the existing field which is a multiple tree picker. This is probably adding the data in an unsupported fashion.
Actually something similar to what I am doing already to make a multitree picker easily searchable.
Eg.
var searchableCategoryGuids = string.Empty;
if (contentNode.Value("categories") is List<IPublishedContent> categories)
{
	foreach (IPublishedContent category in categories)
		searchableCategoryGuids += (" " + category.Key.ToString());
}
e.ValueSet.Set("searchableCategoryGuids", searchableCategoryGuids);

Kind Regards
David

Hi @callumbwhyte
That worked perfectly. I can extend this exactly like you said using my example above. Exactly like I do to make multitree pickers searchable. I create a custom field in the index which is a nice joined string of the guids of the selected multi tree picker items. I can use this string as a searchable field. I can then use this same field as the facet field which works perfectly since it's a list of guids split with a " ".
There was hardly any extra coding I needed to do since I already had this in place. Thanks for helping here.
I will also review those extensions you sent me through. They look great. I didn't know they existed.

Hey @DavidArmitage,
Glad to hear this helped and you got up and running!
If you like the project please consider giving it a ⭐ on GitHub ;-)
Cheers,
Callum


[cxx-interop] Do not try to import uninstantiatable templates

Calling clangSema.isCompleteType tries to instantiate a template, and if that is impossible, returns true. This caused Swift to try to import invalid C++ template instantiations.
This was discovered during C++ interop adoption in SwiftCompilerSources:
Several LLVM headers declare a field with a type DenseMap<int, ForwardDeclared> where ForwardDeclared is defined in an implementation file (.cpp) and is not visible to ClangImporter. That is valid in C++ but caused an error when importing into Swift.

@swift-ci please smoke test

@swift-ci please smoke test


feat: Add async support to InMemoryBM25Retriever and InMemoryEmbeddingRetriever

Related Issues

https://github.com/deepset-ai/haystack/issues/6012

Proposed Changes:

Add async support to InMemoryBM25Retriever and InMemoryEmbeddingRetriever. And a fly-by doc fix.
How did you test it?

Integration tests
Checklist

I have read the contributors guidelines and the code of conduct
I have updated the related issue with new insights and changes
I added unit tests and updated the docstrings
I've used one of the conventional commit types for my PR title: fix:, feat:, build:, chore:, ci:, docs:, style:, refactor:, perf:, test:.
I documented my code
I ran pre-commit hooks and fixed any issue

Pull Request Test Coverage Report for Build<PHONE_NUMBER>1
Details

0 of 0   changed or added relevant lines in 0 files are covered.
3 unchanged lines in 1 file lost coverage.
Overall coverage increased (+0.03%) to 81.929%

Files with Coverage Reduction
New Missed Lines
%

components/tools/openapi/_schema_conversion.py
3
88.79%

Totals

Change from base Build<PHONE_NUMBER>1:
0.03%

Covered Lines:
2344

Relevant Lines:
2861

💛  - Coveralls

Failing integration tests are unrelated.


Demonstrate test failure impacting future tests

cc @issa-tseng
There's definitely something odd going on in the tests on this branch: when make test is run, the failure of the first (modified) test causes the second test to time out.
Example log
  0 passing (4s)
  2 failing

  1) api: /forms/:id/submissions
       .csv.zip GET
         should return a zipfile with the relevant attachments:

      Uncaught AssertionError: expected 'SubmissionDate,meta-instanceID,file1,file2,KEY,SubmitterID,SubmitterName,AttachmentsPresent,AttachmentsExpected,Status,ReviewState,DeviceID,Edits,FormVersion' to be 'ubmissionDate,meta-instanceID,file1,file2,KEY,SubmitterID,SubmitterName,AttachmentsPresent,AttachmentsExpected,Status,ReviewState,DeviceID,Edits,FormVersion'
      + expected - actual

      -SubmissionDate,meta-instanceID,file1,file2,KEY,SubmitterID,SubmitterName,AttachmentsPresent,AttachmentsExpected,Status,ReviewState,DeviceID,Edits,FormVersion
      +ubmissionDate,meta-instanceID,file1,file2,KEY,SubmitterID,SubmitterName,AttachmentsPresent,AttachmentsExpected,Status,ReviewState,DeviceID,Edits,FormVersion

      at Assertion.fail (node_modules/should/cjs/should.js:275:17)
      at Assertion.value (node_modules/should/cjs/should.js:356:19)
      at odk/backend/test/integration/api/submissions.js:1496:31
      at odk/backend/test/util/zip.js:41:23
      at odk/backend/node_modules/streamtest/src/index.js:245:9
      at Writable.<anonymous> (node_modules/streamtest/src/index.js:232:9)
      at Writable.emit (domain.js:475:12)
      at finish (internal/streams/writable.js:657:10)
      at processTicksAndRejections (internal/process/task_queues.js:82:21)

  2) api: /forms/:id/submissions
       .csv.zip GET
         should filter attachments by the query:
     Error: Timeout of 2000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (odk/backend/test/integration/api/submissions.js)
      at listOnTimeout (internal/timers.js:557:17)
      at processTimers (internal/timers.js:500:7)

make: *** [Makefile:34: test] Error 2

@issa-tseng this feels related to test timeouts that we've been discussing.  However, I've found a fix for this specific issue and will open a separate PR addressing the issue.

A fix can be seen at https://github.com/alxndrsn/odk-central-backend/compare/test-failure-leakage...alxndrsn:odk-central-backend:test-failure-leakage-fix?expand=1

@alxndrsn, can this be closed now that #542 is merged?


c40d30da-f3e2-44a8-88dd-30fd3643a805

this is for automated testing

25d893e9-1b25-437c-9cde-331e5caae762


Unable to pass user input during debug, in C++

VSCode Version: Version: 1.48.1
Commit: 3dd905126b34dcd4de81fa624eb3a8cbe7485f13
Date: 2020-08-19T17:09:41.484Z
Electron: 7.3.2
Chrome: 78.0.3904.130
Node.js: 12.8.1
V8: 7.8.279.23-electron.0
OS: Darwin x64 20.0.0
OS Version: macOS 11.0 / I had the same issue before update as well, so includes Catalina 10.15.6 as well

Steps to Reproduce:

Configure the launch.json and tasks.json for g++
click on debug and click start.

Does this issue occur when all extensions are disabled?: Yes/No
Yes.
The debugger moves fine till it encounters a line requiring user input and stops.

### Works till here and then this happens

I have tried setting the external console as true, but then the debugger refuses to start. It gets stuck right at the beginning and doesn't step into main.
Here is the launch.json

/extCpp


Added config filter for war ear goals.

Fixes #1139

The latest snapshot for 3.3.5-M2 is since april 21: https://oss.sonatype.org/service/local/repositories/snapshots/content/io/openliberty/tools/liberty-maven-plugin/3.3.5-M2-SNAPSHOT/liberty-maven-plugin-3.3.5-M2-20210421.231712-1.jar
Is it possible to create a newer snapshot so we can test this?  Also, in RunServerMojo.java just before line 58 in the ear case, should we not run the maven-ear-plugin generate-application-xml just as the default lifecycle does currently?
Is it possible for us non initiated to trigger such snapshot?

@marioja Thanks for reaching out. I do believe you are correct about the generate-application-xml goal for RunServerMojo.java. We will get another PR opened to fix that.
As for snapshot, asking for one in the issue or PR is the right way to go. After we get the additional fix in, I will create a snapshot and post here to let you know it is available.
As for the next release, we do them as needed (when there is enough new function or fixes that someone needs). There is not a set published schedule. Some new function is planned in June and I was planning on doing a release by the end of June. But we can revisit that if the snapshot is not sufficient.

@marioja The 3.3.5-M2-SNAPSHOT has been refreshed with the fix for this issue. Please let us know if the issue is not resolved.


Add: New project Stopwatch

Added a new Project Stopwatch and updated the project list

[x] Add a Project?
[ ] Fix a bug or typo in an existing Projects?
[ ] Documentation change?

Checklist:

[x] I have read CONTRIBUTING.md.
[x] This pull request is all my own work -- I have not plagiarized.
[x] I know that pull requests will not be merged if they fail the automated tests.
[x] This PR only changes one Project folder.  To ease review, please open separate PRs for separate algorithms.
[x] All new Project files are placed inside an existing directory.
[ ] If this pull request resolves one or more open issues then the description above includes the issue number(s) with a closing keyword: "Fixes #ISSUE-NUMBER".
[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[x] I have commented my code, particularly in hard-to-understand areas
[x] My changes generate no new warnings
[x] The title of my pull request is a short description of the requested changes.
[x] I have made corresponding changes to the documentation
[ ] My PR needs documentation change

ATTACH SCREEN-SHOTS

Before
After

< After Image >

Hi. I changed the variable names to be more readable

hr -> hour
min -> minute
sec -> second
ms -> millisecond

Also I added a comment at the beginning of each function to explain its working

You can also checkout our Idea-Arca, the project idea bank for any languages, for open-source contributions.
Happy Contributing season!
Keep up the good work!


Integral constraints like that of the Catenary Problem (constant path length)

How can I implement integral constraints like those seen in the classic variations problem of a hanging rope? The problem states a lagrangian
L = \int y\sqrt{1+y'^2}

And it is subject to a path (rope) length which can be written like
\int \sqrt{1+y'^2} = c

Obviously the end points of the rope are fixed.
I am unsure how to implement a constraint like that. Adding it to the cost function doesnt seem to give me the correct catenary shape. Has anyone successfully been able to solve the catenary problem or one with a similar path length constraint?

@Bobingstern Sorry for the late answer. I missed your message.
Usually we add a component to the state. Let's call it s. The dynamics of this new state is given by the integrand of the constraint and you add two limit constraints, s(0) = 0 and s(tf) = c.


About the accuracy of the asym noise in cifar10

Hello, thanks for your nice work!
I run the Train_cifar.py code, and set the noise_mode to asym, the r( noise rate) to 0.4  .
Then I found the highest accuracy is 83.+ , differing from your paper mentioned about 92.1/93.4.
Am I make some mistake or need to change some hyperparameter?
Thank~
....
Epoch:280   Accuracy:81.89
Epoch:281   Accuracy:81.77
Epoch:282   Accuracy:82.54
Epoch:283   Accuracy:82.56
Epoch:284   Accuracy:82.96
Epoch:285   Accuracy:82.65
Epoch:286   Accuracy:82.90
Epoch:287   Accuracy:82.20
Epoch:288   Accuracy:82.63
Epoch:289   Accuracy:82.06
Epoch:290   Accuracy:82.03
Epoch:291   Accuracy:82.68
Epoch:292   Accuracy:82.34
Epoch:293   Accuracy:82.37
Epoch:294   Accuracy:83.15
Epoch:295   Accuracy:82.32
Epoch:296   Accuracy:82.14
Epoch:297   Accuracy:82.18
Epoch:298   Accuracy:82.28
Epoch:299   Accuracy:82.63
Epoch:300   Accuracy:82.62

Hi, thanks for your interest!
As shown in our paper's appendix, for asym noise, lambda_u = 0.


Button Column visibility and Column Search for v6.0

Hi, i didn't find myself any example of how to implement these functions as the documents i found is out of date and can not use for the new script. Please help me.
For Button Column visibility:
I tried add 'colvis' to buttons array and implement assets from datatables.net but it seem not working.
For Column Search:
I don't know how to implement the search script to script.blade.php.

Just set visible: false or if using the builder, 'visible' => fase on your column definition.

Hi, this is one of the buttons function, here is the link : https://datatables.net/reference/button/colvis#Examples
For the Column search, i was able to achieve it follow your tutorial here https://github.com/yajra/laravel-datatables/issues/422. thanks so much.

I see. Sorry but I haven't used colvis yet. Will try to have a look at it on my free time.

Hi, i was able to resolve the issue in an easy way, just include the newest css and js of datatables.net have colvis and place buttons.server-side.js below it so it can override the functions.

Hi kingofkilled. Can you post the code?


Error with tolerations

I have a simple deployment, and I need to mount secrets from AWS SM. The deployment has tolerations. When attempting to retrieve the secrets, I receive the following error: MountVolume.SetUp failed for volume "secrets" : rpc error: code = DeadlineExceeded desc = context deadline exceeded.
secrets-store-csi-driver-provider-aws pod logs:
I0628 09:56:14.620420       1 server.go:124] Servicing mount request for pod dev-test-77b9f4876d-qv26c in namespace dev using service account dev-secretmanager-sa with region(s) eu-west-1
I0628 09:56:14.624478       1 auth.go:123] Role ARN for dev:dev-secretmanager-sa is arn:aws:iam:::role/dev-secretmanager-role
W0628 09:58:14.595198       1 secrets_manager_provider.go:84] eu-west-1: Failed fetching secret dev/secret: RequestCanceled: request context canceled
caused by: context canceled
E0628 09:58:14.595275       1 server.go:151] Failure getting secret values from provider type secretsmanager: Failed to fetch secret from all regions: dev/secret

secrets-store-csi-driver and secrets-store-csi-driver-provider-aws are installed via Helm with default values and necessary tolerations. The pods of both daemonsets are running on the required node.
When I run the deployment without tolerations (the pods are deployed on a different node accordingly), it mounts correctly (which gives me reason to believe that service account, arn and other settings are configured correctly).
Steps to reproduce the behavior:
---
apiVersion: secrets-store.csi.x-k8s.io/v1
kind: SecretProviderClass
metadata:
  name: test
  namespace: dev
spec:
  provider: aws
  parameters:
    objects: |
        - objectName: "dev/secret"
          objectType: "secretsmanager"
---
apiVersion: apps/v1
kind: Deployment
metadata:
  name: dev-test
  namespace: dev
spec:
  replicas: 1
  selector:
    matchLabels:
      app.kubernetes.io/name: dev-test
  template:
    metadata:
      labels:
        app.kubernetes.io/name: dev-test
    spec:
      serviceAccountName: dev-secretmanager-sa
      containers:
        - name: test
          image: "alpine"
          imagePullPolicy: IfNotPresent
          volumeMounts:
            - name: secrets
              mountPath: "/etc/secrets"
              readOnly: true
      volumes:
        - name: secrets
          csi:
            driver: secrets-store.csi.k8s.io
            readOnly: true
            volumeAttributes:
              secretProviderClass: "test"
      tolerations:
        - key: node-role/test
          operator: Equal
          value: 'true'
          effect: NoSchedule

It seems that this bug has already been noticed #299
Any ideas please

Can you provide information about the environment difference between the tolerated nodes (node-role/test) and the other nodes in the cluster?

Hmm, I'm not seeing anything in there that suggests the CSI driver would fail to work on the tainted nodes.
Are you able to reproduce this on two completely identical node pools (with the only diff being the taint)?
Did the CSI Driver and the AWS provider deploy to the tainted nodes?

Since the timeout during volume setup issue happened only when deploying with affinity rule, likely it's related to the node that matches the affinity rule.
Can you verify that the node meeting affinity criteria ((test: "true") has sufficient resources? You can use kubectl top nodes to get resource usage metrics.
In addition, please verify that the node meeting the affinity criteria has correct network configuration. You may ssh into the required node, and try test connectivity with curl https://secretsmanager.<region>.amazonaws.com.
Does the kubelet logs on the node that meets affinity rule indiate any errors or warnings related to volume setup?

Were you able to resolve the issue?


Help with reloading Motion component

Hi,
How can I make my Motion component reload again once it rests? Just some hint will be fine. I want to rotate my animation not just one loop, but as long as I'd like to. Thanks a bunch!

Check react-motion-loop
On Tue, 27 Dec 2016 at 21:56, cool88<EMAIL_ADDRESS>wrote:

Hi,
How can I make my Motion component reload again once it rests? Just some
hint will be fine. I want to rotate my animation not just one loop, but as
long as I'd like to. Thanks a bunch!
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/chenglou/react-motion/issues/414, or mute the thread
https://github.com/notifications/unsubscribe-auth/AAKsoOXpeFIBbaf2ZAI8EEvd48ZgHwnCks5rMO7cgaJpZM4LWMsm
.


Keep temporary directory until library is released

This makes it easier to debug jetski libraries as stack traces will contain function names.

looks sensible to me :+1:


[BUG] Azure Communication Calling iOS SDK version 2.2.0 crashes on start call function

Describe the bug
I am trying to start a one on one call using Azure CommunicationCalling sdk for iOS. I am getting a crash inside one of the sdk functions as shown in screenshot for backtrace below.
Exception or Stack Trace
Exception:- *** Terminating app due to uncaught exception 'NSInvalidArgumentException', reason: '*** -[__NSArrayM insertObject:atIndex:]: object cannot be nil'
terminating with uncaught exception of type NSException
Stack Trace:-
Thread#0	0x00000001d70a6248 in __exceptionPreprocess ()
#1	0x00000001d0473a68 in objc_exception_throw ()
#2	0x00000001d724a6d4 in _CFThrowFormattedException ()
#3	0x00000001d72475cc in -[__NSArrayM insertObject:atIndex:].cold.1 ()
#4	0x00000001d70b0350 in -[__NSArrayM insertObject:atIndex:] ()
#5	0x000000010699cfe4 in -[ACSIdentifiers toMRIs:] ()
#6	0x000000010697b044 in -[ACSCallAgent startCall:options:withCompletionHandler:] ()
#7	0x0000000102500648 in CallManager.startCall(callee:successHandler:)
I have verified that call agent and communication identifier arr obj passed is not nil.
To Reproduce
Steps to reproduce the behavior:
simply getting a crash on execute the start call function.
Code Snippet
Code for start call:-
func startCall(callee: String, successHandler: @escaping (Call?) -> Void ) {
    // start call logic
    debugPrint(callee)
    let callees:[CommunicationIdentifier] = [CommunicationUserIdentifier(callee)]
    debugPrint(callees)
    self.callAgent?.startCall(participants: callees, options: StartCallOptions()) { (call, error) in
        if let error = error {
            debugPrint(error.localizedDescription)
            successHandler(nil)
        } else {
            self.call = call
            debugPrint("call placed successfully")
            successHandler(call)
        }
    }
}

Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Setup (please complete the following information):

OS: iOS 16.0.3
IDE : Xcode 14.0.1
Azure Communication Calling Version:- 2.2.0

Additional context
I have verified that call agent and communication identifier arr obj passed is not nil.
"8:acs:c95f80a2......"
[<AzureCommunicationCommon.CommunicationUserIdentifier: 0x28323a580>]

@ashishpatill thanks for the report. @raosanat can you please take a look?

We are looking into these old bugs and closing, can you please try with latest version and if still reproducible, feel free to reopen.

Yes its fixed with next version released after i created the bug.


[improve][doc] added instructions about how to run ci from fork

Motivation
As commented here, moving this instruction, how to run Pulsar CI from fork, to the contribution page in order to make it more accessible for new contributors.
Modifications
Added instructions about how to run Pulsar CI from forked github repositories in the contribution page.
Verifying this change
This change is a trivial rework / code cleanup without any test coverage.
Does this pull request potentially affect one of the following parts:
If yes was chosen, please highlight the changes

Dependencies (does it add or upgrade a dependency): (yes / no)
The public API: (yes / no)
The schema: (yes / no / don't know)
The default values of configurations: (yes / no)
The wire protocol: (yes / no)
The rest endpoints: (yes / no)
The admin cli options: (yes / no)
Anything that affects deployment: (yes / no / don't know)

Documentation
Check the box below or label this PR directly.
Need to update docs?

[ ] doc-required
(Your PR needs to update docs and you will update later)

[ ] no-need-doc
(Please explain why)

[x] doc
(Your PR contains doc changes)

[ ] doc-added
(Docs have been already added)

Thank you for checking this PR. I resolved the above comments.

@heesung-sn @Anonymitaet It looks like these instructions have been dropped and aren't on the new website. Would it be possible to get the content to the new website too?

@heesung-sn @Anonymitaet It looks like these instructions have been dropped and aren't on the new website. Would it be possible to get the content to the new website too?

Raised a PR to the new website repo, https://github.com/apache/pulsar-site/pull/111/
@Anonymitaet could you check this by any chance?

@heesung-sn @Anonymitaet It looks like these instructions have been dropped and aren't on the new website. Would it be possible to get the content to the new website too?

Raised a PR to the new website repo, apache/pulsar-site#111 @Anonymitaet could you check this by any chance?

sure, commented in your new PR.


Add 'static lifetime bounds to SPIS DMA buffers

We need + 'static on the WriteBuffer/ReadBuffer bounds

This PR is probably relevant here and elsewhere in nrf-hal: https://github.com/rust-embedded/embedded-dma/pull/6


loss_rpn_cls=0, loss_bbox=0

Hi,
I train Faster RCNN model using  custom data in COCO style, but it makes loss_rpn_bbox: 0.0000 and loss_bbox: 0.0000, the detailed log info are shown in below:
2020-05-16 14:56:10,068 - mmdet - INFO - Start running, host: root@53acd6a3dfd7, work_dir: /dengjinhong/github/tdd_mmdetection/work_dirs/faster_rcnn_r50_fpn_1x_20200516163338
2020-05-16 14:56:10,068 - mmdet - INFO - workflow: [('train', 1)], max: 12 epochs
2020-05-16 14:56:28,250 - mmdet - INFO - Epoch [1][50/534]      lr: 0.00198, eta: 0:38:23, time: 0.362, data_time: 0.013, memory: 3274, loss_rpn_cls: 0.2651, loss_rpn_bbox: 0.0000, loss_cls: 0.4077, acc: 91.1543, loss_bbox: 0.0000, loss: 0.6728
2020-05-16 14:56:42,271 - mmdet - INFO - Epoch [1][100/534]     lr: 0.00398, eta: 0:33:46, time: 0.280, data_time: 0.006, memory: 3274, loss_rpn_cls: 0.0000, loss_rpn_bbox: 0.0000, loss_cls: 0.4531, acc: 100.0000, loss_bbox: 0.0000, loss: 0.4531
2020-05-16 14:56:57,230 - mmdet - INFO - Epoch [1][150/534]     lr: 0.00597, eta: 0:32:44, time: 0.299, data_time: 0.007, memory: 3274, loss_rpn_cls: 0.0000, loss_rpn_bbox: 0.0000, loss_cls: 0.1650, acc: 100.0000, loss_bbox: 0.0000, loss: 0.1650
2020-05-16 14:57:12,471 - mmdet - INFO - Epoch [1][200/534]     lr: 0.00797, eta: 0:32:14, time: 0.305, data_time: 0.007, memory: 3274, loss_rpn_cls: 0.0000, loss_rpn_bbox: 0.0000, loss_cls: 0.0266, acc: 100.0000, loss_bbox: 0.0000, loss: 0.0266
2020-05-16 14:57:27,834 - mmdet - INFO - Epoch [1][250/534]     lr: 0.00997, eta: 0:31:53, time: 0.307, data_time: 0.007, memory: 3274, loss_rpn_cls: 0.0000, loss_rpn_bbox: 0.0000, loss_cls: 0.0078, acc: 100.0000, loss_bbox: 0.0000, loss: 0.0078
2020-05-16 14:57:43,162 - mmdet - INFO - Epoch [1][300/534]     lr: 0.01197, eta: 0:31:33, time: 0.307, data_time: 0.006, memory: 3274, loss_rpn_cls: 0.0000, loss_rpn_bbox: 0.0000, loss_cls: 0.0039, acc: 100.0000, loss_bbox: 0.0000, loss: 0.0039
2020-05-16 14:57:58,621 - mmdet - INFO - Epoch [1][350/534]     lr: 0.01397, eta: 0:31:17, time: 0.309, data_time: 0.006, memory: 3274, loss_rpn_cls: 0.0000, loss_rpn_bbox: 0.0000, loss_cls: 0.0023, acc: 100.0000, loss_bbox: 0.0000, loss: 0.0023
2020-05-16 14:58:14,038 - mmdet - INFO - Epoch [1][400/534]     lr: 0.01596, eta: 0:31:00, time: 0.308, data_time: 0.007, memory: 3274, loss_rpn_cls: 0.0000, loss_rpn_bbox: 0.0000, loss_cls: 0.0016, acc: 100.0000, loss_bbox: 0.0000, loss: 0.0016
2020-05-16 14:58:29,521 - mmdet - INFO - Epoch [1][450/534]     lr: 0.01796, eta: 0:30:45, time: 0.310, data_time: 0.007, memory: 3274, loss_rpn_cls: 0.0000, loss_rpn_bbox: 0.0000, loss_cls: 0.0011, acc: 100.0000, loss_bbox: 0.0000, loss: 0.0011
2020-05-16 14:58:44,967 - mmdet - INFO - Epoch [1][500/534]     lr: 0.01996, eta: 0:30:29, time: 0.309, data_time: 0.006, memory: 3274, loss_rpn_cls: 0.0000, loss_rpn_bbox: 0.0000, loss_cls: 0.0008, acc: 100.0000, loss_bbox: 0.0000, loss: 0.0008
[>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>] 527/527, 14.5 task/s, elapsed: 36s, ETA:     0s2020-05-16 14:59:34,089 - mmdet - INFO - Evaluating bbox...
Loading and preparing results...
2020-05-16 14:59:34,090 - mmdet - ERROR - The testing results of the whole dataset is empty.
2020-05-16 14:59:34,091 - mmdet - INFO - Epoch [1][534/534]     lr: 0.02000,
2020-05-16 14:59:49,768 - mmdet - INFO - Epoch [2][50/534]      lr: 0.02000, eta: 0:28:19, time: 0.312, data_time: 0.011, memory: 3274, loss_rpn_cls: 0.0000, loss_rpn_bbox: 0.0000, loss_cls: 0.0006, acc: 100.0000, loss_bbox: 0.0000, loss: 0.0006
2020-05-16 15:00:05,338 - mmdet - INFO - Epoch [2][100/534]     lr: 0.02000, eta: 0:28:13, time: 0.311, data_time: 0.006, memory: 3274, loss_rpn_cls: 0.0000, loss_rpn_bbox: 0.0000, loss_cls: 0.0005, acc: 100.0000, loss_bbox: 0.0000, loss: 0.0005
2020-05-16 15:00:20,848 - mmdet - INFO - Epoch [2][150/534]     lr: 0.02000, eta: 0:28:06, time: 0.310, data_time: 0.006, memory: 3274, loss_rpn_cls: 0.0000, loss_rpn_bbox: 0.0000, loss_cls: 0.0004, acc: 100.0000, loss_bbox: 0.0000, loss: 0.0004
2020-05-16 15:00:36,366 - mmdet - INFO - Epoch [2][200/534]     lr: 0.02000, eta: 0:27:57, time: 0.310, data_time: 0.006, memory: 3274, loss_rpn_cls: 0.0000, loss_rpn_bbox: 0.0000, loss_cls: 0.0003, acc: 100.0000, loss_bbox: 0.0000, loss: 0.0004
2020-05-16 15:00:51,860 - mmdet - INFO - Epoch [2][250/534]     lr: 0.02000, eta: 0:27:47, time: 0.310, data_time: 0.006, memory: 3274, loss_rpn_cls: 0.0000, loss_rpn_bbox: 0.0000, loss_cls: 0.0003, acc: 100.0000, loss_bbox: 0.0000, loss: 0.0003
2020-05-16 15:01:07,319 - mmdet - INFO - Epoch [2][300/534]     lr: 0.02000, eta: 0:27:37, time: 0.309, data_time: 0.006, memory: 3274, loss_rpn_cls: 0.0000, loss_rpn_bbox: 0.0000, loss_cls: 0.0003, acc: 100.0000, loss_bbox: 0.0000, loss: 0.0003
2020-05-16 15:01:22,718 - mmdet - INFO - Epoch [2][350/534]     lr: 0.02000, eta: 0:27:25, time: 0.308, data_time: 0.006, memory: 3274, loss_rpn_cls: 0.0000, loss_rpn_bbox: 0.0000, loss_cls: 0.0002, acc: 100.0000, loss_bbox: 0.0000, loss: 0.0003

I only make a minor change, i.e. the num_classes=5(I have 5 classes) and dataset information.
The diff between my and official config:
56c56
<             num_classes=80,
---
>             num_classes=5,
125c125
< data_root='data/coco/'
---
> data_root='data/Industrial_quality/'
172,173c172,173
<         ann_file='data/coco/annotations/instances_train2017.json',
<         img_prefix='data/coco/train2017/',
---
>         ann_file='data/Industrial_quality/filtered_target_domain_train.json',
>         img_prefix='data/Industrial_quality/target_domain/all_img/',
194,195c194,195
<         ann_file='data/coco/annotations/instances_val2017.json',
<         img_prefix='data/coco/val2017/',
---
>         ann_file='data/Industrial_quality/filtered_target_domain_test.json',
>         img_prefix='data/Industrial_quality/target_domain/all_img/',
217,218c217,218
<         ann_file='data/coco/annotations/instances_val2017.json',
<         img_prefix='data/coco/val2017/',
---
>         ann_file='data/Industrial_quality/filtered_target_domain_test.json',
>         img_prefix='data/Industrial_quality/target_domain/all_img/',

It is noted that this config could work well in v1.x of mmdetection.
I take a lot of time to fix this issue, but it can not solved by me.
Anyone could help me? Big thanks!

hi: when i train the mode called fcos using the datasets in coco format，i find it always makes loss_bbox=0 and loss_centerness=0.
Is there anyone know the reason? thank you very much!

maybe mm2.0 is unstable,  you can try mm1.0 instead.

Hi @kinredon ,
If the number of classes is 5, you need also change the key classes in your dataset. MMDetection V2.0 supports to train subset of a dataset by setting their classes.

Hi @ZwwWayne ,
Thanks. But sorry to bother you again, what it the key classes in my dataset means?

I believe it is the list of class names, which is specified in the configuration file.
I am running a binary classification with a single object class at the moment, and I adapted the default configuration file to reflect my bespoke COCO formatted dataset.
I start by defining a list of class names strings at the top of the configuration file, called classes.
For each dataset dictionary (train, test, valid), I specify a key 'classes' and assign it the list of strings specified by the list object classes
_base_ = [
    '../configs/_base_/models/mask_rcnn_r50_fpn.py',
    '../configs/_base_/datasets/coco_instance.py',
    '../configs/_base_/schedules/schedule_1x.py', '../configs/_base_/default_runtime.py'
]
dataset_type = 'CocoDataset'
classes=['particle']
data_root = 'datasets/spherical_test_data_v1_5000_1500/'
img_norm_cfg = dict(
    mean=[123.675, 116.28, 103.53], std=[58.395, 57.12, 57.375], to_rgb=True)
train_pipeline = [
    dict(type='LoadMorphologiSynImage'),
    dict(type='LoadAnnotations', with_bbox=True, with_mask=True),
    dict(type='Resize', img_scale=(1296, 972), keep_ratio=True),
    dict(type='Normalize', **img_norm_cfg),
    #dict(type='Pad', size_divisor=32),
    dict(type='DefaultFormatBundle'),
    dict(type='Collect', keys=['img', 'gt_bboxes', 'gt_labels', 'gt_masks']),
]
test_pipeline = [
    dict(type='LoadMorphologiSynImage'),
    dict(
        type='MultiScaleFlipAug',
        img_scale=(1296, 972),
        flip=False,
        transforms=[
            dict(type='Resize', keep_ratio=True),
            dict(type='Normalize', **img_norm_cfg),
            #dict(type='Pad', size_divisor=32),
            dict(type='ImageToTensor', keys=['img']),
            dict(type='Collect', keys=['img']),
        ])
]
data = dict(
    imgs_per_gpu=2,
    workers_per_gpu=5,
    train=dict(
        type=dataset_type,
        classes=classes,
        ann_file=data_root + 'annotations/train_coco.json',
        img_prefix=data_root + 'train/',
        pipeline=train_pipeline),
    val=dict(
        type=dataset_type,
        classes=classes,
        ann_file=data_root + 'annotations/valid_coco.json',
        img_prefix=data_root + 'valid/',
        pipeline=test_pipeline),
    test=dict(
        type=dataset_type,
        classes=classes,
        ann_file=data_root + 'annotations/valid_coco.json',
        img_prefix=data_root + 'valid/',
        pipeline=test_pipeline))
optimizer = dict(type='SGD', lr=0.02, momentum=0.9, weight_decay=0.0001)
checkpoint_config = dict(interval=1)
log_config = dict(
    interval=50,
    hooks=[
        dict(type='TextLoggerHook'),
        dict(type='TensorboardLoggerHook')
    ])
total_epochs = 30
gpus = 2

@ecm200 SSSSuper thanks!
How do you know that, is there a document mention it?

There's a new document for bespoke training formats.
https://github.com/open-mmlab/mmdetection/blob/master/docs/tutorials/new_dataset.md
In there they have an example:
...
# dataset settings
dataset_type = 'CocoDataset'
classes = ('a', 'b', 'c', 'd', 'e')
...
data = dict(
    samples_per_gpu=2,
    workers_per_gpu=2,
    train=dict(
        type=dataset_type,
        classes=classes,
        ann_file='path/to/your/train/data',
        ...),
    val=dict(
        type=dataset_type,
        classes=classes,
        ann_file='path/to/your/val/data',
        ...),
    test=dict(
        type=dataset_type,
        classes=classes,
        ann_file='path/to/your/test/data',
        ...))
...

@ecm200 SSSSuper thanks! This works for me.
How do you know that, is there a document mention it?

hello, I met the same problem, and add classes in my config file, but it still print loss value like that, have you solved? big thanks

@chencheng1203 I met the same problem as well. Any solutions?

Hi @chencheng1203.
My advice would be double, triple check your dataset format makes sense.
I chose to convert my dataset to COCO format so I could lean on all the tools that have developed to assess the COCO data, including the data loader, and the evaluation / validation of the model.
Most of my problems have stemmed from bugs I didn't catch in my input data generation workflow outside of MMDetection. Specifically, I have been generating synthetic data for the problem I am trying to solve, which includes all ancillary data such as bounding boxes, polygons and segmentation masks. As the synthetic is computationally expensive to produce, I have used augmentation to increase the amount of training data available. This involved rotations of the original image, as the images are rectangular, results in parts of polygons and bounding boxes outside of the image frame.
A majority of my problems stemmed from not having caught exceptions in the training data, to limit the polygon and bounding box extents to within the image frame. In particular, the last one that eventually solved the issue for me, was bounding boxes that had some portion of their area outside the image frame. I had removed those completely rotated out of the image frame, but not those straddling it. I solved the issue by squashing the bounding box extents to the image frame extents, and this seems to have solved the problem.
Other problems related to the training images not being of sufficient enough quality. As the process for modelling synthetic data is probablistic, there were cases where extreme model images were produced, which resulted in almost no objects in the image or a single massive object that obscured 90% of the frame.
So, the main message check, check and check again your input data and make sure your input data is as well conditioned as you can make it, avoiding pitfalls like having bounding boxes or polygons outside the image frame.

Oh the other thing with classes is to make sure they are changed in the model configuration of the bbox_head and mask_head of the roi_head.
I have a two class problem at the moment (including the background), and this is my Mask RCNN FPN ResNet101 model config. There are some bespoke additions I have made. These are mainly the image loading pipeline, where I have made a bespoke image loading function, as my images are single channel, and 12-bit. I have also subclassed the COCODataset class to make my own bespoke Dataset class, which was mainly for understanding and modifying the existing COCO evaluation functions for validation at the end of each training epoch.
I have also built a validation checkpointer hook, to save the model only if the desired validation metric has improved from the previous epoch.
This model has currently been running using 5000 image training set and is on the 10th Epoch and converging nicely
_base_ = [
    '../configs/_base_/models/mask_rcnn_r50_fpn.py',
    '../configs/_base_/datasets/coco_instance.py',
    '../configs/_base_/schedules/schedule_1x.py',
    '../configs/_base_/default_runtime.py'
]
dataset_type = 'MorphologiDataset' # 'CocoDataset'
data_root_dir = '/datadrive/drive0/willow_tree_synthetic/mpdsim/train_test_coco_fmt/'
data_dir = 'spherical_test_data_v1p4_5000_500/' # 'test_dataset_v1p2_100/' #
data_root = data_root_dir+data_dir
classes=['particle']
# Update model due to classes
model = dict(
    pretrained=None, # Don't load the pretrained weights. TODO Find out if this is needed changing number of classes.
    roi_head=dict(
        bbox_head=dict(
            type='Shared2FCBBoxHead',
            in_channels=256,
            fc_out_channels=1024,
            roi_feat_size=7,
            num_classes=len(classes), # Modified to number of classes in this problem. COCO default is 80.
            bbox_coder=dict(
                type='DeltaXYWHBBoxCoder',
                target_means=[0., 0., 0., 0.],
                target_stds=[0.1, 0.1, 0.2, 0.2]),
            reg_class_agnostic=False,
            loss_cls=dict(
                type='CrossEntropyLoss', use_sigmoid=False, loss_weight=1.0),
            loss_bbox=dict(type='SmoothL1Loss', beta=1.0, loss_weight=1.0)), # This is L1Loss in standard COCO, specified this way in CityScapes
        mask_head=dict(
            type='FCNMaskHead',
            num_convs=4,
            in_channels=256,
            conv_out_channels=256,
            num_classes=len(classes), # Modified to number of classes in this problem. COCO default is 80.
            loss_mask=dict(
                type='CrossEntropyLoss', use_mask=True, loss_weight=1.0)))
)
img_norm_cfg = dict(
    mean=[123.675, 116.28, 103.53], std=[58.395, 57.12, 57.375], to_rgb=True)
train_pipeline = [
    dict(type='LoadMorphologiSynImage'),
    dict(type='LoadAnnotations', with_bbox=True, with_mask=True),
    dict(type='Resize', img_scale=(1296, 972), keep_ratio=True),
    dict(type='Normalize', **img_norm_cfg),
    #dict(type='Pad', size_divisor=32),
    dict(type='DefaultFormatBundle'),
    dict(type='Collect', keys=['img', 'gt_bboxes', 'gt_labels', 'gt_masks']),
]
test_pipeline = [
    dict(type='LoadMorphologiSynImage'),
    dict(
        type='MultiScaleFlipAug',
        img_scale=(1296, 972),
        flip=False,
        transforms=[
            dict(type='Resize', keep_ratio=True),
            dict(type='Normalize', **img_norm_cfg),
            #dict(type='Pad', size_divisor=32),
            dict(type='ImageToTensor', keys=['img']),
            dict(type='Collect', keys=['img']),
        ])
]
data = dict(
    samples_per_gpu=2, # TODO Usually set to 2, set to 1 for debugging.
    imgs_per_gpu=2, # TODO Usually set to 2, set to 1 for debugging.
    workers_per_gpu=4,
    train=dict(
        type=dataset_type,
        classes=classes,
        ann_file=data_root + 'annotations/train_coco.json',
        img_prefix=data_root + 'train/',
        pipeline=train_pipeline),
    val=dict(
        type=dataset_type,
        classes=classes,
        ann_file=data_root + 'annotations/valid_coco.json',
        img_prefix=data_root + 'valid/',
        pipeline=test_pipeline),
    test=dict(
        type=dataset_type,
        classes=classes,
        ann_file=data_root + 'annotations/valid_coco.json',
        img_prefix=data_root + 'valid/',
        pipeline=test_pipeline))
test_cfg = dict(
    rpn=dict(
        nms_across_levels=False,
        nms_pre=1000,
        nms_post=1000,
        max_num=1000,
        nms_thr=0.7,
        min_bbox_size=0),
    rcnn=dict(
        score_thr=0.05,
        nms=dict(type='nms', iou_thr=0.5),
        max_per_img=500, # Default is 100
        mask_thr_binary=0.5)) # Default is 0.5
optimizer = dict(type='SGD', lr=0.02, momentum=0.9, weight_decay=0.0001)
checkpoint_config = dict(type='CheckpointHook', interval=1)
# checkpoint_config = dict(type='ValidationCheckpointHook', metric='acc', metric_ops='max', overwrite_checkpoint=True)
log_config = dict(
    interval=50,
    hooks=[
        dict(type='TextLoggerHook'),
        dict(type='TensorboardLoggerHook')
    ])
total_epochs = 36
lr_config = dict(step=[24, 33]) # Based on 8 and 11 for 12 Epochs.
gpus = 1
evaluation = dict(interval=1, metric='bbox') # TODO Remove, temporarily here so that evaluation is done on BBOX only at the moment as SEGM not working.

Hi @chencheng1203.
My advice would be double, triple check your dataset format makes sense.
I chose to convert my dataset to COCO format so I could lean on all the tools that have developed to assess the COCO data, including the data loader, and the evaluation / validation of the model.
Most of my problems have stemmed from bugs I didn't catch in my input data generation workflow outside of MMDetection. Specifically, I have been generating synthetic data for the problem I am trying to solve, which includes all ancillary data such as bounding boxes, polygons and segmentation masks. As the synthetic is computationally expensive to produce, I have used augmentation to increase the amount of training data available. This involved rotations of the original image, as the images are rectangular, results in parts of polygons and bounding boxes outside of the image frame.
A majority of my problems stemmed from not having caught exceptions in the training data, to limit the polygon and bounding box extents to within the image frame. In particular, the last one that eventually solved the issue for me, was bounding boxes that had some portion of their area outside the image frame. I had removed those completely rotated out of the image frame, but not those straddling it. I solved the issue by squashing the bounding box extents to the image frame extents, and this seems to have solved the problem.
Other problems related to the training images not being of sufficient enough quality. As the process for modelling synthetic data is probablistic, there were cases where extreme model images were produced, which resulted in almost no objects in the image or a single massive object that obscured 90% of the frame.
So, the main message check, check and check again your input data and make sure your input data is as well conditioned as you can make it, avoiding pitfalls like having bounding boxes or polygons outside the image frame.

well, thank you for telling me so much bro, it realy works, I found my issue in my dataset, something wrong with it

@ecm200 Thank you for your config example. You are right, this issue is caused by the classes. I didn't notice that I should add this line here for my custom dataset as a newbie to mmdetection.
train=dict(
        type=dataset_type,
       --> classes=classes,
        ann_file='path/to/your/train/data',
        ...),


compilation failed in macos bigSur

Hello, I compile  in macos bigSur by modifying Makefile.
Now it's wrong.
ld: warning: ignoring file libhfcommon/libhfcommon.a, building for macOS-x86_64 but attempting to link with file built for unknown-unsupported file format ( 0x21 0x3C 0x61 0x72 0x63 0x68 0x3E 0x0A 0x2F 0x20 0x20 0x20 0x20 0x20 0x20 0x20 )
Undefined symbols for architecture x86_64:
  "_OBJC_CLASS_$_VMUProcInfo", referenced from:
      objc-class-ref in CrashReport_Sierra.o
  "_OBJC_CLASS_$_VMUSampler", referenced from:
      objc-class-ref in CrashReport_Sierra.o
  "_OBJC_CLASS_$_VMUVMRegionIdentifier", referenced from:
      objc-class-ref in CrashReport_Sierra.o
  "_fastArray64Search", referenced from:
      _arch_reapChild in arch.o
  "_util_vssnprintf", referenced from:
      _display_put in display.o
ld: symbol(s) not found for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make: *** [honggfuzz] Error 1

Please help me, thank you very much ^^

I tested under some newer MacOSX and it compiles/works. Please re-open if it's still happening to you.

I tested under some newer MacOSX and it compiles/works. Please re-open if it's still happening to you.

Is there any pending PR fixing the Makefile and MacOS unsupported issue ?


Could not load file or assembly Microsoft.Build.Utilities.v4.0

Hi,
I just tried to use this project for generating the AssemblyInfo. I am using the sameple code
  <AssemblyInfo CodeLanguage="CS"               OutputFile="VersionInfo.cs"              AssemblyVersion="<IP_ADDRESS>"              AssemblyFileVersion="<IP_ADDRESS>" />
However, dotnet build fails:
MyProject.csproj(34,3): error MSB4062: The "MSBuild.Community.Tasks.AssemblyInfo" task could not be loaded from the assembly $MyPath\.nuget\packages\msbuildtasks\<IP_ADDRESS>\build\\..\tools\MSBuild.Community.Tasks.dll. Could not load file or assembly 'Microsoft.Build.Utilities.v4.0, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a'. The system cannot find the file specified. Confirm that the <UsingTask> declaration is correct, that the assembly and all its dependencies are available, and that the task contains a public class that implements Microsoft.Build.Framework.ITask.

The path to MSBuild.Community.Tasks.dll exists.
I am using dotnet, my project is an Sdk Style project (Microsoft.NET.Sdk) and my tagetfranework is netstandard2.0
<Project Sdk="Microsoft.NET.Sdk">
...
<TargetFrameworks>netstandard2.0</TargetFrameworks>

This is my dotnet version
.NET SDK (reflecting any global.json):
 Version:   5.0.103
 Commit:    72dec52dbd

Runtime Environment:
 OS Name:     Windows
 OS Version:  10.0.19041
 OS Platform: Windows
 RID:         win10-x64
 Base Path:   C:\Program Files\dotnet\sdk\5.0.103\

Host (useful for support):
  Version: 5.0.3
  Commit:  c636bbdc8a

.NET SDKs installed:
  1.0.0-preview2-003131 [C:\Program Files\dotnet\sdk]
  2.1.201 [C:\Program Files\dotnet\sdk]
  2.1.202 [C:\Program Files\dotnet\sdk]
  2.1.301 [C:\Program Files\dotnet\sdk]
  2.1.521 [C:\Program Files\dotnet\sdk]
  2.2.107 [C:\Program Files\dotnet\sdk]
  3.0.101 [C:\Program Files\dotnet\sdk]
  3.1.201 [C:\Program Files\dotnet\sdk]
  3.1.406 [C:\Program Files\dotnet\sdk]
  5.0.101 [C:\Program Files\dotnet\sdk]
  5.0.103 [C:\Program Files\dotnet\sdk]

.NET runtimes installed:
  Microsoft.AspNetCore.All 2.1.1 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.All]
  Microsoft.AspNetCore.All 2.1.25 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.All]
  Microsoft.AspNetCore.All 2.2.5 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.All]
  Microsoft.AspNetCore.App 2.1.1 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 2.1.25 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 2.2.5 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 3.0.1 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 3.1.3 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 3.1.12 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 5.0.1 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 5.0.3 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.NETCore.App 1.0.1 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 2.0.7 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 2.0.9 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 2.1.1 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 2.1.25 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 2.2.5 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 3.0.1 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 3.1.3 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 3.1.12 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 5.0.1 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 5.0.3 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.WindowsDesktop.App 3.0.1 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
  Microsoft.WindowsDesktop.App 3.1.3 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
  Microsoft.WindowsDesktop.App 3.1.12 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
  Microsoft.WindowsDesktop.App 5.0.1 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
  Microsoft.WindowsDesktop.App 5.0.3 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]

Any idea what I could check?

I have attached a minimal sample here
msbuildtasks-test.zip

Bit old now but after hours of staring at forum posts and diagnostic output I've come to the conclusion that it's related to this
https://natemcmaster.com/blog/2017/07/05/msbuild-task-in-nuget/
https://github.com/loresoft/msbuildtasks/issues/253


docs(en): optional step for custom gh-pages domain

For gh-pages.
See:
https://github.com/withastro/docs/issues/1016#issue-1306760334

What kind of changes does this PR include?

New or updated content

Description
Add optional step for custom domain with GH Pages

Tried making this change on your behalf, to make it simpler than you figuring out how to make that change here! Now, you can take a look and see what you think or what you'd change @JulianCataldo ! Thanks for your patience!

I don't like that the original text comes back. It's kinda long + the GH Docs are confusing. That's why I originally changed the text to be more simple.

I am not in favour of removing links to official documentation, no matter poor they might be (and, that's a judgement call for each person to make).
I'm happy for someone else to weigh in, but it would take a lot of convincing for me to NOT see it as a service to the reader to link to official docs to what they're trying to do! It at least points them to exactly where in those docs they should be looking. That's literally what that link is for, and we can't control how good someone else's documentation is, nor do we know how helpful any one person will find it.
I'm also open to (and was) discussion how important detailing the description of what happens, vs just what to do in the rest of the instruction. Whenever we suggest something to do with a particular file, and it makes sense to do so, we do show a code sample. Visuals are helpful, even if they take up space. So, I'm personally in favour of keeping the code sample of the new file we're instructing someone to create. It is much cleaner visually than having a paragraph that describes "make this file" and "put this in it." So that's my rationale for reintroducing the original, clear STEP (make this file) and VISUAL code snippet.
Where this PR had originally stalled was discussion on is it helpful (or muddying the waters) to say that GH actions will pick it up in dist, and do this etc. So it's that sentence after the code sample we can keep discussing. That was the one I don't think is necessary, but recognize could be useful and helpful.
So that's where I am with this PR! How about everyone else??  😅

IT'S TIME!
@JulianCataldo , thank you so much for (a) your contribution and (b) letting us take over your branch like this! Sorry for all the notifiations.  😅
What a FIRST-TIME CONTRIBUTION, eh? Did you know what you were getting yourself into? Welcome to Team Docs!


Added jitter to retry intervals

Codecov Report

Merging #377 into dev will increase coverage by 0.03%.
The diff coverage is 100%.

@@            Coverage Diff             @@
##              dev     #377      +/-   ##
==========================================
+ Coverage   86.05%   86.08%   +0.03%
==========================================
  Files          56       56
  Lines        4346     4356      +10
  Branches      464      464
==========================================
+ Hits         3740     3750      +10
  Misses        460      460
  Partials      146      146

Impacted Files
Coverage Δ

azure-storage-common/azure/storage/common/retry.py
90.66% <100%> (+1.43%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update bd7a327...057e8e0. Read the comment docs.


ci: enable signoff on autobumper

btw, I did...mmmh, how to say it...test?? this properly so Im not sure it will work :D
It should according to our env vars but who knows...

no need to waste test cycles on this BTW


Vita snake

New Port for { vitaSnake }
Game Information

Title: { vitaSnake }
URL: { https://github.com/Grzybojad/vitaSnake }

Submission Requirements
CFW Tests
Ensure your game has been tested on all major CFWs:

[ X] AmberELEC
[X ] ArkOS
[ X] ROCKNIX
[ X] muOS

Resolution Tests
Test all major resolutions:

[X ] 480x320
[X ] 640x480
[X ] 720x720 (RGB30)
[X ] Higher resolutions (e.g., 1280x720)

File Structure

Your port should have the following structure:

portname/

port.json
README.md
screenshot.jpg
cover.jpg
gameinfo.xml
Port Name.sh
portname/

Additional Resources
For an in-depth guide on creating a pull request, refer to: PortMaster Game Packaging Guide

The port file/folder structure must be revised, it should be something like this:
spookynakki % tree
.
├── README.md
├── Vitasnake.sh
├── cover.png
├── gameinfo.xml
├── port.json
├── screenshot.png
└── vitasnake
    ├── game.apk
    ├── gamedata
    ├── gmloader
    └── libs

I wasn't sure how to test this so I set it like that.
But this game should be able to run on something like RK3326.
https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail
Virus-free.www.avast.com
https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail
<#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
On Thu, Sep 19, 2024 at 11:30 PM Cebion @.***> wrote:

@.**** commented on this pull request.
In ports/vitasnake/port.json
https://github.com/PortsMaster/PortMaster-New/pull/667#discussion_r1767619633
:

 "Slobters"

],
"desc": "A snake game with smooth rotation made for the PS Vita with LibVita2D. Turn left and right to collect as many apples as you can, but avoid biting your tail, or you will lose the game.",
"desc_md": null,
"inst": "Ready to run !",
"inst_md": null,
"genres": [

 "action",

 "arcade"

],
"image": null,
"rtr": true,
"exp": false,
"runtime": null,
"reqs": [

 "power"

This requirement is set if it only works on cpus above RK3326 is this
correct?
—
Reply to this email directly, view it on GitHub
https://github.com/PortsMaster/PortMaster-New/pull/667#pullrequestreview-2316783001,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A7WIAQ3OUCEC6JOST6MXXSLZXM7BBAVCNFSM6AAAAABOKH6L3GVHI2DSMVQWIX3LMV43YUDVNRWFEZLROVSXG5CSMV3GSZLXHMZDGMJWG44DGMBQGE
.
You are receiving this because you authored the thread.Message ID:
@.***>

Fixed!
I moved the licence file into the second vitasnake folder. Is that ok?
https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail
Virus-free.www.avast.com
https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail
<#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
On Mon, Sep 23, 2024 at 9:17 AM Cebion @.***> wrote:

@.**** requested changes on this pull request.
The file structure is wrong.
In the top vitasnake folder you only need readme, cover, gameinfo.xml,
portj.json, screenshot and the .sh
—
Reply to this email directly, view it on GitHub
https://github.com/PortsMaster/PortMaster-New/pull/667#pullrequestreview-2321298083,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/A7WIAQ4U3AZ3JLVCPXR2JOTZX657XAVCNFSM6AAAAABOKH6L3GVHI2DSMVQWIX3LMV43YUDVNRWFEZLROVSXG5CSMV3GSZLXHMZDGMRRGI4TQMBYGM
.
You are receiving this because you authored the thread.Message ID:
@.***>


Does not work with ES2015 syntax!

Works very well with traditional JS!
But, I get JScriptCodeDom.CodeParseException errors (e.g. => operator gives Unexpected Operator fatal error) for newer JS syntax.

The JavaScript Obfuscator accepts ES5 code. You can transforms your code from ES6 to ES5 and then obfuscate them.

I see.
Anyway, Thank you!


non-esm version

Would you be up for publishing a version that doesn't require esm?

I knew this issue will come. I'll publish both CJS and ESM following the Solving the "ESM in NodeJS" Odyssey. I really like ESM only mode but this decision is not likely to become popular any time soon.
How painful is to use esm loader for 3rd party libs?

It's not terribly painful, just a little obnoxious since it's not part of my "regular" workflow. For now, I'm just doing this:
npm install --save-dev esm
npm install --save foxr
node -r esm my-program.js

This said, since adoption of ESM is pretty low, I do think it'd be great if you did publish a CJS version 😄

Just landed with v0.2.0:
const foxr = require('foxr').default

Thanks dude!


Verify mop works on Pulsar 2.6.1

https://github.com/streamnative/mop/issues/20#issuecomment-709898836

In the version of pulsar 2.6.1, mop does not work properly, this is because mop currently uses the version of pulsar 2.6.0, which leads to incompatibility

@wolfstudy Could you please push a fix for it?

@wolfstudy Could you please push a fix for it?

Sure, https://github.com/streamnative/mop/pull/22 is fixing the issue.


Does not support SNI?

Looks like plugin does not support SNI.
If Redmine is hosted on server with other sites, the plugin seem to connect by IP address and default site is requested. Which causes exception:
com.taskadapter.redmineapi.RedmineTransportException:
Cannot fetch data from https://redminesite.com/enumerations/issue_priorities.json :
javax.net.ssl.SSLException: Certificate for <redminesite.com> doesn't match any of the subject alternative names: [*.someothersirte.com, comeothersite.com]

And looks like this was implemented in the adaptor: 2.5.0 https://github.com/taskadapter/redmine-java-api/issues/212
This project uses 2.6.0.


Missing some icons

Not sure this is a bug persay, but icons from other windows dlls are not showing.
Same partition and folders in Windows default Explorer vs Files.
Latest version since I just reinstalled windows 21H1 (fresh)
https://imgur.com/a/5pkQXY9

there still in the process of implemting them

@josh-65 This is unrelated to the sidebar icons.
@minidarknova This issue should be resolved when we release v2.


fix: Address typo in log statement "directory has be set as the..."

Before:

"The './docs' directory has be set as the output location by default"

After:

"The './docs' directory has been set as the output location by default"

Thanks!


[BUG] Issue title...

I am training  VIT Transformer using a pre-trained VIT model where I selected vit_base_patch16_224 model which 224_224 image. The model is that my dataset contains image size by 222_222. The new dataset contains 7 classes
How I can handle this?
Traceback (most recent call last):
  File "/media/khawar/HDD_Khawar/RSC/Domain_Generalization/train.py", line 176, in <module>
    main()
  File "/media/khawar/HDD_Khawar/RSC/Domain_Generalization/train.py", line 171, in main
    trainer.do_training()
  File "/media/khawar/HDD_Khawar/RSC/Domain_Generalization/train.py", line 145, in do_training
    self._do_epoch(self.current_epoch)
  File "/media/khawar/HDD_Khawar/RSC/Domain_Generalization/train.py", line 103, in _do_epoch
    class_logit = self.model(data, class_l, True, epoch)
  File "/home/khawar/anaconda3/envs/RSC/lib/python3.7/site-packages/torch/nn/modules/module.py", line 722, in _call_impl
    result = self.forward(*input, **kwargs)
  File "/home/khawar/anaconda3/envs/RSC/lib/python3.7/site-packages/timm/models/vision_transformer.py", line 377, in forward
    x = self.forward_features(x)
  File "/home/khawar/anaconda3/envs/RSC/lib/python3.7/site-packages/timm/models/vision_transformer.py", line 362, in forward_features
    x = self.patch_embed(x)
  File "/home/khawar/anaconda3/envs/RSC/lib/python3.7/site-packages/torch/nn/modules/module.py", line 722, in _call_impl
    result = self.forward(*input, **kwargs)
  File "/home/khawar/anaconda3/envs/RSC/lib/python3.7/site-packages/timm/models/vision_transformer.py", line 221, in forward
    f"Input image size ({H}*{W}) doesn't match model ({self.img_size[0]}*{self.img_size[1]})."
AssertionError: Input image size (222*222) doesn't match model (224*224).

@khawar512 not a bug, image size needs to be divisible by patch size and you need to create the model with a specific image size (cannot change it easily like a convnet). So resize your images to 224x224 if you want to use a pretrained model


esy dashboard/assistant

The standalone command esy could do something better than merely print environment variables.

It could teach you how to use esy.
It could quickly report the health of the project (what's installed/missing/built/building/cached)
It could help you debug the most common issues (why your editor tooling / environment isn't working) etc.
Which packages are symlinked. When was the last time a file in that symlinked package was modified? When was the last tie it was built?

Another possibility is that esy build and esy install by default are sent to the background, and the esy command could show the progress for the current project.

Also, perhaps someone could easily  adapt the react-blessed dashboard examples to show which packages are building/completed, and which ones are blocked, failed, and how many cache hits were found:
https://github.com/Yomguithereal/react-blessed

I could imagine esy build firing up this dashboard.
I could imagine esy stat firing up a simplified non-build-related dashboard that shows information about your project, dependencies, binaries brought into scope by packages, ocamlfind libraries available for use.


Utils not found

After the neuralfingerprint install (pip install -e /my_dir/, I'm trying to run the examples (regression.py), but I get a 'utils' not found error...
Can you please help, thanks!

I opened the terminal in the directory "example" and run "regression.py", and I got the same error.
So I added the following two sentences to "regression.py":
import sys
sys.path.append("../")
After that, I changed my python environment from python 3 to python 2. Then everything worked out fine. I don't know why python 3 doesn't support this……


Deploying to hugging face inference endpoint not working

Hi,
I've successfully trained llama with unsloth using my custom dataset. Also tested inference in google colab and successfully saved the merged 16bit model to hugging face.
However, i'm stuck trying to deploy to inference endpoint. To check if this was an issue with my trained model, i tried deploying the Unsloth llama model (unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit ) directly to an inference endpoint and I keep getting the same failure
Is this a build configuration issue? Or I've done something wrong with the advanced configuration when creating the endpoint
Thoughts?

Found the fix!
Known issue : https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct/discussions/34
Nothing to do with Unsloth. Thanks and keep up the good work.

Great you solved it!


custom sound

(Future releases: your own custom sounds, name-based!)

Any idea when this future arrives ? ;-)
Is it much work for you to implement this ?
I want to play a sound file that I created myself.

At the moment I don't have much time, but it is not that much work I think.
If I remember it correctly, the sound files must be converted (and max 30s) and placed in the ios and android project... then it is probably a matter of introducing some conventions and link the right sound.
If you have some time to wait I maybe find some time to implement this feature... but It will not be next week yet.

Would be great !
I can wait two weeks :-)

I've dived back into the native codes, and I will update the code (this week after it has been tested in one of my own projects) so that custom sounds are possible when you include them. Notice that you must convert your custom sounds to CAF for ios. In the first version I will not include checks to check if the given name is available as an asset (So if not set up correctly app could possibly crash or make no sound).

should work now in 1.2.0....