Some links are never added to the DOM

We need to get links from web pages, added by Javascript in this case. Using HtmlUnit 2.35.0 this works well for most sites, but since recently we have trouble with a specific group of websites, sharing the same CMS.
HtmlUnit is unable to add all 'news' links on: https://www.afas.nl/nieuwsberichten/nieuws
This website since recently, assuming the site has changed, is throwing a EcmaError, not being able to read a property. Is that error also actually the real reason the links are not being added?
HtmlUnit is unable to add most some links on: https://www.werkenbijrocwestbrabant.nl/
The links are not added via AJAX, the JSON blob is already in the DOM.

Tested this issue with 2.36.0. It still throws a
TypeError: Cannot read property "tagName" from null
I am not sure if this is actually the root problem.
Is there maybe a workaround?

Here is another example using the same CMS as other example: https://www.kuilnicos.nl/productgroep-prs?PrGr=COM02
This time there are no warnings or errors other than:
Obsolete content type encountered: 'application/x-javascript'.
I can read many links from this page, but not the actual products listed on this page (e.g. https://www.kuilnicos.nl/product-prs/artikel?BiId=26330) .  Different browser versions do not seem to change things.

Have tested this again with the lastest code base
    String webUrl = "https://www.kuilnicos.nl/productgroep-prs?PrGr=COM02";

    try (final WebClient webClient = new WebClient(BrowserVersion.FIREFOX_68 /*, "localhost", 8888 */)) {
        webClient.getOptions().setUseInsecureSSL(true);

        HtmlPage page = webClient.getPage(webUrl);
        webClient.waitForBackgroundJavaScript(20_000);

        System.out.println(" ---- main page start ---- ");
        System.out.println(page.asXml());
        System.out.println(" ---- main page end ---- ");
        System.out.println();
    }

Looks like i always get only the first link. I fear this is because the page does some magic rendering and retrieves only some entries from the server. When scrolling down more entries are fetched. But HtmlUnit is headless -means some of the layout calculations will produce only dummy results. This might lead to this effect.
Because there is a huge amount of js code in this page, i see no chance for me to dig into all the details to figure out what is really going on here - sorry but i do all the work in my spare time.

At least for the first case (https://www.kuilnicos.nl/productgroep-prs?PrGr=COM02) i think all the content is now in the xml.

Did another try on this - some of the pages are changed in between so i had a look at https://www.afas.nl/nieuwsberichten/nieuws.
Page is based on many many js libraries - i see no chance to find the reason for this during the time i have for this project.
Sorry but i have to close this without any good solution for you.


Investigate date-fns to replace moment

Since moment & rollup aren't getting along

I've done the work to replace moment with date-fns on my fork but, like a dickhead, I forgot to branch first so can't open a pull request until my existing PR is merged.
The commit is here if you want to take an early peek: https://github.com/voodoochild/anthracite/commit/b66aa3c8958c2728eb6d2312905fe3edf3b29978
I haven't looked at changing the build process to use rollup since I figured that you might already have a branch for that.


Can't route traffic when create a SOCKS proxy using netty

I have been created a SOKCS Proxy using NETTY library in Android.
now I have implemented the code and everything works fine and the SOCKS proxy connected on local network IP that the phone connected with, so the thing is I want to route all the outgoing data to the mobile data IP , but I didn't find anything that I can  do with NETTY library itself , so any information on this ,will be very helpful, is there a way to do what I mentioned.

You're basically looking for VPN to route all traffic via a tunnel. Configure a system-wide proxy in your phone and your best bet is to expect that most apps will auto-pick and use it.
Also, this is entirely out of the context of Netty. Consider heading over to StackOverflow.


perf: Reuse httpx.Client, use orjson

https://www.python-httpx.org/advanced/clients/

Pull Request Test Coverage Report for Build<PHONE_NUMBER>4
Details

28 of 33 (84.85%)  changed or added relevant lines in 6 files are covered.
15 unchanged lines in 5 files lost coverage.
Overall coverage decreased (-0.03%) to 86.385%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

app/routers/guest/applications.py
1
2
50.0%

app/commands.py
13
17
76.47%

Files with Coverage Reduction
New Missed Lines
%

app/models.py
1
99.33%

app/routers/guest/applications.py
1
84.65%

app/util.py
2
96.3%

app/commands.py
5
94.61%

app/sources/colombia.py
6
70.45%

Totals

Change from base Build<PHONE_NUMBER>3:
-0.03%

Covered Lines:
2024

Relevant Lines:
2343

💛  - Coveralls

Okay, done reviewing code in the fetch_all_awards_from_period path. I don't see much that would cause the server to exhaust resources. Might need to monitor actively if there's a subtle leak. SQLAlchemy seems to only have a LRU Cache with 500 items: https://docs.sqlalchemy.org/en/20/core/connections.html#configuration

Mmm I'm getting this error when trying to deploy the back end:
Process SpawnProcess-1:
Traceback (most recent call last):
  File "/usr/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/usr/lib/python3.11/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/uvicorn/_subprocess.py", line 76, in subprocess_started
    target(sockets=sockets)
  File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/uvicorn/server.py", line 61, in run
    return asyncio.run(self.serve(sockets=sockets))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/asyncio/runners.py", line 190, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/asyncio/base_events.py", line 654, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/uvicorn/server.py", line 68, in serve
    config.load()
  File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/uvicorn/config.py", line 473, in load
    self.loaded_app = import_from_string(self.app)
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/uvicorn/importer.py", line 21, in import_from_string
    module = importlib.import_module(module_str)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 940, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/home/yolile/development/credere-backend/app/main.py", line 4, in <module>
    from app.routers import applications, downloads, guest, lenders, statistics, users
  File "/home/yolile/development/credere-backend/app/routers/applications.py", line 11, in <module>
    from app import dependencies, models, parsers, serializers, util
  File "/home/yolile/development/credere-backend/app/dependencies.py", line 8, in <module>
    from app import auth, models, parsers, util
  File "/home/yolile/development/credere-backend/app/util.py", line 21, in <module>
    from app.sources import colombia as data_access
  File "/home/yolile/development/credere-backend/app/sources/__init__.py", line 9, in <module>
    client = httpx.Client(transport=httpx.HTTPTransport(retries=3, verify=False), timeout=60)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/httpx/_client.py", line 646, in __init__
    super().__init__(
  File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/httpx/_client.py", line 181, in __init__
    self._params = QueryParams(params)
                   ^^^^^^^^^^^^^^^^^^^
  File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/httpx/_urls.py", line 427, in __init__
    self._dict = parse_qs(value, keep_blank_values=True)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/urllib/parse.py", line 718, in parse_qs
    pairs = parse_qsl(qs, keep_blank_values, strict_parsing,
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/urllib/parse.py", line 768, in parse_qsl
    qs = bytes(qs)
         ^^^^^^^^^
TypeError: cannot convert 'NoneType' object to bytes

And a similar one when trying to run commands:
Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "/home/yolile/development/credere-backend/app/commands.py", line 12, in <module>
    from app import mail, models, util
  File "/home/yolile/development/credere-backend/app/util.py", line 21, in <module>
    from app.sources import colombia as data_access
  File "/home/yolile/development/credere-backend/app/sources/__init__.py", line 9, in <module>
    client = httpx.Client(transport=httpx.HTTPTransport(retries=3, verify=False), timeout=60)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/httpx/_client.py", line 646, in __init__
    super().__init__(
  File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/httpx/_client.py", line 181, in __init__
    self._params = QueryParams(params)
                   ^^^^^^^^^^^^^^^^^^^
  File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/httpx/_urls.py", line 427, in __init__
    self._dict = parse_qs(value, keep_blank_values=True)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/urllib/parse.py", line 718, in parse_qs
    pairs = parse_qsl(qs, keep_blank_values, strict_parsing,
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/urllib/parse.py", line 768, in parse_qsl
    qs = bytes(qs)
         ^^^^^^^^^
TypeError: cannot convert 'NoneType' object to bytes

I’ll have a look on Monday. This PR doesn’t fix any bugs, just does some
cleanup and small performance improvements.
On Saturday, August 10, 2024, Yohanna Lisnichuk @.***>
wrote:

Mmm I'm getting this error when trying to deploy the back end:
Process SpawnProcess-1:
Traceback (most recent call last):
File "/usr/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
self.run()
File "/usr/lib/python3.11/multiprocessing/process.py", line 108, in run
self._target(*self._args, **self._kwargs)
File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/uvicorn/_subprocess.py", line 76, in subprocess_started
target(sockets=sockets)
File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/uvicorn/server.py", line 61, in run
return asyncio.run(self.serve(sockets=sockets))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/asyncio/runners.py", line 190, in run
return runner.run(main)
^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/asyncio/runners.py", line 118, in run
return self._loop.run_until_complete(task)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/asyncio/base_events.py", line 654, in run_until_complete
return future.result()
^^^^^^^^^^^^^^^
File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/uvicorn/server.py", line 68, in serve
config.load()
File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/uvicorn/config.py", line 473, in load
self.loaded_app = import_from_string(self.app)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/uvicorn/importer.py", line 21, in import_from_string
module = importlib.import_module(module_str)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/importlib/init.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "", line 1204, in _gcd_import
File "", line 1176, in _find_and_load
File "", line 1147, in _find_and_load_unlocked
File "", line 690, in _load_unlocked
File "", line 940, in exec_module
File "", line 241, in _call_with_frames_removed
File "/home/yolile/development/credere-backend/app/main.py", line 4, in
from app.routers import applications, downloads, guest, lenders, statistics, users
File "/home/yolile/development/credere-backend/app/routers/applications.py", line 11, in
from app import dependencies, models, parsers, serializers, util
File "/home/yolile/development/credere-backend/app/dependencies.py", line 8, in
from app import auth, models, parsers, util
File "/home/yolile/development/credere-backend/app/util.py", line 21, in
from app.sources import colombia as data_access
File "/home/yolile/development/credere-backend/app/sources/init.py", line 9, in
client = httpx.Client(transport=httpx.HTTPTransport(retries=3, verify=False), timeout=60)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/httpx/_client.py", line 646, in init
super().init(
File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/httpx/_client.py", line 181, in init
self._params = QueryParams(params)
^^^^^^^^^^^^^^^^^^^
File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/httpx/_urls.py", line 427, in init
self._dict = parse_qs(value, keep_blank_values=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/urllib/parse.py", line 718, in parse_qs
pairs = parse_qsl(qs, keep_blank_values, strict_parsing,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/urllib/parse.py", line 768, in parse_qsl
qs = bytes(qs)
^^^^^^^^^
TypeError: cannot convert 'NoneType' object to bytes
And a similar one when trying to run commands:
Traceback (most recent call last):
File "", line 198, in _run_module_as_main
File "", line 88, in _run_code
File "/home/yolile/development/credere-backend/app/commands.py", line 12, in
from app import mail, models, util
File "/home/yolile/development/credere-backend/app/util.py", line 21, in
from app.sources import colombia as data_access
File "/home/yolile/development/credere-backend/app/sources/init.py", line 9, in
client = httpx.Client(transport=httpx.HTTPTransport(retries=3, verify=False), timeout=60)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/httpx/_client.py", line 646, in init
super().init(
File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/httpx/_client.py", line 181, in init
self._params = QueryParams(params)
^^^^^^^^^^^^^^^^^^^
File "/home/yolile/development/credere-backend/.ve/lib/python3.11/site-packages/httpx/_urls.py", line 427, in init
self._dict = parse_qs(value, keep_blank_values=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/urllib/parse.py", line 718, in parse_qs
pairs = parse_qsl(qs, keep_blank_values, strict_parsing,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/urllib/parse.py", line 768, in parse_qsl
qs = bytes(qs)
^^^^^^^^^
TypeError: cannot convert 'NoneType' object to bytes
—
Reply to this email directly, view it on GitHub
https://github.com/open-contracting/credere-backend/pull/314#issuecomment-2282251770,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAAGOX2OFMAZ7T6B77LJKM3ZQZRTDAVCNFSM6AAAAABMJOY6R2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEOBSGI2TCNZXGA
.
You are receiving this because you authored the thread.Message ID:
@.***>

--
James McKinney
Head of Technology
+1-514-247-0223 | @mckinneyjames | timezone: EST
🚀 Read our 2023 Annual Report
https://www.open-contracting.org/annual-report-2023 for 11 stories of
transformational change making public procurement more accountable,
inclusive and sustainable.
www.open-contracting.org | follow us @opencontracting

Maybe we need to restore the params={} keyword argument from the original code (which didn’t make any sense, but this error doesn’t make sense either).

It's a Python bug. Upgrade to 3.11.9. https://docs.python.org/release/3.11.9/whatsnew/changelog.html#library

gh-116764: Restore support of None and other false values in urllib.parse functions parse_qs() and parse_qsl(). Also, they now raise a TypeError for non-zero integers and non-empty sequences.

Image has 3.11.9 already:
$ docker compose --progress=quiet run --rm --name credere-backend-shell cron python --version
Python 3.11.9

Thanks, that was the issue indeed. However, I now get:
Traceback (most recent call last):

  File "<frozen runpy>", line 198, in _run_module_as_main

  File "<frozen runpy>", line 88, in _run_code

  File "/home/yolile/development/credere-backend/app/commands.py", line 459, in <module>
    app()

  File "/home/yolile/development/credere-backend/app/commands.py", line 157, in fetch_all_awards_from_period
    _get_awards_from_data_source(from_date, get_db, until_date)

  File "/home/yolile/development/credere-backend/app/commands.py", line 124, in _get_awards_from_data_source
    _create_complete_application(entry, db_provider)

  File "/home/yolile/development/credere-backend/app/commands.py", line 30, in _create_complete_application
    award = util.create_award_from_data_source(session, award_entry)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/yolile/development/credere-backend/app/util.py", line 172, in create_award_from_data_source
    data = data_access.get_award(entry, borrower_id, previous)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/yolile/development/credere-backend/app/sources/colombia.py", line 80, in get_award
    contract_response_json, contract_url = _get_remote_contract(proceso_de_compra, proveedor_adjudicado, previous)
                                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/yolile/development/credere-backend/app/sources/colombia.py", line 60, in _get_remote_contract
    return util.loads(sources.make_request_with_retry(contract_url, HEADERS).json()), contract_url
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/yolile/development/credere-backend/app/util.py", line 42, in loads
    return orjson.loads(response.text)
                        ^^^^^^^^^^^^^

AttributeError: 'list' object has no attribute 'text'

So I guess we need
return util.loads(sources.make_request_with_retry(contract_url, HEADERS)), contract_url
instead of
return util.loads(sources.make_request_with_retry(contract_url, HEADERS).json()), contract_url

Thanks, that was the issue indeed. However, I now get:
Traceback (most recent call last):

  File "<frozen runpy>", line 198, in _run_module_as_main

  File "<frozen runpy>", line 88, in _run_code

  File "/home/yolile/development/credere-backend/app/commands.py", line 459, in <module>
    app()

  File "/home/yolile/development/credere-backend/app/commands.py", line 157, in fetch_all_awards_from_period
    _get_awards_from_data_source(from_date, get_db, until_date)

  File "/home/yolile/development/credere-backend/app/commands.py", line 124, in _get_awards_from_data_source
    _create_complete_application(entry, db_provider)

  File "/home/yolile/development/credere-backend/app/commands.py", line 30, in _create_complete_application
    award = util.create_award_from_data_source(session, award_entry)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/yolile/development/credere-backend/app/util.py", line 172, in create_award_from_data_source
    data = data_access.get_award(entry, borrower_id, previous)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/yolile/development/credere-backend/app/sources/colombia.py", line 80, in get_award
    contract_response_json, contract_url = _get_remote_contract(proceso_de_compra, proveedor_adjudicado, previous)
                                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/yolile/development/credere-backend/app/sources/colombia.py", line 60, in _get_remote_contract
    return util.loads(sources.make_request_with_retry(contract_url, HEADERS).json()), contract_url
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/home/yolile/development/credere-backend/app/util.py", line 42, in loads
    return orjson.loads(response.text)
                        ^^^^^^^^^^^^^

AttributeError: 'list' object has no attribute 'text'

So I guess we need
return util.loads(sources.make_request_with_retry(contract_url, HEADERS)), contract_url
instead of
return util.loads(sources.make_request_with_retry(contract_url, HEADERS).json()), contract_url

Yeah, I amended this commit but I guess it got readded. https://github.com/open-contracting/credere-backend/pull/314/commits/fa8dad3811be17179a4fb28ce9ca8b9675fa7fde


Discard FF crew in crew retrieval

Hi,
You may add a default filter for crew retrieval for discarding already FF crew.
Not much reason to retrieve a crew we already own FF no ?
I mean, the whole idea behind crew retrieval is to be able to get crew we don't own or copy of crew we don't have already FF.
So the idea is to have a filter : show unowned crew and crew not FF.

Hey, I think we need to be careful not to assume specific user behaviour/intent. Some players do run dupes and I'd bet a few might even retrieve them.
So I wouldn't want to change default behaviour.
But I think adding an option for "Not FF (owned or unowned)" makes sense and a few players have requested it. Tracking that at #165.


Feature request: historical opportunities [government product owner, vendors, public]

User Stories
As a vendor, I would like to see which of my competitors are being awarded opportunities, what amounts they are being paid, and what work is being delivered for that money.
As a vendor who has been awarded an opportunity in the past, I would like to be able to refer to the terms of the opportunity, and also be able to point new prospective clients to work that we have been awarded and delivered for the Province of British Columbia.
As a government product owner who is interested in posting a CWU or SWU opportunity, I want to be able to see past opportunities that have been offered so I can get a sense of how I might compose my opportunity.
As a concerned taxpayer, I would like to know that my government is being transparent about the money they are spending through procurement, who they awarding it to, and for what.

I would like to be able to peruse past opportunities and:

Sort all of the opportunities that have been awarded by ministry (see what opportunities my ministry has awarded in the past)
Read the full content of the opportunity as it was posted (i.e. all of the Acceptance Criteria, Proposal Eval criteria in the case of CWU)
See the award amount
See the name of the vendor/individual who was awarded the opportunity
See the number of proposals that were submitted
Find a link to where the work that the opportunity is paying for is being delivered (i.e. link to the public GitHub repo where the work is being delivered)

Is this something that is on the backlog / roadmap? Aside from the transparency it provides, BCDevExchange historic data was extremely valuable for research and for inspiration for future opportunities.

@dy2288
AFAIK it is currently not on the roadmap to incorporate the historical BCDevExchange data into the Digital Marketplace web app. Note that my team (Real Folk) is a vendor, and we can not speak on behalf of the Province or make decisions re: scope and budget. I will bring this up in our next internal product meeting though.
In addition, I am noting some previously-discussed ideas for publishing this data for posterity (in order from least effort to most effort):

Host an archived, read-only version of the old BCDevExchange web app as a reference of historical opportunities.
Create a new, simple archival website that simplifies the presentation of historical opportunities from the old BCDevExchange website (avoids ongoing overhead of maintaining the old BCDevExchange infrastructure).
Migrate the historical opportunities from the BCDevExchange web app to the Digital Marketplace web app.


[patch] Exploit the mangling flag

This depends on pyiron_base 1356, and turns off the automatic name mangling for NodeJob. There is certainly not a large corpus of workflow jobs depending on the old naming scheme, so this can be a patch.
@jan-janssen @srmnitc, I don't know what the timetable is for the DPG or whether base releases can get made sufficiently quickly to utilize this, but it is far and away preferable to #225, which is wrongly patching a problem in _base but only inside _workflow.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>
Details

0 of 1 (100.0%)  changed or added relevant line in 1 file are covered.
9 unchanged lines in 1 file lost coverage.
Overall coverage increased (+0.003%) to 91.431%

Files with Coverage Reduction
New Missed Lines
%

job.py
9
90.29%

Totals

Change from base Build<PHONE_NUMBER>:
0.003%

Covered Lines:
5783

Relevant Lines:
6325

💛  - Coveralls

This won't be necessary, the next version of base will jump straight to pyrion_base 1358, so we'll get the desired renaming behaviour by default and never need to exploit the mangling flag


Can the value of different targets be encoded by simply switching the mask positions of different targets?

Hi,

When feature concat is used, the value of different targets can be encoded only by exchanging the mask of different targets?However, I don't think the exchange of mask positions of different targets in concat has any effect on the result. 2. Can the ref_v1 and ref_v2 output here be called target features?

I didn't write the code that you highlighted.
If we don't know the target mask how can we decode the object?

I didn't write the code that you highlighted.
If we don't know the target mask how can we decode the object?

I didn't write the code that you highlighted.
If we don't know the target mask how can we decode the object?

@hkchengrex Sorry, I have updated the picture, I just don't understand how to know the value of each target when encoding the value of memory frame.Because only the positions of the predicted masks of different targets change during value coding.

The "positions" control the function arguments. The first mask is the main object mask and the second mask is the mask for other objects (this follows from STM).


Please define unit for smtc_modem_hal_get_battery_level

The documentation says:
/**
 * @brief Return the battery level
 *
 * @return uint8_t Battery level for lorawan stack
 */
uint8_t smtc_modem_hal_get_battery_level( void );
```

What is the unit ? assuming not Volt and not mVolt in an uint8. What can it be ? %age ?

Hi,
It is compliant with the battery level defined in the LoRaWAN specification.

This is documented in line 440 of "smtc_modem_hal.c"
This will be moved to the *.h for the next coming release.
Many thanks,
Best regards


Allow custom pgn to ankify

I have a large tactics database on pgn format  that is separated in individual chapters for each puzzle. The way this tool sounds, this should be possible in the current setup, any advice on how to do this ?

Even better would be to allow usage of custom anki template which only contains fen and move list  fields for eg.

Even better would be to allow usage of custom anki template which only contains fen and move list  fields for eg.

Hey, can you provide an example of how your database of pgn files looks like? I guess in the current version it won't work, but maybe it can be extended with not much effort to make your use case working.

They would be like these :
https://github.com/xinyangz/chess-tactics-pgn
http://gorgonian.weebly.com/uploads/1/7/2/2/17221082/auerswald.pgn

Maybe these card templates are a better solution for you?
The second pgn database you mentioned (auerswald collection) is already available for the above card templates here.
Or are the two sets you mentioned above just examples of how yours looks like?
In any case, at the moment chessli is not able to ankify arbitrary pgn databases, but since the above shared decks exist and chessli makes available the > 1 million (and growing) lichess puzzle database, I would need to be convinced that this is a feature useful to be implemented.

I close this here for now. @ExtremeCoolDude, just comment here if you have further questions.
The "ankification" of arbitraty pgn sources is not possible at the moment, but I will try to tackle it in the future, see #5.

Thank you for the reply. I looked at the above solutions, the card templates are excellent.
More interesting is the template has only two pertinent fields, fen and pgn. Since anki decks can be imported as json , outputting two fields to a text file shouldn't be difficult:
`  if games_by_user:
            for game_json, game_pgn in [
                (
                    game,
                    games_client.export(
                        game["id"],
                        literate="true",
                        as_pgn=True,
                        opening="true",
                        tags="true",
                        moves="true",
                        evals="true",
                    )

I'm sure I can output Fen and SAN  from somewhere around here.  I'll post if I figure something out. Thanks!

I think I commented when I was logged in on another account xD, so I did try it but the chess py  library doesn't spit out { comments } nicely for the excellent templates, particularly if there are linebreaks on pgn comments, the linebreaks is included in the string, which is very hard to import into anki since anki treats each line as a separate card, other than that simply iterating over games and spitting out fen and SAN separated by tab with game on each line is enough to import into anki as a txt file.


RFC: Backtrace in core

Rendered
Based on Backtrace in core PR.
Remaining concerns:

[x] Check if impl Backtrace return type works with backtrace_create()
[x] Address more abstract pointer to Backtrace type - increase size from 1 word to 2 words
[x] Clarify weak lang items
[x] Why use struct instead of trait

What's the current status of this RFC?

What's the current status of this RFC?

The current status is that we don't intend to merge this RFC. It was written as one of the potential paths to moving error into core assuming generic member access didn't work out but at this point it seems extremely likely that we will merge the generic member access RFC once we finish the provider RFC.
For context:

https://github.com/rust-lang/rfcs/pull/2895
https://github.com/rust-lang/rfcs/pull/3192

@yaahc shall we close it, then?


correcting the paragraph portion

as it was saying ">This is the second paragraph.

This is not a second  paragraph." this expression was incorrect because in fact it was still the second paragraph, so instead i propose to change such portion to "this is not a third paragraph" to make the idea a bit more clear

Issue #213
Changes

-

Flags

Signed-off-by: Andres Arrieta<EMAIL_ADDRESS>

my bad, should i just add the DCO as a comment? (i dont think i need to install anything, do i?)
Signed-off-by: Andres Arrieta<EMAIL_ADDRESS>

I believe this has already been fixed in a previous PR. I'm closing.


Update the link for the 2010 census on the methodology & data page

Describe the bug
Update the link on the 2010 census on the methodology & data page
To Reproduce
Steps to reproduce the behavior:

Go to 'Methodology & data'
Scroll down to 'Training and workforce development data sources'
Click on a 2010 census link
See error

Expected behavior
Should link to  https://www.census.gov/data/developers/data-sets/acs-5year/2010.html
Screenshots
If applicable, add screenshots to help explain your problem.
Desktop (please complete the following information):

OS: [e.g. iOS]
Browser [e.g. chrome, safari]
Version [e.g. 22]

Smartphone (please complete the following information):

Device: [e.g. iPhone6]
OS: [e.g. iOS8.1]
Browser [e.g. stock browser, safari]
Version [e.g. 22]

Additional context
Add any other context about the problem here.

occurs in 4 locations


Whether or not an icon is set, there will be a margin on the left, whether the margin can be removed

Set collapseIcon = true on the PreferenceScreen.

Set collapseIcon = true on the PreferenceScreen.

thanks


Software Component Version via API

See here: https://answers.sap.com/questions/13204377/software-components-rest-api.html

I would close the issue here, because it is more about the right FM to get information and regarding the SDK part I have answered what was possible.


Sync NPC/player health changes

When a player is sharing NPCs other people on the server can only deal damage to those shared NPCs (and the player) if they run them over in a vehicle, or if the mirrored player manages to actually shoot them. I think it would be ideal if health changes were also synced between players. (i.e. when a person on the server damages an NPC or another player that is being shared, the server and the player sharing that NPC should have that health reduced, or killed if the shooter does enough damage)

Thanks for your help!
The health of the players and NPCs are synchronized. The problem is with the synchronization for weapons.
Currently, 1/4 of all weapons are missing bullets when shooting, which is why the NPCs and players can only take damage with certain weapons.
Weapon syncing will be reworked in a future update. The focus for syncing is currently on vehicles and player movement, so i can't say exactly when i'll be able to fix this bug.

Interesting... would it be possible to share a list of which weapons are currently supported?

Weapons that work (not all tested)

Combat MG
Gusenberg Sweeper
Micro SMG
SMG
Special Carbine
Carbine Rifle
Heavy Sniper
Sniper Rifle
Musket
Pump Shotgun
Sawed-Off Shotgun
Bullpup Shotgun
Minigun
Grenade Launcher
AP Pistol
Pistol
Combat Pistol
Pistol .50
SNS Pistol
Heavy Pistol
Vintage Pistol

Thanks

I've managed to get health syncing working on my fork, feel free to check here: https://github.com/Katsute/RAGECOOP-V/issues/2.


Saucelabs testing old Firefox (v45)

Unsure if it's intentional or not, but I just noticed that tests are run on Firefox 45 -- that's currently 21 versions old. Are there any technical reasons it's not running release versions?

No, there is no reason for that. The configuration is in the Gruntfile. There is no version specified. I would expect SauceLabs to use the newest one...
I think it is important to let the tests run in older browsers. But it is most important in IE and Safari (which sadly doesn't work at all at the moment) and it should be in addition to the new browser versions and not instead of.
I you can find out what's going on, please let me know.


No way to use alternate metrics, like Mahalonobis

Your HDBSCAN implementation is impressive and can be vary useful in various fields. The implementation mentions lots of different metrics, but no way to specify keywords for certain metrics. This might be an issue with me not being a python expert. If that's the case, I apologize for wasting time.

I believe this is (hopefully) a documentation issue -- we are definitely lacking in documentation; something I hope we'll get remedied in the next few months.
Ideally you should be able to use alternative metrics with something like:
clusterer = hdbscan.HDBSCAN(metric='mahalonobis').fit(X)
clusterer.labels_, clusterer.probabilities_

Presuming X is a suitable ndarray, each row a point in some n-space. I believe the following should be supported:
              'euclidean'
              'minkowski'
              'manhattan'
              'l1'
              'chebyshev'
              'seuclidean'
              'mahalanobis'
              'wminkowski'
              'hamming'
              'canberra'
              'braycurtis'
              'matching'
              'jaccard'
              'dice'
              'kulsinski'
              'rogerstanimoto'
              'russellrao'
              'sokalmichener'
              'sokalsneath'
              'haversine'

Obviously not all of those will work with all data (Hamming expects binary, Haversine requires 2D data, and so on). I admit that I haven't tested all of this particularly well, but for the most part I am using other implementations, or stealing Jake Vanderplas' implementations from his kd-tree and ball-tree implementations, so it ought to work. Please let me know if it doesn't and I'll try to look into what's going wrong.

Thanks for getting back to me so quickly. Getting something like the Mahalanobis distance running (which is unit/scale independent in each dimension of the data) opens up the potential uses for this algorithm to lots of physical processes.  I'm basically running though one of your python notebooks, but switching in the Mahalanobis metric in place of the minkowski metric. I've added what I've done so far in the code quote below.
The issue seems to be there's no way to pass the Mahalanobis covariance matrix to the metric code. i.e. the p number for the minkowski metric doesn't get passed to the mahalanobis metric function.
`import numpy as np
import hdbscan
import matplotlib.pyplot as plt
import pdb
import seaborn as sns
import sklearn.datasets as data
moons, _ = data.make_moons(n_samples=50, noise=0.05)
blobs, _   = data.make_blobs(n_samples=50, centers=[(-0.75,2.25), (1.0, 2.0)], cluster_std=0.25)
test_data = np.vstack([moons, blobs])
##The mahalanobis covar matrix
ss = np.array([[1.0,0],[0.0,1.0]])
##!!Crashes on this line below!!
clusterer = hdbscan.HDBSCAN(min_cluster_size=5,p=ss metric='mahalanobis')
##!!Crashes on above line!!
clusterer.fit(test_data)
pdb.set_trace()
print 'here'
`
p.s. not to jump the gun here or anything, but how do I credit you guys if I use this in a scientific publication?

In principle the Mahalanobis metric should get V, or VI as the covariance matrix, p is just for minkowski. The catch may be in ensuring that those kwargs get passed all the way through -- perhaps they do not. I'll have to look into that and get back to you.

So the short answer is I am currently not threading the appropriate kwargs all the way through everything, hence the breakage. I'll try and get that sorted as soon as I can, and then hopefully you can pull from master here and have something that works for you.

Thanks Imcinnes! Very appreciated

I've just committed what should be the relevant changes to master. If you can clone from here, build, and see if that works that would be great!

As for citation -- should it ever come to that -- I would suggest you be sure to cite the Campello, Moulavi and Sander Paper(s) we reference in the README and code, and ultimately beyond that you can just cite the github repo (although I'm not sure of exactly what the right approach to that is these days). Thanks for taking an interest in our code -- we hope it proves useful to you in your research!

Thanks again for the fast work on this. I ran it and got numbers out that look reasonable, so I guess it's all working! If output from your code ends up in a paper I will be sure to let you know before publication.


Start releasing binaries

This is intended to help improve the UX around installation for broader adoption

Closing in favor of #150


cloud scheduler

[ ] create a cloud scheduler job that'll trigger cloud run service at a desired frequency
[ ] configure the job to send a request to the cloud run service endpoint


global: move to centralised babel import

comment: isort will make some problems, because the lines are only replaced and not newly isorted


Feature Request: On-screen ROM list for batch selections and/or delete

Being new to ROMs I really like your app - its very helpful. One thing that would make it so much easier for Noobies is to have an on-screen editor allowing us to choose what ROMs to copy over and/or delete.
Especially helps when we have Full ROM sets with clones, etc that we dont yet know much about.
a simple list with check boxes to select, then 'copy' or 'delete' would be great.
thx for considering!

Sorry for the delay, I hope you have solved your problem by now ^^'
That's what the "manage games list" is for. You can download a pre-built games list, and use it to copy only the good games from your fullset.
Alternatively, you can make a search using http://adb.arcadeitalia.net/lista_mame.php?lang=en, export the results, and use it.


[Bugfix/Critical] Removing dangerous config log

There was a dangerous stdout log in configuration, which could
output user data

Good spot!


Malware Broadcaster not destroying turrets, mines, or spike traps

I've noticed malware broadcaster doesn't destroy anything, or make anything able to be disabled. I tried to disable something from terminal, it out puts a response as disabled, but it doesn't show as disabled, or destroyed, and it stays intact when next to it.
This is as of version 3.9.15 - 2024-08-19. Will update when I play the newest version.

I would have to look at logs to know what's going on when you try to use Malware Broadcaster.

Closing due to lack of response.


Get the update/edit route dynamically for resources

In Project Stage component

Currently, we are using the same route for the store and updateby appending stage-id for update route.
At present, the stage-id is provided dynamically. so we have to get the updated route for update so that it will not be reliable on store route in future.

This is not relevant anymore. Closing


Prevent non-gen1 Megas in LG

?
Won't this also prevent Gen 1 Megas in LG? Mewtwo and Charizard aren't the only megas, are they?

Fixed in ed54a6eb4db5d


Add one hexapdf benchmark

Apparently YJIT already shows speedups on this project, and it's open source. It's also "real-world" software that happens to not directly be a web use case. I was thinking that we could add just one of the larger benchmarks from their repository. Generally, longer-running benchmarks make for more accurate timing.
https://github.com/gettalong/hexapdf
https://github.com/gettalong/hexapdf/tree/master/benchmark
@noahgibbs would you be ok with taking this issue? I know you're busy with the upstreaming so this can wait. Otherwise we could ask Kevin or someone else on the team.

I'm cool with taking this post-upstreaming. I'm also fine with somebody else doing it.

A simple benchmark sounds good 👍


Problem changing LED assignment while led is on.

Example:
led = LED(4)
led.on()
This turns on the led connected to gpio4, as one would expect. However, if you then do;
led = LED(18) this could be any available gpio;
the led connected to gpio4 turns off (but, interestingly, an led connected to gpio18 does NOT turn on). If you then issue an 'led.on()', the led connected to gpio18 will turn on.

That is the expected behaviour.
When you create an LED object and assign it to led, you hold a reference to it in led. You can create another with another object name and both references are then active. However, you can close the object explicitly with led.close() which will remove your control of it and return the pin to us original state.
You can also implicitly close the object by deleting the reference with del led but that will wait for the garbage collector to actually do the cleanup. Or if you create a new object with the name of an existing one it'll probably just get cleaned up straight away. Cleanup restores the state (which usually turns it off) so that's what you're seeing.
If you want to keep both LEDs on, you'll need to create two separate objects for them e.g. led and led2 or a list leds = [LED(4), LED(18)] or even LEDBoard(4, 17).

Just a quick correction here - Ben's basically covered everything, but I'll walk through the object lifetimes. One thing to bear in mind is that when GPIO Zero shuts down a device it tries to turn it off (it doesn't leave it's state alone). This is largely a safety feature (so if your robot script crashes out the motors don't keep running!).
So, let's walk through line by line:
led = LED(4)

At this point an LED object has been created and the name "led" has been associated with it, so the LED object has a reference count of one.
led.on()

The "on" method is called and the LED lights up.
led = LED(18)

Now the complicated bit. In an assignment we evaluate the right side first (LED(18)) then perform an assignment to the name on the left. So, firstly a new LED object is created against pin 18. The original LED object is still in existence at this point. Next the name "led" is removed from the LED(4) object and its reference count drops to zero. In CPython at least, the garbage collector should rapidly destroy that object now, which will result in the LED switching off (due to the aforementioned safety feature in GPIO Zero). Finally, the "led" named is now assigned to the new LED(18) object. The LED(18) object doesn't turn on because you haven't told it to (and it has no association with the LED(4) object that existed previously).
Hopefully that explains what's happening behind the scenes a bit more. Please note that object lifetimes are a complex thing - if you try something similar with Button you'll find they won't disappear as easily (due to internal references keeping them alive). If you definitely want things to shut down at particular times, use close() as Ben noted above.


urxvt doesn't display progress bars correctly

Description
When using urxvt to pull an image the progress bars are drawn off by one line. This is annoying because it causes statically printed messages to be overriden by progress bars and it can make the status of certain layers get covered up.
Steps to reproduce the issue:

docker pull an image with more than one layer using urxvt

Describe the results you received:
$ docker pull ascribe/image-match
Using default tag: latest
latest: Pulling from ascribe/image-match

43c265008fae: Already exists
af36d2c7a148: Already exists
f6a5aab6cd0c: Downloading 539.8 kB/129.8 MB
132c9d275259: Downloading 719.6 kB/2.889 MB
f2bfc1fc1d76: Downloading 654.6 kB/15.88 MB
5a0288588dea: Waiting
276aa5e3c7b2: Waiting
0a789057158f: Waiting
b579dcc73c1a: Waiting
9fca55327c3f: Waiting
60402126d860: Waiting
949bc7382b9d: Waiting
25784ad4ced1: Waiting
25784ad4ced1: Pulling fs layer

Note that the last line here is printed on the same line as the cursor when using urxvt, but it's printed one line above the cursor when using xterm. That seems to be the source of the issue.
Describe the results you expected:
$ docker pull ascribe/image-match
Using default tag: latest
latest: Pulling from ascribe/image-match

43c265008fae: Already exists
af36d2c7a148: Already exists
143e9d501644: Already exists
f6a5aab6cd0c: Downloading 539.8 kB/129.8 MB
132c9d275259: Downloading 719.6 kB/2.889 MB
f2bfc1fc1d76: Downloading 654.6 kB/15.88 MB
5a0288588dea: Waiting
276aa5e3c7b2: Waiting
0a789057158f: Waiting
b579dcc73c1a: Waiting
9fca55327c3f: Waiting
60402126d860: Waiting
949bc7382b9d: Waiting
25784ad4ced1: Waiting

Additional information you deem important (e.g. issue happens only occasionally):
Output of docker version:
Client:
 Version:      1.12.2-cs2
 API version:  1.24
 Go version:   go1.6.3
 Git commit:   d5fda6e
 Built:        Sun Oct 23 07:48:43 2016
 OS/Arch:      linux/amd64

Server:
 Version:      1.13.0-dev
 API version:  1.25
 Go version:   go1.7.3
 Git commit:   c5ceb0f-unsupported
 Built:        Sun Nov  6 06:37:06 2016
 OS/Arch:      linux/amd64

Output of docker info:
Containers: 6
 Running: 1
 Paused: 0
 Stopped: 5
Images: 82
Server Version: 1.13.0-dev
Storage Driver: overlay2
 Backing Filesystem: extfs
Logging Driver: json-file
Cgroup Driver: cgroupfs
Plugins:
 Volume: local
 Network: bridge host macvlan null overlay
Swarm: inactive
Runtimes: runc
Default Runtime: runc
Security Options: apparmor seccomp
Kernel Version: 4.8.3
Operating System: NixOS 17.03.git.210b3b3 (Gorilla)
OSType: linux
Architecture: x86_64
CPUs: 4
Total Memory: 15.53 GiB
Name: thisisfine
ID: 4XB6:RAOL:2UT7:W3TT:JBSR:ILHC:LREA:HUVU:5U7V:TI7E:WUT2:WQTS
Docker Root Dir: /var/lib/docker
Debug Mode (client): false
Debug Mode (server): true
 File Descriptors: 22
 Goroutines: 34
 System Time: 2016-11-06T15:07:26.849363997-08:00
 EventsListeners: 0
Username: viktorstanchev
Registry: https://index.docker.io/v1/
WARNING: No cpu cfs quota support
WARNING: No cpu cfs period support
Insecure Registries:
 <IP_ADDRESS>
 <IP_ADDRESS>/8

Additional environment details (AWS, VirtualBox, physical, etc.):
physical

@vikstrous strange.

Capturing some output with script(1) I think the problem may be with the sequence <ESC>[1B<ESC>[1A^M. (Where <ESC> is actually the ASCII ESC character 0x1b and ^M is carriage return 0x0d)
According to Wikipedia <ESC>[1B is "Move cursor down", with the caveat "If the cursor is already at the edge of the screen, this has no effect.". <ESC>[1A is likewise move up 1 unless at the edge.
It appears that the sequence First<ESC>[1B<ESC>[1A^MSecond on urxvt produces (where _ is the final position of the cursor)
Second_
First

Compared with xterm which instead produces
Second_

because (I'm speculating) <ESC>[1B does nothing (already at the edge of the screen), <ESC>[1A moves up one line, then ^M moves back down and "Second" overwrites the "First".
I'm not sure what exactly is happening with urxvt to cause the observed behaviour, which is that after  <ESC>[1B<ESC>[1A^M the cursor has moved up one line.
I'm not even really convinced as to which of the two is right or wrong. Might be best to take this one to the urxvt list perhaps?

I tested with aterm, xterm and mlterm and they all behave correctly. I'm going to post to the rxvt-unicode ML and see if they have any insights.

I received a series of very helpful replies from Marc on the rxvt-unicode list:
http://lists.schmorp.de/pipermail/rxvt-unicode/2016q4/002315.html
His conclusion:

In summary: docker outputs a lot of "move cursor 0 characters" commands, which are undocumented, non-ANSI, and behave different in different terminals.

He also recommends using termcap, which seems very sensible to me, I'll take a look at that and try to raise a PR.

Ooops, s/termcap/terminfo/ in my parts of the above.

I proposed a fix for the underlying issue in #28238, I'm also still looking into using terminfo (oh man, my fingers typed termcap the first time again).

#28238 has been merged and fixed the underlying issue here. I think this issues can be closed. I'm still looking at a switch to terminfo but no need to keep this open for that I think.


Prepared  GitHub Action to keep snapshotting of local or remote charts

GitHub action which enables to do continuous snapshot testing for local or remote Helm charts in your CI is ready 🚀
https://github.com/jlandowner/helm-chartsnap-action


Fix YoutubeDL-Material links

Updated link to YoutubeDL-Material to the actual link (it was set to the youtube-dl project before)

What this PR does / why we need it:
It fixes the link for YoutubeDL-Material, it was previously set to the youtube-dl home page. youtube-dl is the command-line utility that YoutubeDL-Material is based on, so the confusion is very understandable.
Which issue (if any) this PR fixes:
N/A
Any other useful info:
N/A

Please see also https://github.com/davestephens/ansible-nas/pull/327
Yours does address both link locations though. 👍

Ah ok, thanks for the note! I'll leave it up to the author whether to merge or not, I don't mind either way :)

Thanks! 👍

Thanks! 👍


Set 'z-index' to render suggestions over descendant elements/components of

Hi there,
First, thank you for this amazing library. Great work there.
My submit button comes from a different component and I'd like the autosuggest component to not know about it. Yet, by default, the suggestions show up below this button:

It would be great to have a way to customize the classes of the components inside MUIPlacesAutocomplete, including the suggestions box.

By the way, you can also see that on this example the Google logo does not show up. Haven't had time to check why yet, that's next on my plate.

This is probably because you're using react-popper. I might take some inspiration from https://material-ui-next.com/demos/autocomplete/ to do a Paper-based suggestion list.

@charlax
Thanks for the positive words. It's good to see/hear that someone is trying to use this library. I'm sure it's rough around the edges/harder to use than others since I'm learning but this feedback definitely helps me grow and make this library better. :smile:
I'll look into this and checkout the MUI samples for autocomplete. Is there a code sample/repo that you can provide that quickly shows what you are experiencing?
If you figure out why the Google logo isn't showing up either let me know in another issue.

Here's how I'm modifying the demo:
% git diff master -- demo/DemoBasic.jsx
diff --git a/demo/DemoBasic.jsx b/demo/DemoBasic.jsx
index e3a3d1b..10d7454 100644
--- a/demo/DemoBasic.jsx
+++ b/demo/DemoBasic.jsx
@@ -1,3 +1,4 @@
+import Button from 'material-ui/Button';
 import React from 'react'
 import Snackbar from 'material-ui/Snackbar'
 import MUIPlacesAutocomplete from './../dist'
@@ -30,6 +31,7 @@ class DemoBasic extends React.Component {
           onSuggestionSelected={this.onSuggestionSelected}
           renderTarget={() => (
)}
         />
+      <Button variant="raised" color="secondary" type="submit">Suivant</Button>
         <Snackbar
           onRequestClose={this.onClose}
           anchorOrigin={{ vertical: 'bottom', horizontal: 'center' }}

Full file:
import Button from 'material-ui/Button';
import React from 'react'
import Snackbar from 'material-ui/Snackbar'
import MUIPlacesAutocomplete from './../dist'

class DemoBasic extends React.Component {
  constructor() {
    super()

    this.state = { open: false, suggestion: null }

    this.onClose = this.onClose.bind(this)
    this.onSuggestionSelected = this.onSuggestionSelected.bind(this)
  }

  onClose() {
    this.setState({ open: false })
  }

  onSuggestionSelected(suggestion) {
    // Add your business logic here. In this case we simply set our state to show our <Snackbar>.
    this.setState({ open: true, suggestion })
  }

  render() {
    const { open, suggestion } = this.state

    return (

        <MUIPlacesAutocomplete
          onSuggestionSelected={this.onSuggestionSelected}
          renderTarget={() => (
)}
        />
      <Button variant="raised" color="secondary" type="submit">Suivant</Button>
        <Snackbar
          onRequestClose={this.onClose}
          anchorOrigin={{ vertical: 'bottom', horizontal: 'center' }}
          autoHideDuration={5000}
          open={open}
          message={suggestion ? (Selected suggestion: {suggestion.description}) : ''}
          style={{ width: '70vw' }}
        />

    )
  }
}

DemoBasic.description = 'Basic usage'

export default DemoBasic

Results in:

If I change the Popper' z-index, it works as I'd like to:

% git diff master -- src/MUIPlacesAutocomplete.jsx
diff --git a/src/MUIPlacesAutocomplete.jsx b/src/MUIPlacesAutocomplete.jsx
index 7be9108..1618ca0 100644
--- a/src/MUIPlacesAutocomplete.jsx
+++ b/src/MUIPlacesAutocomplete.jsx
@@ -66,7 +66,7 @@ export default class MUIPlacesAutocomplete extends React.Component {
       <Popper
         placement="top-start"
         modifiers={({ inner: { enabled: true } })}
-        style={{ left: 0, right: 0 }}
+        style={{ left: 0, right: 0, zIndex: 1 }}
       >
         {({ popperProps, restProps }) => (
           <div

This is hinted by https://github.com/FezVrasta/popper.js/issues/482
So basically we'd need a way to provide Popper CSS...

Awesome repo and info. I have some time this weekend so I am going to look at this issue. My first thoughts are to allow people add styles to <MUIPlacesAutocomplete> via a HOC.

@charlax
I've renamed this issue and gave it a label of 'bug' to isolate the issue of suggestions not rendering over descendant elements/components vs. providing fine grained control over the appearance/behavior of the elements/components that <MUIPlacesAutocomplete> composes. I've filed a task for providing fine grained control here: #29.
I've got a PR to fix the issue of the suggestions not rendering over descendant elements/components here: #30. This will unblock you and others while I provide a solution for fine grained control.


Promote integration-service from staging to production

Included PRs:

https://github.com/redhat-appstudio/integration-service/pull/552
https://github.com/redhat-appstudio/integration-service/pull/558
https://github.com/redhat-appstudio/integration-service/pull/561
https://github.com/redhat-appstudio/integration-service/pull/559
https://github.com/redhat-appstudio/integration-service/pull/560
https://github.com/redhat-appstudio/integration-service/pull/553
https://github.com/redhat-appstudio/integration-service/pull/556
https://github.com/redhat-appstudio/integration-service/pull/546
https://github.com/redhat-appstudio/integration-service/pull/555
https://github.com/redhat-appstudio/integration-service/pull/554
https://github.com/redhat-appstudio/integration-service/pull/521

/lgtm
/approve

/lgtm
/approve

/retest-required

/retest-required

CI is blocked due to KFLUXBUGS-1104

/retest-required


Write tests for side effects

Will work on effect test tonight.

Got it, I'll be available for review  :+1:


chore(docs): fix README.md

@djMax could you merge this PR?

Sorry - missed this notification originally.


(I#3934) Update user manual and in-app documentation for splitByLength()

Fixes #3934
Changes proposed in this pull request:

updated user manual and documentation for splitByLength()

Fixes #{3934}

Hi @TheTrailblazer09 ! Just some quick advise for your description: the first line must start with:
"Fixes" + SPACE + "#" + Issue number. No curly braces like you added.
Regards, Antoine

Fixes #~{~ 3934 ~}~

Hi @TheTrailblazer09 ! Just some quick advise for your description: the first line must start with: "Fixes" + SPACE + "#" + Issue number. No curly braces like you added.
When you are ready, tell me, I'll review your changes.
Regards, Antoine

Hi, I am ready

Fixes #~{~ 3934 ~}~

Hi @TheTrailblazer09 ! Just some quick advise for your description: the first line must start with: "Fixes" + SPACE + "#" + Issue number. No curly braces like you added.
When you are ready, tell me, I'll review your changes.
Regards, Antoine

Hi, I am ready

I think I disagree with the original issue actually: the array slicing has nothing to do with the function call: all arrays can be sliced in this way, so I would not add it to this section of the documentation.
I guess we could mention that in some cases it might be useful to chain this function call with a slicing operator, but it should really be clear slicing is available in other contexts, regardless of which function produced a given array. So I would leave the section header untouched, at least.

So do you think I should change the documentation (to say that slicing is available in other contexts as well ) or should I let it be?

Good work. Thank you, @TheTrailblazer09.

Thanks & Warm Regards


Does not work with Python 3.7

Library does not import on Python 3.7. Simple reproduction:
$ python --version
Python 3.7.4

$ python -c "import ynab_client"
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/Users/ralmeida/.pyenv/versions/3.7.4/lib/python3.7/site-packages/ynab_client/__init__.py", line 19, in <module>
    from ynab_client.api.accounts_api import AccountsApi
  File "/Users/ralmeida/.pyenv/versions/3.7.4/lib/python3.7/site-packages/ynab_client/api/__init__.py", line 6, in <module>
    from ynab_client.api.accounts_api import AccountsApi
  File "/Users/ralmeida/.pyenv/versions/3.7.4/lib/python3.7/site-packages/ynab_client/api/accounts_api.py", line 133
    async=params.get('async'),
        ^
SyntaxError: invalid syntax

I tested with 3.7.4, but any 3.7+ version should give the same problem, since async is now a reserved Python keyword. In 3.6.9 it works fine (as it should with other previous versions as well).
Maybe it's a swagger-codegen problem?

Likely related to https://github.com/swagger-api/swagger-codegen/issues/8328

This is fixed in https://github.com/gchiam/ynab-client-python/pull/12 but you need to ensure you have the latest copy of this repo. https://github.com/gchiam/ynab-client-python/pull/14 cuts a new release number so you can ensure you get the 3.7 compatible version in future.


#824 [Partial Fix] : A15-4-4 - Dont report on functions having a noexcept specification with a complex expression

Description
This PR implements a change to avoid reporting on functions that have a noexcept specification with a complex expression. In principle, the expression in the noexcept specification should be resolved to either true or false. However, in some cases, CodeQL is not able to see the resolved value and suggests to make a function as noexcept despite it already having a noexcept specification. Unfortunately, the minimized sample is difficult to create and hence, tests cannot be added at this moment. Since, the current implementation just looks for the literal true, and it doesn't consider if the specification has the constant value true, we can consider revising this fix once such capability gets implemented.
The other issues mentioned in #824 need a more detailed modeling of exception types that can be thrown and will be solved later.
Change request type

[ ] Release or process automation (GitHub workflows, internal scripts)
[ ] Internal documentation
[ ] External documentation
[x] Query files (.ql, .qll, .qls or unit tests)
[ ] External scripts (analysis report or other code shipped as part of a release)

Rules with added or modified queries

[ ] No rules added
[ ] Queries have been added for the following rules:

rule number here

[x] Queries have been modified for the following rules:

A15-4-4

Release change checklist
A change note (development_handbook.md#change-notes) is required for any pull request which modifies:

The structure or layout of the release artifacts.
The evaluation performance (memory, execution time) of an existing query.
The results of an existing query in any circumstance.

If you are only adding new rule queries, a change note is not required.
Author: Is a change note required?

[x] Yes
[ ] No

🚨🚨🚨
Reviewer: Confirm that format of shared queries (not the .qll file, the
.ql file that imports it) is valid by running them within VS Code.

[ ] Confirmed

Reviewer: Confirm that either a change note is not required or the change note is required and has been added.

[ ] Confirmed

Query development review checklist
For PRs that add new queries or modify existing queries, the following checklist should be completed by both the author and reviewer:
Author

[x] Have all the relevant rule package description files been checked in?
[x] Have you verified that the metadata properties of each new query is set appropriately?
[ ] Do all the unit tests contain both "COMPLIANT" and "NON_COMPLIANT" cases? - Minimized case cannot be created.
[x] Are the alert messages properly formatted and consistent with the style guide?
[x] Have you run the queries on OpenPilot and verified that the performance and results are acceptable?As a rule of thumb, predicates specific to the query should take no more than 1 minute, and for simple queries be under 10 seconds. If this is not the case, this should be highlighted and agreed in the code review process.
[x] Does the query have an appropriate level of in-query comments/documentation?
[ ] Have you considered/identified possible edge cases? - Minimized case cannot be created.
[x] Does the query not reinvent features in the standard library?
[x] Can the query be simplified further (not golfed!)

Reviewer

[x] Have all the relevant rule package description files been checked in?
[x] Have you verified that the metadata properties of each new query is set appropriately?
[x] Do all the unit tests contain both "COMPLIANT" and "NON_COMPLIANT" cases?
[x] Are the alert messages properly formatted and consistent with the style guide?
[x] Have you run the queries on OpenPilot and verified that the performance and results are acceptable?As a rule of thumb, predicates specific to the query should take no more than 1 minute, and for simple queries be under 10 seconds. If this is not the case, this should be highlighted and agreed in the code review process.
[x] Does the query have an appropriate level of in-query comments/documentation?
[x] Have you considered/identified possible edge cases?
[x] Does the query not reinvent features in the standard library?
[x] Can the query be simplified further (not golfed!)

Thanks @lcartey for the approval. Looks like the CI job fails due to not being able to access some resources (?). I'm not very well aware about this error and was wondering if it is anything that I should fix? Kindly let me know.


The Component use an outdated version of React Bootstrap

Hi!
Thanks for a good component.
But I've got an issue with its dependencies and with react-bootstrap itself.
Is it possible to remove it from dependencies  and leave one in devDependneices for dev and test purposes ?
The thing is that I use react-bootstrap with browserify, and browserify add in bundle my version of react-bootstrap and version of you component.

+1

we removed the dependency to react-bootstrap


Training

Updates and refactoring to enable training, including on GPU systems.
A simple script should eventually be added.

merging


Unable to build with shared libraries and gcc on MacOS

$ ./build charm++ netlrts-darwin-x86_64 gcc-10 --build-shared
[...]

[ 35%] Linking CXX static library ../../lib/libck.a
ld: warning: building for macOS 10.7 is deprecated
ld: warning: dylib (/usr/local/Cellar/gcc/10.2.0/lib/gcc/10/libstdc++.dylib) was built for newer macOS version (11.0) than being linked (10.7)
Undefined symbols for architecture x86_64:
  "_CcdCallFnAfter", referenced from:
      __Z10_qdHandlerP8envelope in qd.C.o
  "_CcdCallFnAfterOnPE", referenced from:
      __ZN9LBManager8setTimerEv in LBManager.C.o
      __ZN12MetaBalancer12periodicCallEPv in MetaBalancer.C.o
  "_CcdCallOnCondition", referenced from:
      __ZN7CkArray19setupSpringCleaningEv in ckarray.C.o
      _CkCallWhenIdle in init.C.o
      __Z10_qdHandlerP8envelope in qd.C.o
  "_CcdCallOnConditionKeep", referenced from:
      __ZN13LBMachineUtil7StatsOnEv in LBMachineUtil.C.o
      __ZN10TraceArray10traceBeginEv in trace-common.C.o
  "_CcdCancelCallOnCondition", referenced from:
      __ZN7CkArrayD2Ev in ckarray.C.o
      __ZN7CkArrayD1Ev in ckarray.C.o
  "_CcdCancelCallOnConditionKeep", referenced from:
      __ZN13LBMachineUtil8StatsOffEv in LBMachineUtil.C.o
      __ZN10TraceArray8traceEndEv in trace-common.C.o
  "_CcsDelayReply", referenced from:
      _ccsHandlerToCallback in ckcallback.C.o
  "_CcsRegisterHandlerFn", referenced from:
      __ZN16ckcallback_group19registerCcsCallbackEPKcRK10CkCallback in ckcallback.C.o
  "_CcsSendDelayedReply", referenced from:
      __ZNK10CkCallback4sendEPv in ckcallback.C.o
# [~100 more of these snipped]

Same happens with ./buildold.

My guess for what is happening here is that we need to add -l arguments when building shared objects. For example, libck.dylib needs to be built with -lconverse.


Add a save function to the session sidecar

This can be used by the ui to save unsaved work in a user's session when a user tries to shut down a session that has unsaved work.

Please also include the Refresh function.
Ref: https://github.com/SwissDataScienceCenter/renku-ui/issues/1956

The implementation will require a bit more than just renku save. It will need to do the following:
- git fetch
- git status --porcelain --branch: Should return that checkout is at or ahead of upstream, if not fail
- renku save

The second command should provide user-understandable feedback as to why the save couldn't run if it fails at that point.


Fix Manual Entry #2

Change Enter Key detection to KeyEventListener - Know issues with this are the Hardware back buttons are now enabled, this may cause user confusion.

This fixes the manual KB entry issue


User Login

User Story:
AS A registered user
I WANT TO log into my account
SO THAT I can report and track community issues
Acceptance Criteria:

The user can input their email and password to log in.
The system validates the email and password.
The user should receive a JWT token after successful login.

Tasks:

[x] Create a login form in the front-end.
[x] Implement validation for email and password input.
[x] Create the API route for user login.
[x] Implement JWT token generation and send it to the front-end.
[x] Handle error responses for incorrect or password.

GitHub Issue 2: User Login Implementation
What I’ve Done:

Created the login form (login.tsx) where the user can input their email and password.
Implemented validation for the email and password fields in the frontend to ensure correct input before submission.
Developed the login API route (POST /api/auth/login) on the server side to verify user credentials against the database.
Implemented JWT token generation using jsonwebtoken in authController.js upon successful login.
Added modal prompts in the frontend to notify users of:
Successful login.
Invalid password.
Nonexistent user (when an email is not registered).
Tested the login functionality with Postman:
Valid credentials return a JWT token and a success message.
Invalid credentials return appropriate error messages (e.g., wrong password, user does not exist).

What’s Left to Do:

This issue is now complete in terms of logging in the user and generating the JWT token.
However, the handling of storing the JWT token in localStorage and using it for protected routes will be handled in GitHub Issue 6.


Add missing background_modes

This is kind of a W.I.P. since I am not able to test this until monday. I'm running El Capitan at the moment and won't have access to a machine running Yosemite till monday.
_ This resolves issue #219 _
This pull request adds the options listed below. While a user could reference missing background modes like the following:
app.info_plist['UIBackgroundModes'] = [ 'bluetooth-central', 'bluetooth-peripheral' , 'my-missing-background-mode']

I think it's cleaner to reference it as the other already present background modes :smile:
Now you should be able to reference bluetooth-peripheral together with audio like:
app.background_modes = [:audio, :bluetooth_peripheral]

Add fetch  (iOS 7 and later)
The app requires new content from the network on a regular basis. When
it is convenient to do so, the system launches or resumes the app in
the background and gives it a small amount of time to download any new
content.
Add remote-notification (iOS 7 and later)
The app uses remote notifications as a signal that there is new content available for download. When a remote notification arrives, the system launches or resumes the app in the background and gives it a small amount of time to download the new content.
Add bluetooth-peripheral (iOS 6 and later)
The app uses the CoreBluetooth framework to communicate in peripheral mode with a Bluetooth accessory. The system will alert the user to the potential privacy implications of apps with this key set.

I came across the following URL
https://github.com/HipByte/RubyMotion/blob/master/lib/motion/project/template/ios.rb#L177
Should I also update the message to state that you can also set background_mode via the app.background_modes way?

Wow, I just came across this pull request and since there has been no activity I'll close this 🙂
I haven't needed this myself so I guess this is either fixed or nobody has come across this issue.


csvkit: 0.9.1 -> 1.0.2

Motivation for this change
Upgrade csvkit so that we can remove dateutil old versions (see #25375).
In order to upgrade csvkit, we need to update the following packages too
agate -> 1.6.0
agate-dbf -> 0.2.0
agate-excel -> 0.2.1
agate-sql -> 0.5.2 (new)
dbf -> 0.96.8
python-slugify -> 1.2.4
Things done

[x] Tested using sandboxing
(nix.useSandbox on NixOS,
or option build-use-sandbox in nix.conf
on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] Linux

[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nox --run "nox-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[x] Fits CONTRIBUTING.md.

One commit per package please.

Can you enable the sandbox and test whether the packages are working?

@FRidh I have verified using the sandbox.

thanks


[es] Remove deprecated getting started guides

Fixed #40537

@sftim, We are completely removing that page. So not sure why a redirect would be required.

/lgtm

/approve


Update cloudinary links.

Your checklist for this pull request
🚨Please review the guidelines for contributing to this repository.

[x] Make sure you are requesting to pull a topic/feature/bugfix branch (right side). Don't request your default branch!
[x] Make sure you are making a pull request against the default branch (left side). Also you should start your branch off default branch.
[x] Check the commit's or even all commits' message styles matches our requested structure.
[x] Check your code additions will fail neither code linting checks nor unit test.
[x] I have added necessary documentation (if appropriate)

Description
❤Thank you!
Post merge checklist

[ ] Follow steps from the guidelines for contributing to this repository.
[ ] If you are a new contributor, ping in the thread and one of the maintainers will add you to all-contributors list.

PR in progress.


Is there any implementation of FENCE instructions?

Hi!
I'm testing somethine about memory access, and I want to keep the order between two store/load instruction. I used "fence rw,rw" to do that, but nothing happened.
After checking the file, FENCE instruction has been found in EnvCallPlugin,
https://github.com/SpinalHDL/NaxRiscv/blob/main/src/main/scala/naxriscv/execute/EnvCallPlugin.scala#60
but I've not found any implementation of it. Is this feature been supported? Or it's just done in another module?
Thanks for your help!

Hi,
Fence are only "properly" implemented if memory coherency is enabled. It is done in the Lsu2Plugin :
https://github.com/SpinalHDL/NaxRiscv/blob/1c50e84d9a6f7ea93d7153f12906c25552267b9d/src/main/scala/naxriscv/lsu2/Lsu2Plugin.scala#L1857
It will add some logic to hold instruction just before the issue queue (dispatcher)

Ok, i got it! thanks!


Uncaught (in promise) TypeError: Failed to execute 'put' on 'Cache': Vary header contains *

When I first run the code, browser console shows this error message:
Uncaught (in promise) TypeError: Failed to execute 'put' on 'Cache': Vary header contains *
    at Object.put (workbox-core.prod.js:1)
put @ workbox-core.prod.js:1

My config:
create-nuxt-app v3.7.1
✨  Generating Nuxt.js project in nuxt-job-1
? Project name: nuxt-job-1
? Programming language: JavaScript
? Package manager: Yarn
? UI framework: None
? Nuxt.js modules:
? Linting tools: (Press <space> to select, <a> to toggle all, <i> to invert selection)
? Testing framework: None
? Rendering mode: Universal (SSR / SSG)
? Deployment target: Static (Static/Jamstack hosting)
? Development tools:
? What is your GitHub username? mashirozx
? Version control system: Git

🎉  Successfully created project nuxt-demo

OK, here: https://github.com/mashirozx/nuxt-debug
Environment info:
Edition	Windows 10 Pro
Version	20H2
Installed on	2020/8/22
OS build	19042.1165
Experience	Windows Feature Experience Pack 120.2212.3530.0
PowerShell 7.1.4
Nodejs v14.17.5
Yarn 1.22.11

@mashirozx That error is being triggered from an existing service worker you've installed on localhost:3000 - nothing to do with this project. (Note that it doesn't replicate in codesandbox for that reason.) Make sure to clear your service workers in chrome://serviceworker-internals/

Oh, yeah, it's the reason, a chrome plugin

Thanks 😊


Request:  Allow the color of highlighted nodes to be changed.

I've noticed at least one colorblind streamer has had issues seeing the typical red highlight.  Could there be an option to allow for the highlight color to be changed so that people with color deficiencies can find a color they can see for highlights?

On my phone atm so I can't confirm it but if I remember correctly this is possible to do in the settings.
Edit -> Settings

Had time to check now and it is already in place in settings.


Add mod and module links

Add links to webpages to mods and modules.

It might be fine for an initial version to only have links on Mods and not Modules, but then to display a module's mod's links on its detail view.


no closer is inserted for class*| as the opener

Title is not very accurate because I wanted to avoid using a "clickbaity" title. The problem is that the closer is not inserted for an opener which ends with a pattern similar to ass*|.
To reproduce, compare the behaviour of:
let b:pear_tree_pairs = extend(deepcopy(g:pear_tree_pairs), {
            \ 'ass*|': {'closer': ' end'}
            \ }, 'keep')

with
let b:pear_tree_pairs = extend(deepcopy(g:pear_tree_pairs), {
            \ 'bss*|': {'closer': ' end'}
            \ }, 'keep')

I need more info, because the two examples you give behave identically for me. Could you please show me:

The rest of your g:pear_tree_pairs if it's not the default

The behavior of ass*| vs bss*|

An example of what the wildcard part could be in this case

Also (not totally relevant, but) what programming language is this for?

No other modifications to g:pear_tree_pairs was done.

For ass*|, the closer( end) is not added but it is added for bss*|.

I was using any letter as the wildcard. I was trying to add a closer for class in ruby but it didn't work so, I kept playing with the opener and found that clbss was working.

The behaviour is not consistent, when I created the issue, bss*| was working but ass*| was not. After sometime, both were working. Right now neither of them are working.


why the terraform provider param is null? It can't find in terraform repository.

why the terraform provider param is null? It can't find in terraform repository.
Error: Failed to query available provider packages
│
│ Could not retrieve the list of available versions for provider hashicorp/null: provider
│ registry.terraform.io/hashicorp/null was not found in any of the search locations
│
│   - D:/DevTools/terraform/plugins

terraform {
required_version = ">= 0.13.0"
required_providers {
aws = {
source  = "hashicorp/aws"
version = ">= 2.0"
}
null = {
source  = "hashicorp/null"
version = ">= 2.0"
}
}
}


Add Native Support for Ephemery Testnet and Config Files

Description
There is currently no native support for Ephemery using the --network=ephemery flag.
We also need to include the Ephemery config to connect to the Ephemery Testnet easily.
For context Ephemery Testnet was initiated by @taxmeifyoucan. Ephemery testnet is a network that rolls back to the genesis after a set period of time. It is focused on short term and heavy testing usecases. This is also to avoid problems like insufficient testnet funds, inactive validators, state bloat, and similar issues faced by long-running testnets.

Whenever, we need to start an Ephemery Testnet
Versions (Add all that apply)

Software version: [teku --version or look for log lines starting with Teku version:]
Java version: [java -version]
OS Name & Version: [cat /etc/*release]
Docker Version: [docker version]
Cloud VM, type, size: [Amazon Web Services I3-large]

As part of my contribution for my Ethereum Protocol Fellowship (EPF) project, I would like this issue to be assigned to me.

For the context, ephemery is an implementation of eip-6916. The specification for CL client support is defined there.


Update Heroku deployment section

I just went through deploying it to Heroku and decided to document it for other people. @davezuko let me know if you want to make some changes or feel free to reject this ;)

[Current coverage][cc-pull] is 75.32%

Merging [#866][cc-pull] into [master][cc-base-branch] will not change coverage

@@             master       #866   diff @@
==========================================
  Files            15         15
  Lines            77         77
  Methods           0          0
  Messages          0          0
  Branches          0          0
==========================================
  Hits             58         58
  Misses           19         19
  Partials          0          0

Powered by Codecov. Last updated by [165535c...f2e9a3d][cc-compare]
[cc-base-branch]: https://codecov.io/gh/davezuko/react-redux-starter-kit/branch/master?src=pr
[cc-compare]: https://codecov.io/gh/davezuko/react-redux-starter-kit/compare/165535c9f2228106a72ac7e0f657844e78559420...f2e9a3d0b771bbfa0b8f8a3542170408b7f39f3a
[cc-pull]: https://codecov.io/gh/davezuko/react-redux-starter-kit/pull/866?src=pr

This is great, I don't see why I should reject it ;)

@davezuko ooh or feel free to merge it!

Merged, thank you!

@jsfr I saw you commented on this but can't seem to find it. If you have any concerns with what was just merged, please let me know and I'd be happy to edit. I'm not a Heroku user, so I'm taking this more on faith and what little experience I have with it than rigorous experience.


Should this be used to host a course at a website?

Hi!
Been playing with this tool, and I love the way it works! I'm wondering... Would it make sense to use this as the basis for an online course? I'd be more than happy to have freeCodeCamp host the course, but it seems like a great template for me to get started with.
Let me know!

This relies on the freeCodeCamp - Courses VSCode extension. So, I am not sure how you would use this for an online course (outside of tools like Gitpod, CodeSpaces, or CodeAlly).
Do you have anything more specific in mind?

It looks like you can serve it from a nodejs standpoint, so I was wondering if this was suitable to host on a site.
It looks like it would work pretty well?

We are repeating some stuff across platforms (I am talking with you on the forum), but just to be clear:
You can have the client (React) stuff as a website, but the tests are written in Nodejs, and test the OS filesystem. So, you have to host a VM for each client session - see tools listed above.
The client by itself is nothing special - it does nothing interactive with the lessons.

Yes!
Sorry! Will continue on the forum. Thanks for the insights.


tec-failed tx continues to be retried in subsequent ledgers (Version: 1.6.0)

Issue Description
When applying a transaction to a ledger that fails with a TEC code the transaction should be discarded but is being held and retried until retry limit is reached.
(Not sure if this is a bug or if I'm misunderstanding some internal process.)
Steps to Reproduce
Add
return {tecNO_PERMISSION, true};

as the first line of
static std::pair<TER, bool>
invoke_apply(ApplyContext& ctx)

in ripple/app/tx/impl/applySteps.cpp
This will cause every transaction rippled attempts to apply to the ledger to fail with a TEC code.
Next:

Run ./rippled -a
Set ./rippled log_level trace
Submit a transaction over websocket (or presumably some other way would work also)

{
        Account: 'rHb9CJAWyB4rj91VRWn96DkukG4bwdtyTh',
        TransactionType: "Payment",
        Amount:<PHONE_NUMBER>,
        Destination: "rUCzEr6jrEyMpjhs4wSdQdz4g8Y382NxfM",
        LastLedgerSequence: 20
}

Advance the ledger using ./rippled ledger_accept
Continue advancing the ledger and observe each advance the transaction re-appears and is re-applied

# ./rippled -a 2>&1 | grep TxQ
2020-Sep-08 14:41:00.509805003 UTC TxQ:TRC Transaction 33E0E840154EA34C1DA94A4988C7915FDE3FDDD5857D2BE9FEEBE42B91FD13C6 from account rHb9CJAWyB4rj91VRWn96DkukG4bwdtyTh has fee level of 307 needs at least 256 to get in the open ledger, which has 0 entries.
2020-Sep-08 14:41:00.509842934 UTC TxQ:TRC Applying transaction 33E0E840154EA34C1DA94A4988C7915FDE3FDDD5857D2BE9FEEBE42B91FD13C6 to open ledger.
2020-Sep-08 14:41:00.509873722 UTC TxQ:TRC New transaction 33E0E840154EA34C1DA94A4988C7915FDE3FDDD5857D2BE9FEEBE42B91FD13C6 applied successfully with tecNO_PERMISSION
2020-Sep-08 14:41:05.728192665 UTC TxQ:DBG Ledger 3 has 0 transactions. Ledgers are processing as expected. Expected transactions is currently 1000 and multiplier is 128000
2020-Sep-08 14:41:05.728211119 UTC TxQ:DBG Expected transactions updated to 1000 and multiplier updated to 128000
2020-Sep-08 14:41:05.728758544 UTC TxQ:TRC Transaction 33E0E840154EA34C1DA94A4988C7915FDE3FDDD5857D2BE9FEEBE42B91FD13C6 from account rHb9CJAWyB4rj91VRWn96DkukG4bwdtyTh has fee level of 307 needs at least 256 to get in the open ledger, which has 0 entries.
2020-Sep-08 14:41:05.728783862 UTC TxQ:TRC Applying transaction 33E0E840154EA34C1DA94A4988C7915FDE3FDDD5857D2BE9FEEBE42B91FD13C6 to open ledger.
2020-Sep-08 14:41:05.728798118 UTC TxQ:TRC New transaction 33E0E840154EA34C1DA94A4988C7915FDE3FDDD5857D2BE9FEEBE42B91FD13C6 applied successfully with tecNO_PERMISSION
2020-Sep-08 14:41:07.888517058 UTC TxQ:DBG Ledger 4 has 0 transactions. Ledgers are processing as expected. Expected transactions is currently 1000 and multiplier is 128000
2020-Sep-08 14:41:07.888538368 UTC TxQ:DBG Expected transactions updated to 1000 and multiplier updated to 128000
2020-Sep-08 14:41:07.889091474 UTC TxQ:TRC Transaction 33E0E840154EA34C1DA94A4988C7915FDE3FDDD5857D2BE9FEEBE42B91FD13C6 from account rHb9CJAWyB4rj91VRWn96DkukG4bwdtyTh has fee level of 307 needs at least 256 to get in the open ledger, which has 0 entries.
2020-Sep-08 14:41:07.889114898 UTC TxQ:TRC Applying transaction 33E0E840154EA34C1DA94A4988C7915FDE3FDDD5857D2BE9FEEBE42B91FD13C6 to open ledger.
2020-Sep-08 14:41:07.889131740 UTC TxQ:TRC New transaction 33E0E840154EA34C1DA94A4988C7915FDE3FDDD5857D2BE9FEEBE42B91FD13C6 applied successfully with tecNO_PERMISSION
2020-Sep-08 14:41:08.904645781 UTC TxQ:DBG Ledger 5 has 0 transactions. Ledgers are processing as expected. Expected transactions is currently 1000 and multiplier is 128000
2020-Sep-08 14:41:08.904666379 UTC TxQ:DBG Expected transactions updated to 1000 and multiplier updated to 128000
2020-Sep-08 14:41:08.905325714 UTC TxQ:TRC Transaction 33E0E840154EA34C1DA94A4988C7915FDE3FDDD5857D2BE9FEEBE42B91FD13C6 from account rHb9CJAWyB4rj91VRWn96DkukG4bwdtyTh has fee level of 307 needs at least 256 to get in the open ledger, which has 0 entries.
2020-Sep-08 14:41:08.905350089 UTC TxQ:TRC Applying transaction 33E0E840154EA34C1DA94A4988C7915FDE3FDDD5857D2BE9FEEBE42B91FD13C6 to open ledger.
2020-Sep-08 14:41:08.905368264 UTC TxQ:TRC New transaction 33E0E840154EA34C1DA94A4988C7915FDE3FDDD5857D2BE9FEEBE42B91FD13C6 applied successfully with tecNO_PERMISSION
2020-Sep-08 14:41:09.703609839 UTC TxQ:DBG Ledger 6 has 0 transactions. Ledgers are processing as expected. Expected transactions is currently 1000 and multiplier is 128000
2020-Sep-08 14:41:09.703626730 UTC TxQ:DBG Expected transactions updated to 1000 and multiplier updated to 128000
2020-Sep-08 14:41:09.704139221 UTC TxQ:TRC Transaction 33E0E840154EA34C1DA94A4988C7915FDE3FDDD5857D2BE9FEEBE42B91FD13C6 from account rHb9CJAWyB4rj91VRWn96DkukG4bwdtyTh has fee level of 307 needs at least 256 to get in the open ledger, which has 0 entries.
2020-Sep-08 14:41:09.704190336 UTC TxQ:TRC Applying transaction 33E0E840154EA34C1DA94A4988C7915FDE3FDDD5857D2BE9FEEBE42B91FD13C6 to open ledger.
2020-Sep-08 14:41:09.704209743 UTC TxQ:TRC New transaction 33E0E840154EA34C1DA94A4988C7915FDE3FDDD5857D2BE9FEEBE42B91FD13C6 applied successfully with tecNO_PERMISSION
2020-Sep-08 14:41:10.439903472 UTC TxQ:DBG Ledger 7 has 0 transactions. Ledgers are processing as expected. Expected transactions is currently 1000 and multiplier is 128000
2020-Sep-08 14:41:10.439931254 UTC TxQ:DBG Expected transactions updated to 1000 and multiplier updated to 128000
2020-Sep-08 14:41:10.440634692 UTC TxQ:TRC Transaction 33E0E840154EA34C1DA94A4988C7915FDE3FDDD5857D2BE9FEEBE42B91FD13C6 from account rHb9CJAWyB4rj91VRWn96DkukG4bwdtyTh has fee level of 307 needs at least 256 to get in the open ledger, which has 0 entries.
2020-Sep-08 14:41:10.440665119 UTC TxQ:TRC Applying transaction 33E0E840154EA34C1DA94A4988C7915FDE3FDDD5857D2BE9FEEBE42B91FD13C6 to open ledger.
2020-Sep-08 14:41:10.440689174 UTC TxQ:TRC New transaction 33E0E840154EA34C1DA94A4988C7915FDE3FDDD5857D2BE9FEEBE42B91FD13C6 applied successfully with tecNO_PERMISSION

Expected Result
Transaction which returns a TEC should be classed as applied and therefore dropped from queue.
Actual Result
Transaction appears to remain (in queue?) and reapply is attempted (until retry limit?) each time the ledger is advanced
Environment
CentOS Linux release 8.2.2004 (Core), boost_1_70_0
rippled version 1.6.0 (checked out from master)

To make a long story short, that's because the transaction didn't actually get added to a ledger.
Every transaction submitted locally is added to a "local transactions" object, regardless of the result. https://github.com/ripple/rippled/blob/develop/src/ripple/app/misc/NetworkOPs.cpp#L1422-L1428
After every ledger close, the transactions in that object are checked against the ledger. Any that are found are removed. Any not found are retried.
That's why you're seeing the transaction get retried, because your added line of code is bypassing everything that could possibly put the transaction into a ledger.
If I understand what you want to do, you can replace this line: https://github.com/ripple/rippled/blob/develop/src/ripple/app/tx/impl/Transactor.cpp#L650
        result = apply();

with
        result = tecNO_PERMISSION;

Alternatively, don't modify code at all, but create transactions that create a scenario where the transaction engine returns a real tec code.
Personally, I find it to be a little inaccurate to think of transactions as "succeeding" or "failing". IMHO, a better way to think about it is "made it into a (validated) ledger" or "didn't make it into a ledger". Then "made it into a ledger" can be further divided as "did what I expected it to do" (generally a tesSUCCESS) or "didn't do what I expected it to do" (generally a tec).
Since the behavior described is intentional, other than the modified code, I'm going to close this issue. If you have further questions or issues, feel free to re-open this ticket or create a new one.


Fixed import for Application, it is now using <%=packageName%>

Fixed import for Application, it is now using <%=packageName%> in Swagger2MarkupIntTest

:+1: Thanks! I missed that!


Ignore certain file types

Is there a way to make the automated encoder ignore certain file types or only encode certain ones?
I have it watching a folder that gets other junk files put in with video files.

Currently the watch folder is expected to receive only video files.  However, depending on your workflow, there is always a way to only copy proper files to the watch folder.  If you need more details on this, please describe how you bring your files to the watch folder.
Else, an other solution is to just let the conversion fails on these files.  You can also use the pre-conversion hook to determine if the file needs to be encoded and delete it if it doesn't have to.

I have Handbrake watching the completed folder of NZBGet, sometimes there are .nfo or .sbt files that are downloaded alongside.
I’ll take a look at the pre-conversion hook. I’d like to be able to skip x265 files, since that’s what I’m encoding too anyway.
Sent with GitHawk


Update APT About Page Text

Description
About page text needs updating to reflect current state of APT.
Document
Tasks:

[x] review page and determine what updates are needed
[x] send the updates to DevSeed

Acceptance Criteria

[x] about page text updates sent to DevSeed

@wrynearson The About page text is ready to be updated (see document).

@wrynearson Looks good on staging.


Use logger rather than System.err

Use logger instead of System.err for logging ScheduledExecutorService termination failure.
I think the current code use System.err because this piece was copied from java documentation:
https://docs.oracle.com/javase/7/docs/api/java/util/concurrent/ExecutorService.html
The following method shuts down an ExecutorService in two phases, first by calling shutdown to reject incoming tasks, and then calling shutdownNow, if necessary, to cancel any lingering tasks:
 void shutdownAndAwaitTermination(ExecutorService pool) {
   pool.shutdown(); // Disable new tasks from being submitted
   try {
     // Wait a while for existing tasks to terminate
     if (!pool.awaitTermination(60, TimeUnit.SECONDS)) {
       pool.shutdownNow(); // Cancel currently executing tasks
       // Wait a while for tasks to respond to being cancelled
       if (!pool.awaitTermination(60, TimeUnit.SECONDS))
           System.err.println("Pool did not terminate");
     }
   } catch (InterruptedException ie) {
     // (Re-)Cancel if current thread also interrupted
     pool.shutdownNow();
     // Preserve interrupt status
     Thread.currentThread().interrupt();
   }
 }

@joschi Yes, that was c&p issue. Fixed in the last commit


fixes #12 set up table balancer

This PR depends on fluo-io/fluo-deploy#52 because it removes calls to fluo new.  I suppose this also fixes #23

+1


Error when running against Tap code

Overview
Currently, executing node examples/tap.js results in the following output:
node examples/tap.js

node.js:201
        throw e; // process.nextTick error, or 'error' event on first tick
              ^
TypeError: Object #<WriteStream> has no method 'on'
    at TapProducer.<anonymous> (stream.js:52:8)
    at TapProducer.__profile__ (/Users/maynardb/Documents/Code/Ardus/lib/decorators/profiler.js:74:23)
    at TapProducer.__profile__ [as pipe] (/Users/maynardb/Documents/Code/Ardus/lib/decorators/profiler.js:74:23)
    at new GlobalHarness (/Users/maynardb/Documents/Code/Ardus/node_modules/tap/lib/tap-global-harness.js:21:15)
    at Object.<anonymous> (/Users/maynardb/Documents/Code/Ardus/node_modules/tap/lib/main.js:8:28)
    at Module._compile (module.js:432:26)
    at Object..js (/Users/maynardb/Documents/Code/Ardus/lib/globals/profiler.js:8:12)
    at Module.load (module.js:351:31)
    at Function._load (module.js:310:12)
    at Module.require (module.js:357:17)

Action(s)

Figure out why this is happening
Fix it

Update
I believe I know what is causing this issue. The wrapper is only wrapping properties one level deep. This means any properties nested beyond one level are lost.
Solution
The wrapper needs to recursively wrap properties all the way down.
Gotcha
The wrapper must have a way to short circuit the wrapping process to avoid errors such as the following:
RangeError: Maximum call stack size exceeded

Fix (sort of)
I actually ran into several issues working this that all pretty much boiled down to the same thing: automatically detecting the source file name and line number for a function invokation isn't exactly easy :-)
The hack I put in place for the specific error above was actually a console.log call. Say it with me now: "Globbing stdio is baaaaad"
Anyway, the two commits from today that directly deal with this are:
https://github.com/bsgbryan/Ardus/commit/5efd39bb15ab616ebec2b4103ae081a77847a2b2
and
https://github.com/bsgbryan/Ardus/commit/8d723ef938e8103ea9ff8d0f0a5c6143cf14905a
Caveat
I have only tried this with Ardus' examples so far. I'll try it with some other code to see if my changes really stand up.

Summary
Ok, so I'va arrived at a solution for this that I'm not sure psyched about, but works. This line fixes the problem in the best way I know of for now.
I'm going to close this issue, but will keep an eye out for a more elegant solution.