Migrations are not applied within makefile task 'bootstrap'

Bug Report
Expected behavior/code
Once successfully installed with make bootstrap the site should run and display pages correctly.
Actual Behavior
Trying to reach any page leads to a Http500 error with the following traceback:
Environment:

Request Method: GET
Request URL: http://<IP_ADDRESS>:8070/

Django Version: 3.2.16
Python Version: 3.10.8
Installed Applications:
('richie.apps.demo',
 'richie.apps.search',
 'richie.apps.courses',
 'richie.apps.core',
 'richie.plugins.glimpse',
 'richie.plugins.html_sitemap',
 'richie.plugins.large_banner',
 'richie.plugins.nesteditem',
 'richie.plugins.plain_text',
 'richie.plugins.section',
 'richie.plugins.simple_picture',
 'richie.plugins.simple_text_ckeditor',
 'richie.plugins.lti_consumer',
 'richie',
 'dj_pagination',
 'dockerflow.django',
 'parler',
 'rest_framework',
 'djangocms_admin_style',
 'djangocms_googlemap',
 'djangocms_link',
 'djangocms_picture',
 'djangocms_text_ckeditor',
 'djangocms_video',
 'cms',
 'menus',
 'sekizai',
 'treebeard',
 'filer',
 'easy_thumbnails',
 'dal',
 'dal_select2',
 'django.contrib.auth',
 'django.contrib.contenttypes',
 'django.contrib.sessions',
 'django.contrib.admin',
 'django.contrib.sites',
 'django.contrib.sitemaps',
 'django.contrib.staticfiles',
 'django.contrib.messages',
 'django.contrib.humanize')
Installed Middleware:
('richie.apps.core.cache.LimitBrowserCacheTTLHeaders',
 'cms.middleware.utils.ApphookReloadMiddleware',
 'django.middleware.security.SecurityMiddleware',
 'django.contrib.sessions.middleware.SessionMiddleware',
 'django.middleware.csrf.CsrfViewMiddleware',
 'django.contrib.auth.middleware.AuthenticationMiddleware',
 'django.contrib.messages.middleware.MessageMiddleware',
 'django.middleware.locale.LocaleMiddleware',
 'django.middleware.common.CommonMiddleware',
 'django.middleware.clickjacking.XFrameOptionsMiddleware',
 'dockerflow.django.middleware.DockerflowMiddleware',
 'cms.middleware.user.CurrentUserMiddleware',
 'cms.middleware.page.CurrentPageMiddleware',
 'cms.middleware.toolbar.ToolbarMiddleware',
 'cms.middleware.language.LanguageCookieMiddleware',
 'dj_pagination.middleware.PaginationMiddleware')

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 84, in _execute
    return self.cursor.execute(sql, params)

The above exception (relation "cms_urlconfrevision" does not exist
LINE 1: ...sion"."id", "cms_urlconfrevision"."revision" FROM "cms_urlco...
                                                             ^
) was the direct cause of the following exception:
  File "/usr/local/lib/python3.10/site-packages/django/core/handlers/exception.py", line 47, in inner
    response = get_response(request)
  File "/usr/local/lib/python3.10/site-packages/django/utils/deprecation.py", line 116, in __call__
    response = self.process_request(request)
  File "/usr/local/lib/python3.10/site-packages/cms/middleware/utils.py", line 11, in process_request
    apphook_reload.ensure_urlconf_is_up_to_date()
  File "/usr/local/lib/python3.10/site-packages/cms/utils/apphook_reload.py", line 19, in ensure_urlconf_is_up_to_date
    global_revision = get_global_revision()
  File "/usr/local/lib/python3.10/site-packages/cms/utils/apphook_reload.py", line 55, in get_global_revision
    revision, _ = UrlconfRevision.get_or_create_revision(
  File "/usr/local/lib/python3.10/site-packages/cms/models/apphooks_reload.py", line 26, in get_or_create_revision
    obj, created = cls.objects.get_or_create(
  File "/usr/local/lib/python3.10/site-packages/django/db/models/manager.py", line 85, in manager_method
    return getattr(self.get_queryset(), name)(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/django/db/models/query.py", line 581, in get_or_create
    return self.get(**kwargs), False
  File "/usr/local/lib/python3.10/site-packages/django/db/models/query.py", line 431, in get
    num = len(clone)
  File "/usr/local/lib/python3.10/site-packages/django/db/models/query.py", line 262, in __len__
    self._fetch_all()
  File "/usr/local/lib/python3.10/site-packages/django/db/models/query.py", line 1324, in _fetch_all
    self._result_cache = list(self._iterable_class(self))
  File "/usr/local/lib/python3.10/site-packages/django/db/models/query.py", line 51, in __iter__
    results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
  File "/usr/local/lib/python3.10/site-packages/django/db/models/sql/compiler.py", line 1175, in execute_sql
    cursor.execute(sql, params)
  File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 98, in execute
    return super().execute(sql, params)
  File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 66, in execute
    return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)
  File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 75, in _execute_with_wrappers
    return executor(sql, params, many, context)
  File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 79, in _execute
    with self.db.wrap_database_errors:
  File "/usr/local/lib/python3.10/site-packages/django/db/utils.py", line 90, in __exit__
    raise dj_exc_value.with_traceback(traceback) from exc_value
  File "/usr/local/lib/python3.10/site-packages/django/db/backends/utils.py", line 84, in _execute
    return self.cursor.execute(sql, params)

Exception Type: ProgrammingError at /
Exception Value: relation "cms_urlconfrevision" does not exist
LINE 1: ...sion"."id", "cms_urlconfrevision"."revision" FROM "cms_urlco...
                                                             ^

Steps to Reproduce

Clone repository from master branch
Use make bootstrap and when finished successfully use make run
Go anywhere on deployed local site, like http://localhost:8070/

Worth to note than then after, i've runned make migrate, not any migrations was created from make bootstrap, and when it finished, the site has coming back without error (except for missing data, but it was expected).
Environment

Richie version: 2.17.0 (latest from master branch 5ae0063)
Platform: Linux

Possible Solution
I don't really know what is going on, since the migrate tasks is included in make bootstrap

I think this may have been an issue with memory, i'm recalling to have seen many logging output about the postgres container instance that could not be reached, and so maybe the migrate task an further tasks from bootstrap could not have been runned.
You probably can close this issue.

I'm closing this since i did not reproduce this issue with more recent releases.


Recreate Spring Boot classloader in unit test

Do you think you could merge this? That way it can be merged in the upstream webjars-locator. Thanks!


Optimize and moved project_list method to service

Notion card
Summary

Optimized project_list method in the Company model
Moved project_list method to it's services

Preview

Type of change
Please delete options that are not relevant.

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[x] Refactor (non-breaking and retains same functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to
not work as expected)
[ ] This change requires a documentation update

How Has This Been Tested?

Checklist:

[x] I have manually tested all workflows
[x] I have performed a self-review of my own code
[ ] I have annotated changes in the PR that are relevant to the reviewer
[ ] I have added automated tests for my code

@abinashpa Please update the branch

@swaathi I have added memoization for ProjectListService#project_list_query

@swaathi

Renamed both method and the variable name project_list_query.
I did a self-review of my code but I get very few rails tasks so it's hard to practice all of them, please be explicit in my review.
I did change the summary, you can check the history.
All Rspec tests are passing, but CI is failing because of an OpenSSL issue over which I don't have any control.

CI is passing now.


Create ContactCard component structure

Contact Card
Component Screenshot: https://share.getcloudapp.com/P8uedn2L
Figma design: https://www.figma.com/file/Lo1ZcBOO9t4QRbX2I0PwBQ/RBB?node-id=161%3A0
The contact card should output the following data:

URL (or modal trigger)
Image URL
Title
Blurb

The entire card should be clickable and trigger either the URL or a modal popup.
Note: Just the rough layout, styling not important yet

Id love to jump on this one

"The entire card should be clickable and trigger either the URL or a modal popup." -
So will the image be a link to the contact? I dont quite understand the requirement.

Apologies, let me elaborate off of the above screenshot:
Each card has an image.
If we look at the "Business Owners" card. On click of this card, a business registration form modal will appear. Don't worry about the contents of the modal for now, we just need the ability to trigger a modal if necessary from an individual card.
If we look at the "General Inquiry" card. Clicking of this card should be a mailto: link with a fake email address for now (we'll change this to the proper RBB support email). Opens in a new tab
The "Volunteers" card will be a Discord link (https://discord.gg/272XMuv). Opens in a new tab.
We need to be able to support the above cases with this component. Let me know if that helps!

Thats great info thank you! So its actually three cards with separate use cases!

 Create "ContactCard" component

Ahh i missed the screenshot, too eager! Thank you for clarifying :)

Thats great info thank you! So its actually three cards with separate use cases!

Three separate cards, but should only be one React component, with props to address each use case :)

Ahh i missed the screenshot, too eager! Thank you for clarifying :)

No worries at all!

Yep, all over it! First time using Chakra so learning that as i go. Will hopefully have this done by latest Sunday night.

I might suggest using the react-spring-modal package for the modals as well. It's a library I made that abstracts out a lot of the accessibility issues when dealing with models while still allowing you to keep the modals looking professional with the possibility of animations/transitions via react-spring. If not that's fine too as long as the modals we use are accessible.

I might suggest using the react-spring-modal package for the modals as well. It's a library I made that abstracts out a lot of the accessibility issues when dealing with models while still allowing you to keep the modals looking professional with the possibility of animations/transitions via react-spring. If not that's fine too as long as the modals we use are accessible.
https://npm.im/react-spring-modal

Thanks Chris, We're using Chakra so I had thought to use their modal, but I will take a look at this package. I'm not a massive fan of spring but if needs must... 😊


Uncaught bud without mother in edit annotations

There seems to be an issue where the annotations table will have a mother-bud pair where both cells are listed as buds, and there's no error when I feel like this would be good to catch. See cells 2/3 below:

See comment in Issue #29; problem may have resulted from manually changing cell cycle annotations table in a prior frame, so not replicable easily.


Make default file permissions more restrictive

This asures that the process can still read and write its own log file,
but that other users cannot. This is a fairly standard mode for log
files in linux.
This addresses #82

Any chance we can get this patch tagged and released? I am currently using aws/amazon-cloudwatch-agent  which imports this utitity as  gopkg.in/natefinch/lumberjack.v2 v2.0.0 which has overly permissive logfiles. This patch will fix that. Hopefully we can do a v2.0.1 or a v2.1 release?
Thank you


fixed oc scale command example in camel-cdi-http README.md

replaced incorrect replication controller reference camel-servlet-quickstart with quickstart-war-camel-servlet

Can one of the admins verify this patch?

ok to test


Remove collection of moderation actions and replace with helix endpoint lookup

Moderation actions can now be directly queried from the Helix API:
https://dev.twitch.tv/docs/api/reference/#get-banned-events
So it should no longer be necessary to collect this data from pubsub ourselves.

Awesome, this endpoint looks great!


[Icon Request] Certificate and Key icons

[x] I'm sure this issue is not a duplicate?

[x] I want to create an icon request:
- Type: extension
- Icon Name: cert
- Sample original Icon: N/A
- Extensions: .csr, .crt, .cer, .der, .pfx, .p12, .p7b, .p7r, .src, .crl, .sst, .stl

[x] I want to create an icon request:
- Type: extension
- Icon Name: key
- Sample original Icon: N/A
- Extensions: .pem, .key

Guys, I need some help. I created some icons for this issue but I can't decide which to chose.
Group 1

Group 2

I do have a personal preference but I'll tell you after yours.

I like the style of the second one, but I think the green is a bit worrying and I can't get why it's there... I think users shouldn't have a question about a icon which should improve the recognizably.

If you zoom in you'll see it's a locket.

oh. lol. Didn't saw that. But I think the contrast is a bit worse :/

You are right. Too much dark colors in there.
How about those ones?

I could get used to it. :)

I like Group 1. It's simpler and ads less noise to the icon. Straight to the point.

Guys, you aren't making my life any easier. 🤕
I'm lining towards Group 2 as they are more distinguishable to the eye.

Trivia: When those get merged we will surpass the 500 icons mark.

Let's flip a coin. 👅
(and wait until it says we're using the second one)


Convert challenge events to merged style

Converts all of the remaining challenge events to merged events.
I don't particularly like using destructuring for parameters of the afterChallenge handlers. However, there are over 100 cards that use that event and updating each one manually would have been far more error prone and time consuming.
Finally, since we're already touching all of the afterChallenge events, this would be a good opportunity to rename the event. I was thinking of something like onChallengeWinnerDetermined as being more descriptive, but it's a bit long. Open to suggestions.

So TIL destructuring exists, and now have one more thing to hate about javascript :(


Improve quantile method docstring + error

[x] Closes #6875
[x] Tests added
[ ] User visible changes (including notable bug fixes) are documented in whats-new.rst
[x] New functions/methods are listed in api.rst

Thanks @headtr1ck!


View Changes from each commit in the pull request

Having multiple commits in the PR, it would be easier to see the changes from each commit in the PR or a range of commits in the PR instead of only the squashed content of all the commits

A list of commits and all of the files changes within them is available if you check out the pull request:

There's an existing feature request to also make this visible without checkout out the PR: https://github.com/microsoft/vscode-pull-request-github/issues/2201
I'm going to close this as a duplicate, thanks!


client: rework how the handler's type gets checked

Previously it would allow tuple and any pointer types. This enforces the expected type to be a non tuple struct or a pointer to one.

Nice, thanks.


feat(MemberApprovalController): Add 'redirect_to_admin' config.

Wrap $Content in <p> tags.
Add fullstop to 'ALREADYAPPROVEDNOTE' text.
Add LiteralField # anchor. This is to ensure future breakage is unlikely.
Update README.md to document configuration behaviour.

Hold off for a tic.


Use Folium attribute selection to populate ST controls

Hi Randy.  I have created a user story for a use case I have which is to use information from selected features in a specific map layer to populate ST controls.  An example : populating an image list in a ST dropdown with the currently visible (or selected) features on a given layer in the map.
I'd like to work on a PR for that and wondered if you had thoughts or plans along those lines.  Here is the (short) document : https://github.com/ymoisan/streamlit-folium/blob/master/user-stories.md.  Comments welcome.  Thanx for the component !

Thanks for checking out this component!
There are really two parts here:

Folium itself isn't bi-directional, so any work to pass data back and forth would need to be done at the leaflet layer

Deciding what to pass back and forth

Number 1 can be done independently of number 2, since you could set up a bi-directional component for Streamlit that doesn't return anything. That could be a good first project for anyone.
For number 2, we'd have to think of the entire surface area of plugins that people might use from Folium, and then think about passing data back. I suspect what we would want to do is pass a Dict back to Python, so that we can have any number of keys returned back (where the key might be a plugin, or a specific value like bbox). Then, it's a matter of implementing all those things.
If you're willing to take a shot at a PR, I'm happy to review it!

Thanx for your ideas.  I agree that a broad approach assessing plugins should be taken for the general case.  I noticed for example that the Fullscreen plugin does not work currently through Streamlit-folium.
I started playing with html (e.g. adding a map title) to feel things a bit more.  We'll see what we'll com up with.

It looks like #9 is a step in this direction... does that suggest there's a workaround for item 1 @randyzwitch mentioned (Folium not bi-directional)?
If the goal is to change what data is used in a graph based on the marker a user selects in a folium map, would you still suggest using leaflet? Or does #9 look like something that will be a viable path in the next couple months?

It looks like #9 is a step in this direction... does that suggest there's a workaround for item 1 @randyzwitch mentioned (Folium not bi-directional)?
If the goal is to change what data is used in a graph based on the marker a user selects in a folium map, would you still suggest using leaflet? Or does #9 look like something that will be a viable path in the next couple months?

Hi @dansbecker -
Yes, #9 is a step towards have data communicate back and forth, but it's not going to be because Folium does it. Rather, I was originally going to set it up to pass the bounding box back from Leaflet.js to Python, just to prove it could be done. Then, we could figure out what other data might be useful to send back.
Not sure when I'll get back to working on that PR, but the fix I was waiting for has gone into base Streamlit, so if I can get a co-worker to help me it might not be too long from now.

Hi @dansbecker -
Yes, #9 is a step towards have data communicate back and forth, but it's not going to be because Folium does it. Rather, I was originally going to set it up to pass the bounding box back from Leaflet.js to Python, just to prove it could be done. Then, we could figure out what other data might be useful to send back.
Not sure when I'll get back to working on that PR, but the fix I was waiting for has gone into base Streamlit, so if I can get a co-worker to help me it might not be too long from now.

@randyzwitch After some time experimenting with streamlit-folium, we did a quick try with a pure Leaflet (and React) implementation instead because of one particularly thorny issue we could not overcome : leave the map "alone" when updating a Streamlit item.  I still very much like the idea of avoiding JS and staying in Python (being able to use tools like shapely is great, for example) but the way Streamlit re-runs the whole script from top to bottom upon refreshing one UI component makes it unbearable because it re-creates the map every time.  At least I haven't found a decent way to cache the map (it does not appear to be "st.cacheable").
I was (and still am) attracted by the simplicity of Streamlit but as far as I can see it looks like using it as a "web map wrapper" may not be the best use case.  Still searching ...

@randyzwitch After some time experimenting with streamlit-folium, we did a quick try with a pure Leaflet (and React) implementation instead because of one particularly thorny issue we could not overcome : leave the map "alone" when updating a Streamlit item.  I still very much like the idea of avoiding JS and staying in Python (being able to use tools like shapely is great, for example) but the way Streamlit re-runs the whole script from top to bottom upon refreshing one UI component makes it unbearable because it re-creates the map every time.  At least I haven't found a decent way to cache the map (it does not appear to be "st.cacheable").
I was (and still am) attracted by the simplicity of Streamlit but as far as I can see it looks like using it as a "web map wrapper" may not be the best use case.  Still searching ...

That's a good point, and glad you are researching this. As a non-Folium user for the most part, I'm viewing this as an interesting exploration of what Streamlit and the relation between Python and JS might be.
Which is to say, the actual Python Folium part is limited by the Folium package itself. Bi-directional communication doesn't exist there, so it doesn't easily exist in Streamlit. But if we're viewing Folium as a API to Leaflet.js, in the same way that Vega is a grammar of D3, then there might be some interesting ideas here.

That's a good point, and glad you are researching this. As a non-Folium user for the most part, I'm viewing this as an interesting exploration of what Streamlit and the relation between Python and JS might be.
Which is to say, the actual Python Folium part is limited by the Folium package itself. Bi-directional communication doesn't exist there, so it doesn't easily exist in Streamlit. But if we're viewing Folium as a API to Leaflet.js, in the same way that Vega is a grammar of D3, then there might be some interesting ideas here.

Version 0.6.0 is now on PyPI. Use pip install -U streamlit-folium to get the latest version. Please also see the release notes on how this version is believed to solve this issue
https://github.com/randyzwitch/streamlit-folium/releases/tag/v0.6.0


New Combination - type species

It allows creating a new combination even if the species is the type of another genus, without sending any warning

Not sure I understand, species can be used in combiantion with any genera, regardless of their type status? @proceps does doing this mean we should fire a soft validation warning?

This is legal action. People move species from one genus to another (in some cases moving a type species). But creating a new combination, does not change the classification of the species. You still have to go to the taxon and change the parent. I remember we discussed changing a parent according to newly created combination. I do not remember if this was implemented. And yes, the taxon will be flagged with a soft validation warning. I do not know if you see this in the context of a new combination page or not. But this is soft validation. This is still a legal movement. It would be a suggestion that genera should be marked as synonyms.

Sure, I was referring to fire a soft validation warning, while saving the new combination.
I did not know that we still have to go to the taxon and change the parent according to the newly created combination. It does not seem very practical to me.. two steps for the new combination...
Anyway, I just tried changing the parent according to the newly created combination, but the taxon was not flagged with a soft validation warning either.

I just tried moving type species from the genus.  Those are not pop ups, those do not prevent changes, just warning on the right side of the web page.

There are some modifications that I would suggest doing. We can continue discussing this issue personally next week.

Believe this is resolved.  Re-open with specifics if not.


1.0.0-alpha.1

tea shebangs are pretty dope now:
https://github.com/teaxyz/cli/blob/a2d2b44edc800134c15745f772860b6b6ec71484/scripts/publish-release.sh


changes required for viva

We may choose to break this out into discrete commits, but I wanted
to submit all the changes we made during the install so that we can see
all what changed and open discussions.

sensu changes were based on the existing sensu fixes PR as well as forcing the use of embedded ruby ( sudo calls in checks would invalidate tits use ).


change regex for {{Routemap}}

not tested, might work or it might not. should fix #18

It should match every unnamed parameter since each of them should work identically to the map(n) parameters, although most maps use |map2= on enwiki.

Done with fcbc51c.


Support dat shortnames via TLS?

The current DNS shortnames have no authentication, so they aren't usable in production.  To be comfortable using shortnames, we need a decentralized method of assigning dat hashes to shortnames that has authentication.
I'd guess that TLS is the best way of doing this, even though it's not ideal, since it's already out there, decentralized and authenticated.  The path looked up could be:
https://hostless.website/.well-known/dat-url
A TLS result would have to take precedence over a DNS TXT result, otherwise we haven't improved the security of shortnames.
Thanks!

This may be a smart decision. It'll be a while before we can add authentication to the dat protocol.

been a while since ive looked at the spec but would this technically be WebFinger?

@maxogden it is close. Webfinger uses the .well-known path-space, but that's shared by a number of specs.

Another option is to HEAD / and include a header in the response

@pfrazee ah ok. i didnt like WebFinger a few years ago cause it was XML only but was hoping maybe something better had come out
also, if we're cool inventing specs (vs using dnssec or whatever) we could do a simple stateless message based encrypted udp thing (similar to dns but using sodium)

@maxogden You should give Webfinger another look, it's all json now.
We can invent as much as we like within TLS. We need the cert-based authentication.

Another option is to HEAD / and include a header in the response

I think we'd want something that most website owners can achieve.  "Put a file here" works approximately anywhere (think e.g. GitHub Pages, Heroku), but anything involving changing HTTP configuration doesn't.

Good point
On Wed, Dec 21, 2016 at 4:32 PM, Chris Ball<EMAIL_ADDRESS>wrote:

Another option is to HEAD / and include a header in the response
I think we'd want something that most website owners can achieve. "Put a
file here" works approximately anywhere (think e.g. GitHub Pages, Heroku),
but anything involving changing HTTP configuration doesn't.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/beakerbrowser/beaker/issues/227#issuecomment-268661048,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABNhU_C9_HvHOpWJlqKQlvq7N2lWE-jtks5rKakJgaJpZM4LTatX
.

Oh, just to get back to something from earlier:

It'll be a while before we can add authentication to the dat protocol.

How would that help with forward resolution of shortnames?  I'm having trouble imagining that.  (Feel free to point me towards old design docs or whatever.)

We havent explored it yet in depth. Specifically, we'd need to authenticate a DNS mapping.
One way to do it is DNSSEC, except the crypto community doesn't love it (weak RSA keys for one, centralization of authority, other easons) and it doesn't have extensive support by TLDs. Another way would be to get certs issued by CAs which can be placed in Dats, but that's obviously going to require some lobbying.

get certs issued by CAs which can be placed in Dats

But that doesn't help you find a Dat from a shortname, right? Once you have a Dat connection open you've already solved the problem of finding out which Dat hash you're looking for, and you're authenticated by its own keypair.
That's why I was confused about how this problem could be solved by adding anything to the Dat protocol.  The shortname scheme has to exist outside of the Dat protocol to be useful and decentralized, it seems.

But that doesn't help you find a Dat from a shortname, right?

Correct, it helps us authenticate it. You do the shortname lookup => hash via DNS. Then you download the dat site, and check the certfile in the dat. If a trusted CA-chain signature authenticates ownership of the shortname, you're all set.

I've put this into a proposal: https://github.com/beakerbrowser/beaker/wiki/Authenticated-Dat-URLs-and-HTTPS-to-Dat-Discovery

I like the `.well-known/' idea. Having said that, it's not always convenient to set up an HTTPS web server, and yet one almost always has access to the DNS for custom domains. Might a blob of base64 in a text record be an alternative option?

@Jermolene My only reservation is that DNS does not have authentication, so somebody could MITM the lookup

@pfrazee ah, yes, you did point that out elsewhere I think. The .well-known/ mechanism is plenty useful enough to be getting on with.

could be an opportunity to promote DNSSEC and complimentary tech like DNSCRYPT (https://dnscrypt.org).

DNSSEC gets mixed reviews. It might be the right choice in the long run, but for now I think I'd rather use a .well-known

Done! https://github.com/beakerbrowser/beaker/pull/275


Automatically lock inactive sessions after 6 hours

Description
Changes to session management following milestone 6 feedback from TA.
Before: Sessions are always live and can always be written to.
After: Sessions are automatically locked after 6 hours of inactivity (when both collaborators are offline).
Related Issue

Type of Change

[ ] Bug fix
[ ] New feature
[x] Improvement
[ ] Documentation update

Screenshots (if applicable)

Additional Notes
Will merge after about 9pm SGT which is when the testing rooms are automatically locked.

Yep, seems like it's working, so I'll merge.


Header decryption panic during reflection

Hello @lucasepe thank you so much for creating this open source tool - I very much prefer to maintain the replication of my master password lists myself rather than using an online service, and on linux a tool like this is very necessary!
I was wondering if you had encountered the following problem: when I try to read a password file generated by the Mac OS X client v4.17, I'm getting a panic (shown below). I've tried the following things:

Checked the password (if I enter the wrong password, I get an invalid password message)
Checked the filetype (if I send in a text file, I get an error - not a pwsafe file)

I've tried checking if the file is locked or unlocked before copying the pwsafe file to my linux machine, but I couldn't tell if that was having any effect.
 If so is there a fix? If not, I'm happy to look into a solution, though I haven't dug into the pwsafe file format extensively.
$ pwsafe list
panic: reflect.Set: value of type []uint8 is not assignable to type []string

goroutine 1 [running]:
reflect.Value.assignTo(0x5d2ec0, 0xc00000e680, 0x97, 0x612832, 0xb, 0x5d2a80, 0x0, 0x5d2ec0, 0x8, 0x18)
	/usr/local/go/src/reflect/value.go:2425 +0x405
reflect.Value.Set(0x5d2a80, 0xc000156020, 0x197, 0x5d2ec0, 0xc00000e680, 0x97)
	/usr/local/go/src/reflect/value.go:1554 +0xbd
github.com/fatih/structs.(*Field).Set(0xc0002fa120, 0x5d2ec0, 0xc00000e680, 0xc00000e680, 0x0)
	/home/benjamin/Workspace/go/src/github.com/fatih/structs/field.go:83 +0x1c5
github.com/lucasepe/pwsafe.setField(0xc0002fa120, 0xc0003560f5, 0x0, 0x2c50b)
	/home/benjamin/Workspace/go/src/github.com/lucasepe/pwsafe/decrypt.go:182 +0x285
github.com/lucasepe/pwsafe.unmarshalRecord(0xc000356000, 0x2c600, 0x2c600, 0xc000109200, 0xc000326000, 0x2c600, 0x30000, 0x30000, 0x4c9713, 0x5df7a0)
	/home/benjamin/Workspace/go/src/github.com/lucasepe/pwsafe/decrypt.go:236 +0x7c
github.com/lucasepe/pwsafe.(*V3).Decrypt(0xc000156000, 0x64f8a0, 0xc000010058, 0xc00001a8d0, 0x23, 0x0, 0x0, 0xd)
	/home/benjamin/Workspace/go/src/github.com/lucasepe/pwsafe/decrypt.go:99 +0x6b2
github.com/lucasepe/pwsafe.OpenPWSafeFile(0xc000018b40, 0x20, 0xc00001a8d0, 0x23, 0x0, 0x0, 0x0, 0x0)
	/home/benjamin/Workspace/go/src/github.com/lucasepe/pwsafe/dbFile.go:19 +0xec
github.com/lucasepe/pwsafe/cmd/list.(*listAction).handler(0xc0001090b0, 0x0, 0x0)
	/home/benjamin/Workspace/go/src/github.com/lucasepe/pwsafe/cmd/list/list.go:72 +0xee
github.com/lucasepe/cli.(*Tool).Run(0xc00007a080, 0xc00013c420, 0x0)
	/home/benjamin/Workspace/go/src/github.com/lucasepe/cli/tool.go:76 +0xdb
main.main()
	/home/benjamin/Workspace/go/src/github.com/lucasepe/pwsafe/cmd/main.go:78 +0x705

Hi @bbengfort! Thank you very much!
...it never happend to me...maybe your db has some field 'type' that had never happened to me.
To decode PWSafe fields there is the helper library 'https://github.com/fatih/structs' that is, now, archived and read only.
It would be great if you could look into it.
There is 'https://github.com/lucasepe/pwsafe/blob/master/decrypt_test.go'  you could create some "dummy db" with some sort of similar content, adding a test case in order to investigate.

Have you seen this error before?
pwsafe list -file ~/tmp/test.psafe3
💀  Error parsing the unencrypted records - Error parsing record - Encountered unknown Record Field type - 22


Does SEAL support CKKS bootstrapping?

May I confirm that SEAL supports CKKS bootstrapping?

BR

No any bootstrapping yet.

No any bootstrapping yet.

Any reason why not? Isn't bootstrapping an important feature?
BR


Swarm - 2025 Proposal

This task is intended to
Proposal context
Deliverable

https://catalyst-swarm.gitbook.io/intersect-town-hall-playbook/the-proposal/intersect-town-hall-by-swarm

Acceptance Criteria

.

Estimated Duration

Cost

More resources should be added for project members outreach to Intersect WGs

Call to action in 24th October Town Hall.
The next fund focuses on Proposal creation.
November or December, have an After Town Hall on this


Initial refactor of TS tests

Opening for visibility and feedback. Already noticing some gaps in coverage so I'll be trying to fix those as I work through these.
Ref #1431

Coverage remained the same at 97.173% when pulling eecf85b75d499e04f93067264b5064aa60f91c8f on willsoto:refactor/typings into 6dd5af9e8f05a6001f9e75f79560b0c94a8df397 on Vincit:new-typings.

There's already an examples folder. can we move these new examples into examples/ts?

@willsoto The idea here seems to be to copy the examples from the documentation? They are in no way comprehensive, but I guess that's a good place to start. I'd rather have real unit tests like where.ts that tests all the possible ways you can call where/orWhere/andWhere/etc..

There's already an examples folder. can we move these new examples into examples/ts?

I see purpose of the tests as different from what is happening in the examples folders. The examples are more "end-to-end" what does it look like to work with Objection whereas the tests are just going through the many possible forms of queries, models, etc.
With that said, I took a glance at the examples folder and it looks like it could maybe be updated.

The idea here seems to be to copy the examples from the documentation? They are in no way comprehensive, but I guess that's a good place to start. I'd rather have real unit tests like where.ts that tests all the possible ways you can call where/orWhere/andWhere/etc..

That is right. And it is just a starting point. The kind of coverage you are describing is exactly where I want to go with this. I will also try and move what makes sense from the existing "tests" to the appropriate locations since we know those are battle-tested.

I haven't forgotten about this. Been busy with other things but I'll have some time to get back to this soon.

I merged new-typings with v2.0. You can point this to v2.0 branch now.

I've rebased and added tests for:

Basic Queries
Relation Queries

I am not sure how you prefer to proceed. It might be good to merge these PRs in little by little to prevent something that is 1000+ lines long. Happy to do either, but ultimately your call.
If you feel like this is good enough to merge, please go ahead and do so and I'll make follow-up PRs.
PS: I am not sure why tests are failing only on Node 12. I can take a look at fixing unless you already have a fix in mind?

@koskimas pinging to get your thoughts on my previous comment

We can merge this as soon as the tests pass

@koskimas looks like tests are passing now 👍


Document accepting Canvas in Tugboat

Firefox recently introduced some protection against canvas fingerprinting. This restricts the use of HTML5 canvas for privacy reasons.
If you update to a modern version of Firefox, you'll need to accept the usage of Canvas in Tugboat (similar to allowing access to the microphone).
The JS shell is the component using canvas under the hood.
Without accepting Canvas, log outputs will appear to be censored.
Add something to the docs around this - maybe in Troubleshooting?

+1 to Troubleshooting

Looks like this was introduced in Firefox 58
https://www.ghacks.net/2017/10/28/firefox-58-warns-you-if-sites-use-canvas-image-data/

I dug into this more, and found that this behavior is caused by enabling an advanced Firefox feature to resist browser fingerprinting. This is disabled by default, and can only be enabled via about:config or by using a privacy extension that enables it. It also shows up in "How to make Firefox better protect your privacy" articles.
I think this is worth keeping in mind as "something we've seen", but not worth noting explicitly.

Thanks, Ben! So for now, I won't add this to the docs, unless it's something we see a lot of support inquiries around.


Fix test where CHECK is used without a colon.

@swift-ci smoke test

LGTM, assuming it works. :)  As noticed on #26077.

@swift-ci Please smoke test

I haven't dropped this John. I just keep getting side-tracked. Its on my queue.

@swift-ci smoke test and merge

@swift-ci smoke test and merge

@swift-ci smoke test and merge

@swift-ci smoke test and merge

@swift-ci smoke test and merge


Fixed onImport only being triggered once

I thought, that postcss would load the plugin multiple times, but it turned out, that if I delete the handler, then it will only run once. Fixed it. (gonna need this for the new watch feature for rollup-plugin-postcss)

Hi! Any opinion on this?

Hello?

Merged. Thanks.


Remove this commented out code.

Why this issue?
https://sonarcloud.io/project/issues?resolved=false&id=asyncapi_EDAVisualiser&open=AYdwcYkeZxfSDDTOFuLO&tab=why
Where's the issue?
https://sonarcloud.io/project/issues?resolved=false&id=asyncapi_EDAVisualiser&open=AYdwcYkeZxfSDDTOFuLO&tab=code

Hey @jonaslagoni !
Can I pick this one up?

Yep @syedzubeen 👍


Update Advanced Types.md

Minor change to heading level of "Using type predicates" from #### to ###, so that it becomes consistent with the other headings.

Agree - thanks 👍🏻

Agree - thanks 👍🏻

That's not your fault

That's not your fault


Update fabric.mod.json

I noticed that DungeonZ can't run in 1.20.1 because the minecraft version in fabric.mod.json is 1.20 instead of >=1.20.So I did it for 1.20.1 compatibility.

This was first intentionally but mojangs decision is understandable


The first circle is always active

Hi, first of all, great work.
Is there any way to "deactivate" the first circle?, when I set the setCurrentItem in the adapter, the circle on that position is well activated but also the first one.
Regards.

I had the same problem when updated from v1.13 to v1.14. With a bit of search in the source code, I saw that CircleIndicator now implements OnPageChangeListener.
This solution worked for me:
mPager.setAdapter(adapter);
mIndicator.setViewPager(mPager);
mPager.addOnPageChangeListener(mIndicator);

I think the above behaviour should be reflected in the sample app.

Thanks @eeVoskos, sadly that's not working for me, my code look like this
mPager = (ViewPager) findViewById(R.id.pager);
CircleIndicator defaultIndicator = (CircleIndicator) findViewById(R.id.indicator_default);
mPagerAdapter = new ScreenSlidePagerAdapter(getSupportFragmentManager());
mPager.setAdapter(mPagerAdapter);
mPager.setCurrentItem(position);
defaultIndicator.setViewPager(mPager);
mPager.addOnPageChangeListener(defaultIndicator);

But doesn't matter which position the ViewPager starts, the first indicator is always active, I'm doing something wrong?

nvm, just switching this two lines and now it's working like a charm
mPager.setCurrentItem(position);
defaultIndicator.setViewPager(mPager);

Try calling mPager.setCurrentItem(position) last, after initializing the ViewPager and the CircleIndicator:
mPager = (ViewPager) findViewById(R.id.pager);
CircleIndicator defaultIndicator = (CircleIndicator) findViewById(R.id.indicator_default);
mPagerAdapter = new ScreenSlidePagerAdapter(getSupportFragmentManager());
mPager.setAdapter(mPagerAdapter);
defaultIndicator.setViewPager(mPager);
mPager.addOnPageChangeListener(defaultIndicator);
mPager.setCurrentItem(position);

@eeVoskos is right.


encrypting secrets stored in the .vscode/settings.json file

I'd love to have my secrets, that are currently stored unencrypted in the .vscode/settings.json to be persisted in filesystem encrypted, but decrypted in runtime using sops.

Do you have any idea how to achieve that with this extension? Since the VSCode works directly with the file system, I have no easy way how to decrypt the file in runtime only for the VSCode, not for FS.

honestly? no idea, I'm just looking for the solution, where I can safely share the .vscode/settings.json in the git repo, while preventing secrets to be held in plaintext.

I'd recommend committing it as .vscode/settings.enc.json. Ignore the file .vscode/settings.json in git. And add git "post pull" (or similar) hook that decrypts the file using sops command.


possible false positive mxparser-1.2.1.jar when using Java library Xstream

A dependency-check of our project reports a high vulnerability when using mxparser-1.2.1..jar with a version of Xstream before 1.4.16. But we are already using Xstream 1.4.17.
This is a sample of our maven dependency tree:

com.thoughtworks.xstream : xstream:jar:1.4.17:compile

io.github.x-stream : mxparser:jar:1.2.1:compile

Could this be a false positive, because the groupId of mxparser contains "x-stream"?

This issue is already solved: https://github.com/jeremylong/DependencyCheck/issues/3230


Linear Regression

#10
I've added the required changes. Let me know, if there's any issue.

@amansharma2910 Sure. I'll do the required changes asap.

@amansharma2910 I've done the changes you requested. Please check and let me know if there's an issue. Also, I've added some content from my own article on medium (I've added it as reference too), I hope that's not a problem.


Issue #SB-5591 feat: CircleCI Config changes for Web Build

[ ] Have you followed Contribution Guidelines

Hello @lakhanmandloi, This is a auto-generated response.  Click the URL for review pull request - http://sunbird-docs-qa.s3-website.ap-south-1.amazonaws.com/pr-web/32.

Hello @lakhanmandloi, This is a auto-generated response.  Click the URL for review pull request - http:32.www-qa.sunbird.org .

Hello @lakhanmandloi, This is a auto-generated response.  Click the URL for review pull request - http://32.www-qa.sunbird.org .


Permanent chat effects, planting seeds in filled plant pots and watering them in inventory

Permanent chat effects such as using white:shake:, glow1: instead of typing it over and over "white:shake:" it does it automatically for you as you type in anything in the chat bar for public chat, not using the autochat, but typing any message in the public chat and it uses the chat effects without typing "glow1:shake:" for example over and over. I know it works for autochat, but I want to type multiple different messages using the chat effects without adding "green:" over and over again.
When planting a seed in a filled plant pot, when we looked in our inventory let it say maple seedling over the pot instead of hovering over the item in your inventory with the mouse, and let it say (w) for water in the inventory when you water it and then turn it into a sapling.  You know how jewelry has the number in the inventory or when wearing it? Instead of a number, you can show in your inventory when a seed has been planted into a filled plant pot (s), then watered(w).
Thank you.

One suggestion per issue please

You can accomplish the last two requests by using the inventory tagging plugin.

Also #1 is faking too much input

Yeah, looks like inventory tagging is more than enough for this. And rest is faking user input


Can the stream support setting up an avatar?

Now the user can set an avatar at zulip,but stream isn't support.
I think it's better if suppoted this feature.

@xiaomingplus can you explain more clearly what you have in mind, perhaps with a screenshot?

@timabbott Sorry about that,I mean that I want to custom an stream avatar.just like Messager group avatar:

:)

OK, makes sense.  I think we're unlikely to support that in the near future (a photo takes a lot more space, so it has significant impact on how many streams can be shown), but you can customize the color used for a stream, which can work pretty well for reminding you which stream something is.


Feature/expander #41

Changes:

Hooked up the default expanded state of the groups
Added streaming changes to the test server to prove the group doesn't open and close when the state changes.
Updated the attribute name to use the metadata label
Filter anything with the tag widget:icon rather than the name icon
Generally updated the group/attribute container/led widget so it looks right in the attribute details panel.
Fixed snapshot tests so they don't contain all the theming variables (only for the snapshots in this PR, these will be addressed as we go forward).
Moved the LED widget into the malcolmWidgets folder

Still to do:

Add description as a tooltip

To test:

Run npm start and navigate to http://localhost:3000/gui/?block=PANDA:SEQ1 and observe the led attributes in the outputs section.

connect to #41

I don't really understand this comment, isn't this what AttributeSelector does? (but it only has the LED in it at the moment)

Codecov Report

Merging #73 into version1 will decrease coverage by 0.79%.
The diff coverage is 52.94%.

@@             Coverage Diff             @@
##           version1      #73     +/-   ##
===========================================
- Coverage     94.05%   93.26%   -0.8%
===========================================
  Files            21       22      +1
  Lines           202      208      +6
  Branches         23       26      +3
===========================================
+ Hits            190      194      +4
  Misses           12       12
- Partials          0        2      +2

Impacted Files
Coverage Δ

...ets/attributeDetails/attributeDetails.component.js
100% <ø> (ø)
:arrow_up:

...lmWidgets/groupExpander/groupExpander.component.js
100% <ø> (+16.66%)
:arrow_up:

src/malcolmWidgets/led/widgetLED.component.js
100% <100%> (ø)

...s/attributeSelector/attributeSelector.component.js
37.5% <37.5%> (ø)

src/blockDetails/blockDetails.component.js
87.5% <57.14%> (ø)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 80822af...47fbe89. Read the comment docs.

@btester271828 can you take a look at the PR once the latest build finishes please.


[doc][trans] submit translation for Yi quick start - choose your path and Yi quick start - pip

This PR resolves #320

fix translation according to review suggestions

fix translation according to suggestion by @lljzhgxd

@202030481266  We would like to invite you to please include the prompt used for translation in your PR description, specifically mentioning that you are using the Yi-34B-Chat model. This would greatly assist us in better understanding the context and providing the necessary support.
We appreciate your cooperation and participation!   🥳

Ok, I use Yi-chat-34B model to assist me with the translation tasks. Here is my prompt:

continue talking with :

Ok, I use Yi-chat-34B model to assist me with the translation tasks. Here is my prompt:

continue talking with :

Basically the prompt is:
你是一名01ai的高级文档工程师，你非常擅长Markdown语言，并且擅长英文和中文。下面是一段Markdown笔记，你需要将里面的英文翻译为中文同时保持笔记的格式正确（注意链接不需要翻译！）。

the content you need to translate

请翻译：

@202030481266  It seems that your translation is completed. Congratulations! 🥳
If the translation is completed, you can resolve all the conversations in both the comments section and the PR (Pull Request) section.

@202030481266 I shared some views in the PR section. Please feel free to give feedback. Thanks! 🥳
Once the translation is completed, you can close all the discussions in both the comments section and the PR section.

I have already resolve all the conversations. @GloriaLee01

I have already modified the translation by all the conversations. @GloriaLee01


Reset feature flags when switching through logins

Fixes #2181
Fixes #2154
This PR attempts to clean up the auth flow and makes it so that when the user account is switched, we never accidentely use feature flags of a wrong server URL and also ensures we reconfigure Autocomplete so it works.
⚠ This PR has a potential to break areas depending on auth, so please take some time to test it. I've been testing it as thorough as I could though!
Test plan
The canonical test case was:

Be signed in to dotcom and have the starcoder-hybrid feature flag enable
Now switch account to an enterprise instance
Ensure that requests are made to the enterprise instance and that we do not use starcoder model strings

https://github.com/sourcegraph/cody/assets/458591/ab5a19a6-a906-42e6-8f76-ae61b500e30c

@sourcegraph/cody-vscode Friendly nudge for a PR review 🤗


"make test" is broken

Originally "make test" used docker/podman to run the build and the tests.
However, the tests now start containers as well. So that means that we start containers inside of containers. Unfortunately that broke "make test". "make container-test" still works, but requires the user to have all kind of development tools installed, which can be tricky on windows and mac os.

For docker we can run docker-in-docker, by passing in the docker socket. This actually creates containers alongside the builder container (sibling containers), but still it works for our case.
For podman the story is different. Podman can run inside of podman. However, podman cannot run inside of docker. So it is either podman-in-podman or docker-in-docker. Mixing environments is not possible (e.g. podman-in-docker). As podman is only available for Linux, building solely on podman would exclude windows and mac developers.
Also, currently there seems to be no way to install podman inside of UBI8 images. Which rules out podman-in-podman anyway.
When PR #36 is merged, we still have the problem that people running podman, cannot run make test.
One idea would be to use podman-remote, which emulates a docker socket, that we could pass in the same way as with docker.  And would not require us to install "podman" inside of the UBI image.

For docker we can run docker-in-docker, by passing in the docker socket. This actually creates containers alongside the builder container (sibling containers), but still it works for our case.
For podman the story is different. Podman can run inside of podman. However, podman cannot run inside of docker. So it is either podman-in-podman or docker-in-docker. Mixing environments is not possible (e.g. podman-in-docker). As podman is only available for Linux, building solely on podman would exclude windows and mac developers.
Also, currently there seems to be no way to install podman inside of UBI8 images. Which rules out podman-in-podman anyway.
When PR #36 is merged, we still have the problem that people running podman, cannot run make test.
One idea would be to use podman-remote, which emulates a docker socket, that we could pass in the same way as with docker.  And would not require us to install "podman" inside of the UBI image.

@ctron Hello Sir I want to contribute to this issue I'm noob into this Can you please elucidate me so that I can work on this issue

@ctron Hello Sir I want to contribute to this issue I'm noob into this Can you please elucidate me so that I can work on this issue

Thank you for your interest in the project and this issue. However, I don't think this is a good first issue to work on.

Ok Sir .Sir please don't mine for asking this query can you please suggest any good first issues or any issues I will learn about it

I am closing this one now. It still is an issue. But it doesn't seem to bother anyone too much, even myself. We can re-open if that should change.


UI Refresh

Hello there,
first I really want to thank you about the work you realize.
My 4 years old son is diabetic since 2 years and it's really helpfull to find this kind of " independant " support and aid.
You can't imagine (in fact I think you can :) how it help us during the night mostly.
I will have one question and one suggestion about nightscout.
During the night when my boy is sleeping, if the pump stop because of a hypo, when it will restart there is a message on the pump. I'm pretty sure for legal reason you can't, but do you think it could be possible to skip the message from nightscout for exemple ? Because without that, I should go in it bedroom, try to manipulate the pump whithout wake up him, skip the message and then if necessary administrate a bolus.
Now my suggestion is more about the UI of nightscout. I'm currently a UI/UX Designer based in France and working in video games. I would like to know if you will be interesting to discuss with me about your UI, and if could give you some suggestion to have something more eye catching, more esthetic ?
I'm not currently saying your work is bad, but I think with some small arrangement (my wife have some ideas) it could be really better. :)
Fell free to contact me if you are interesting.
Thanks for your attention, and thanks again for the huge work you produce.
It really change our daily!
Sorry if my english is not really good.
Yoann.

@pazaan thanks a lot to answer me quickyl.
Ok for the remote control I understand.
About my suggestions I will prepare you a pdf with some propositions next week.
Maybe we can talk about it later on Gitter.
See you !

Mocks and implementation concepts provided by @YoannBaz over Gitter:
pack01.pdf
pack01Annotation.pdf
mockup.psd.zip

My two cents, for what it's worth:

I propore to link all dots behind
them to have something less
rough, more esthetic and
modern.

I would actually prefer not to have the dots connected, makes it easy to know if all readings have been caught or if the sensor is acting sketchy. I don't want things "polished".
The other suggestions sounds okay though even though GUI-stuff comes after improved functionallity/stability fixes in my book

I think it could be interesting to
have the average of the last 24h.
What do you think about it ?

We got xDrip/Nightscout and other 3rd part stuff for these things, I never really use the uploader for anything but uploading stuff, if I want stats there's Nightscout reports, Sure if these things ain't to much of a hassle - go for it. I would so much prefer remote bolusing though :)

Hi,
Yeah, remote bolusing would be totally awasome.
D.
Dne po 13. 8. 2018 7:56 uživatel SoffMirj<EMAIL_ADDRESS>napsal:

My two cents, for what it's worth:
I propore to link all dots behind
them to have something less
rough, more esthetic and
modern.
I would actually prefer not to have the dots connected, makes it easy to
know if all readings have been caught or if the sensor is acting sketchy. I
don't want things "polished".
The other suggestions sounds okay though even though GUI-stuff comes after
improved functionallity/stability fixes in my book
I think it could be interesting to
have the average of the last 24h.
What do you think about it ?
We got xDrip/Nightscout and other 3rd part stuff for these things, I never
really use the uploader for anything but uploading stuff, if I want stats
there's Nightscout reports, Sure if these things ain't to much of a hassle

go for it. I would so much prefer remote bolusing though :)

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/pazaan/600SeriesAndroidUploader/issues/211#issuecomment-412415296,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AmcJY0Uk4RFcQd5BgjsgFktxfmXBWYlbks5uQRUAgaJpZM4Sw-zi
.

My two cents, for what it's worth:
I propore to link all dots behind
them to have something less
rough, more esthetic and
modern.

I would actually prefer not to have the dots connected, makes it easy to know if all readings have been caught or if the sensor is acting sketchy. I don't want things "polished".
The other suggestions sounds okay though even though GUI-stuff comes after improved functionallity/stability fixes in my book
I think it could be interesting to
have the average of the last 24h.
What do you think about it ?

We got xDrip/Nightscout and other 3rd part stuff for these things, I never really use the uploader for anything but uploading stuff, if I want stats there's Nightscout reports, Sure if these things ain't to much of a hassle - go for it. I would so much prefer remote bolusing though :)

@whooze This isn't an either/or scenario. It's not like "You're not getting remote bolusing because I'm working on this" ;)
Remote bolusing is a much larger issue which will require us to:
a) reverse engineer the over-the-air encryption
b) build a RileyLink-type device that can communicate directly with the pump

@YoannBaz looked at your ideas: you mention that you like to compare the current graph to the one from the day before. Have you considered using an AGP as a backdrop to the current graph?
It could be rather subtly shaded, so it doesn't detract from the current data.
You could even give a bigger weight to "same day of week" or "previous three days" if you would prefer to place some emphasis.
That way it's a bit easier to see if the current day is following a pattern, or how it relates to previous experience.


I'm missing a link in last episode's notes

Here's the current show notes for it:
https://github.com/oxidecomputer/oxide-and-friends/blob/master/2024_09_23.md
However at around the 53:50 timestamp in the YT video (https://m.youtube.com/watch?v=Y-cC5pUXjbQ), one of Nathaniel's posts about remote hardware work is mentioned. And that link isn't present in the notes. I'd love to read it; could you please add a link in the notes? :)

done; thanks

No problem. Thank you! 😊


Country Flags not loading

Describe the bug
Country flags in drivers' standings not loading.
To Reproduce
Add a card with the below config
type: custom:formulaone-card
card_type: driver_standings
sensor: sensor.formula_one_sensor_drivers
title: Driver Standings
standings:
  show_flag: true
  show_team: true

Expected behavior
Country Flags should load.
Screenshots

Desktop (please complete the following information):

not browser specific.

Smartphone (please complete the following information):

not browser specific.

Additional context
Looks like the site https://www.countries-ofthe-world.com/ is down.
May be a better way is to have the images locally, for quick loading?

Update the card. This will fix your issue


datadog-integrations-core: add missing modules and dependencies

Description of changes
This PR fixes the builds of the Datadog core integrations (part of #222932).
Datadog has switched over to pyproject, so their setuptools config is likely not getting much attention. We're patching setuptools to actually build the base and checks modules that are required for the integrations to be loaded. We should switch to pyproject in the long-term (see https://github.com/NixOS/nixpkgs/issues/222932#issuecomment-1525207268).

Things done

Built on platform(s)

[ ] x86_64-linux
[x] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Let's say I try this, how can I check it works ? where do I look aton the  dadadog dashboards ?

The quick and dirty method is to run agent check nginx. There'll be a bunch of warnings about missing checks, but none of them should mention rtloader, python, or nginx. It should end with a message saying that no valid checks were found.
The long version is...
1. Set up the services
We'll work with nginx as an example, but any of the v7-supported checks should work.
Set up the nginx and datadog-agent services:
{
  services.nginx = {
    enable = true;
    statusPage = true;
    virtualHosts = {
      "anything-other-than-localhost" = {
        locations."/" = {
          return = "200 'Hello world'";
        };
      };
    };

  services.datadog-agent = {
    enable = true;
    apiKeyFile = "...";
    # If using a different region, like EU:
    # site = "datadoghq.eu";
    checks = {
      nginx = {
        instances = [
          { nginx_status_url = "http://localhost:80/nginx_status"; }
        ];
      };
    };
  };
}

2. Run agent check nginx
You'll see a bunch of unrelated warnings, but it should eventually print out information about the nginx server.
3. Install the nginx integration on https://app.datadoghq.com
Go to the Integrations tab on the left, search for nginx, and install.
4. Check the dashboard
Go to Dashboards and open NGINX - Metrics.
Here's a quick test you can run to fill up the dashboard with data:
nix run stable#wrk -- -t12 -c400 -d1m http://<IP_ADDRESS>


When booting for the first time, the subscription may never get first heartbeat

In what appears to be a race inside of Postgres, creating a replication slot and connection immediately after a publication has been created appears to cause the initial replication heartbeat to never be received. You can see this by running:
make recreatedb
 go run cmd/pg2sink/main.go stream --sink=file --sink.file.schemas-path=/tmp/schemas --sink.file.modifications-path=/tmp/modifications --importer-poll-interval=3s --manage-publication

Several times, where eventually you'll receive the error "initial_heartbeat_failed". This can be mitigated by pausing during the creation of the publication, but it would be good to understand why this is.

Confirmed this is still an issue with revised subscription code

Having reordered the start-up/shutdown behaviour, and cleaned up the way contexts are cancelled, this no longer appears to be an issue.
Checked with ebd5d801d8858422d9af11291c0323e12c1d18f3, can no longer replicate.


feat: Webhook Notification

Added
Paddle\SDK\Notifications\Notification
Subtypes added in https://github.com/PaddleHQ/paddle-php-sdk/pull/73
Usage
use Paddle\SDK\Notifications\Notification;

$notification = Notification::fromRequest($request);
$id = $notification->id;
$event = $notification->event;
$eventId = $event->eventId;
$eventType = $event->eventType;
$occurredAt = $event->occurredAt;

if ($event instanceof TransactionUpdated) {
    $transactionId = $event->transaction->id;
}

Superseded by https://github.com/PaddleHQ/paddle-php-sdk/pull/74


feat: port Algebra.Homology.Homology

todo:

[ ] simpNF linter on imageToKernel_as_boundariesToCycles
[ ] simpNF linter on cyclesMap_arrow_assoc and cyclesMap_arrow
The attribute is @[reassoc (attr := simp), elementwise (attr := simp)], so I couldn't use "-- @[simp] -- Porting note: simp can prove this" from the wiki

Thanks @int-y1 & @Parcly-Taxel ! Increasing the priority of the simp lemmas has fixed the simpNF linter issue.

bors r+


Email reset password

Description
Users can now send themselves a password reset url. The url has a JWT that contains a nonce associated with the user. When the user follows the link and sends the password, the nonce is removed from the database, rendering the link useless for repeated endpoint access.
Fixes # (issue)
Type of change
Please delete options that are not relevant.

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[x] This change requires a documentation update

How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration

[ ] Test A
[ ] Test B

Checklist:

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[ ] My code has been reviewed by at least one peer
[x] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes

I cannot npm install once I get into emailResetPassword branch - npm install does work on master branch


MAINT: Use different lighthouse action

This uses a dedicated GitHub Action for lighthouse to analyze and upload reports for our HTML artifacts automatically. It simplifies the configuration of our pages, and also provides reports that are a bit more understandable than our current setup.
It removes the pa11y as well - my reasoning for this is the following:

We already have auditing with Lighthouse, and it's not clear what pa11y provides on top of lighthouse
There is a lot of custom configuration for running the pa11y server. I worry that this is not easy to maintain or inspect, and given that we have an alternative with much less configuration, I think that's a better option.

Question: remove pa11y?
There's a lot of other scripting stuff that we could remove if we want to stop relying on pa11y for our accessibility. I think there are pros and cons, but wanted to show off this alternative as a start. What do others think?
closes #546

It seems a lot of accessibility stuff was introduced by @bollwyvl here: https://github.com/pydata/pydata-sphinx-theme/pull/294.
Nick, WDYT about the py11y removal proposed by @choldgraf here?

Btw, @choldgraf, it seems there is some branch conflict.

Yes I would love to hear @bollwyvl's thoughts re: maintainability+complexity vs. doing a reasonable job of addressing accessibility issues.

i think it's a regression in development and testing robustness if there is no local capability for a developer to identify (and therefore fix) the ~30% of WCAG issues that pa11y's rules can actually say anything about. But then i haven't been doing much beyond getting that set up, as the roadmap hasn't been changed since we added it. The fact that pa11y finds those issues, and lighthouse doesn't, already suggests that it covers more than lighthouse.
To that end, I don't even know what claims lighthouse (or the wrapper action) are making, as it's more of a general-purpose tool, and was useful for putting number to things like asset pre-loading that helped us improve the perceptual speed of theme with actual metrics, and helping keep it there (provided we haven't just been bumping the thresholds down). The fact that it handles some accessibility concerns seems almost incidental, aside from google's goal of helping you convert more eyeballs (or screen readers) so they can sell more ads and personal data.
Longer term, I'd prefer that concerns like accessbility aren't delegated to a secondary test suite: i'm also looking into working accessibility testing into more real browser environments, with e.g. robotframework/selenium, but don't yet have anything concrete to demonstrate these. The advantage there is one could hijack things like Capture Page Screenshot, which get run in happy day and error situations, which would help on highly dynamic tools... which some documentation sites get closer to with e.g. thebe, jupyterlite, etc.
But same deal applies: if a tool can't be run locally and in  CI worker, I feel like it's bad for open source.

Just a note that you can generate lighthouse reports directly from Google Chrome. So at least that's one option for local running, but as you say the things that lighthouse vs. pa11y test for are slightly different.
I agree with all of your points, I just worry that right now our usage of pa11y is not super actionable. As a first step, I've added some more documentation of what the pa11y error messages mean in the contributing docs: https://pydata-sphinx-theme.readthedocs.io/en/latest/contribute/topics.html#errors-in-ci-cd-and-what-to-do
Maybe this will make it easier for people to understand what the pa11y test does and how to interpret the results?

I was investigating re-enabling the a11y.py check here, but realized that it is using yarn in that script, and we don't use yarn anymore in this package. So that script is broken now, I think.
I do not understand the script well enough to debug it, just highlighting it here.

I think that the accessibility audits with pa11y was just flaky, not broken. I also opened up a new PR to reduce the scope to just lighthouse, and not touching pa11y. closing this one!


feat(GatewayDispatchEvents): add AuditLogEntryCreate

Please describe the changes this PR makes and why it should be merged:
If applicable, please reference Discord API Docs PRs or commits that influenced this PR:

discord/discord-api-docs#5849

You should also add the GUILD_BANS renamed intent in this PR


doc: update developer guide about retriggering CI jobs

Describe what this PR does
Add instructions about how and when to retrigger the CI jobs
Signed-off-by: Prasanna Kumar Kalever<EMAIL_ADDRESS>

This should have been detected as doc-change-only by the CI jobs, not sure why that is not happening :disappointed:

This should have been detected as doc-change-only by the CI jobs, not sure why that is not happening disappointed

#1617 might fix this

Looks good. I wonder if markdown-lint accepts the current state.

done now :-)

/test commitlint

Still an error:
./docs/development-guide.md:272: MD007 Unordered list indentation

A detailed description of the rules is available at https://github.com/markdownlint/markdownlint/blob/master/docs/RULES.md

/retest ci/centos/mini-e2e-helm/k8s-1.18.9

/retest ci/centos/mini-e2e-helm/k8s-1.18.9

Just checking if the doc-only-change detection (still) works


Inconsistency in Orso.empty() - first column must be Qz

Currently Orso.empty() creates a header object with empty.columns == [Column.empty()] == [Column(name=None)]
This is inconsistent with our agreed-upon specification, which requires that any existing columns up to length 4 must be named in this order: ["Qz", "R", "sR", "sQz"], and any columns after that can have any name.
Mitigations we can use include:

modify Column.empty() (or Orso.empty()?) to output columns == None instead of [Column(name=None)]
modify Column.empty() to output something like [Column(name="Qz")] or [Column(name="Qz"), Column(name="R")]
drop the rule about column order from the specification
not enforce the rule about column order in the schema

What do people think we should do?

I'd like 3 and 4 to be non-starters. In real life would an empty file (or one without data having been filled in) ever be useful to save and recover?
If the answer is yes, and since I'd like to keep our existing specification, and things have to make sense, then would it be best to go with 1?

I'm ok with 1 - it's the solution I used in the original pull request.  But I don't know how Orso.empty() is intended to be used - if users are going to get one of these and fill it out, then putting in the minimal column set (Qz, R) might be helpful.
If it's only ever going to be used by other programs as a starting point, then it doesn't really matter and we can just pick one and move on.


migrated to dexter to stop apps from crashing when requesting permi…

…ssions from appcompat-based activities

updated gradle
updated build tools
updated support libs
updated target and compile sdks
updated glide lib
updated ucrop lib

Hi, I created an issue and decided to fix it myself as I needed fixed lib.
I currently resorted to using my own fork, but it would be cool if you merge my pr.

@MrBIMC I was not able to check the pull request and updated the library with the changes.
I think I have incorporated all the changes that were required. Pleases visit the releases page.
Also check the Readme file for updated instructions.


ARROW-1565: [C++] Implement TopK/BottomK

Heap-based topk can compute these indices in O(n log k) time

Thanks @lidavidm, @edponce  for the feedback.  I reduced the code, refactoring it where it was required.

You may want to rebase to fix some of the builds.
I think you've mentioned benchmarks, are there results to show/is there benchmark code?

  PartitionNthIndices uses std::nth_element which uses internally a special algorithm called introselect,  this is a  is a selection algorithm that is a hybrid of quickselect and heap selection.
This PR started  as a way to speed top-k queries, https://lemire.me/blog/2017/06/21/top-speed-for-top-k-queries/ using FastPriorityQueue-KWillets-replaceTop approach.  However C++ implementation for std::nth_element  has the best of quickselect and heap selection as an hybrid solution.
In the next  benchmarks I will show the peformance when the algorithm needs to be stable to enable keep=first and keep=last. I will explore ways to implement a stable binary heap to do that and compare with  {std::nth_element + std::stable_sort}.
--

Should SelectK instead be an aggregate function?

I am not sure, I am new with arrow. And this function looks like pretty similar to the APIs of SortIndices and PartitionNthIndices So I think it is in the right place.
Looking forward to your thoughts. cc @lidavidm

Thanks for the feedback @lidavidm

Thanks for the updates.
We may actually want this to be implemented multiple ways: as both a hash aggregate kernel and a vector kernel. We'll want the hash aggregate kernel to match Pandas, where nlargest is part of a group by operation. Of course, we can split out the implementation of that for later, but I think it's worth considering how we can share the implementations as much as possible. (It may not be that you can share much, since the hash aggregate kernel has to work in a streaming fashion which this does not do.)
We'll still want a vector kernel implementation (the one here) as essentially a pipeline sink, since this implements an ... ORDER BY ... LIMIT operation. (We'll need to implement an ExecNode for that - that can be a separate follow up JIRA, it should be straightforward.) Note if you do want to match the API of SortIndices this should return indices, not values.

Update: I changed these APIs to return only indices like SortIndices.

Also, note there are some CI failures - mostly just different compilers looking for different things.
It might be good to compare the kernel here with SortIndices (since you could emulate a top-K by calling SortIndices, slicing the output, then calling Take) - I wonder how much of a speedup this achieves.

Here the benchmarks results for  topk with sortingIndices and topk with NonStableHeap, values are int64 scalars with length from 1 << 20 to 1 << 23 and with 100 of null_proportion , k is 1/8*N:
TopK_SortingIndices
-----------------------------------------------------------------------------------------------
Benchmark                                     Time             CPU   Iterations UserCounters...
-----------------------------------------------------------------------------------------------
TopKInt64/32768/10000/min_time:1.000     199633 ns       199601 ns         7010 bytes_per_second=156.563M/s items_per_second=20.521M/s null_percent=0.01 size=32.768k
TopKInt64/32768/100/min_time:1.000       205520 ns       205486 ns         6734 bytes_per_second=152.078M/s items_per_second=19.9332M/s null_percent=1 size=32.768k
TopKInt64/32768/10/min_time:1.000        196022 ns       195979 ns         7124 bytes_per_second=159.456M/s items_per_second=20.9002M/s null_percent=10 size=32.768k
TopKInt64/32768/2/min_time:1.000         124550 ns       124531 ns        11204 bytes_per_second=250.941M/s items_per_second=32.8914M/s null_percent=50 size=32.768k
TopKInt64/32768/1/min_time:1.000           9395 ns         9394 ns       149397 bytes_per_second=3.24871G/s items_per_second=436.034M/s null_percent=100 size=32.768k
TopKInt64/32768/0/min_time:1.000         199116 ns       199086 ns         7016 bytes_per_second=156.968M/s items_per_second=20.5741M/s null_percent=0 size=32.768k
TopKInt64/1048576/100/min_time:1.000   10200499 ns     10199057 ns          137 bytes_per_second=98.0483M/s items_per_second=12.8514M/s null_percent=1 size=1048.58k
TopKInt64/8388608/100/min_time:1.000  105033049 ns    105007534 ns           13 bytes_per_second=76.185M/s items_per_second=9.98572M/s null_percent=1 size=8.38861M

TopK_NonStableHeap
-----------------------------------------------------------------------------------------------
Benchmark                                     Time             CPU   Iterations UserCounters...
  However  the implementation of a stable version of it using a StableHeap is not as good as TopK_NonStableHeap, as you can  see  below:
TopK_StableHeap
-----------------------------------------------------------------------------------------------
Benchmark                                     Time             CPU   Iterations UserCounters...
-----------------------------------------------------------------------------------------------
TopKInt64/32768/10000/min_time:1.000     213637 ns       213609 ns         6596 bytes_per_second=146.295M/s items_per_second=19.1752M/s null_percent=0.01 size=32.768k
TopKInt64/32768/100/min_time:1.000       222127 ns       222091 ns         6332 bytes_per_second=140.708M/s items_per_second=18.4429M/s null_percent=1 size=32.768k
TopKInt64/32768/10/min_time:1.000        216600 ns       216562 ns         6353 bytes_per_second=144.3M/s items_per_second=18.9137M/s null_percent=10 size=32.768k
TopKInt64/32768/2/min_time:1.000         186647 ns       186613 ns         7585 bytes_per_second=167.459M/s items_per_second=21.9492M/s null_percent=50 size=32.768k
TopKInt64/32768/1/min_time:1.000           8101 ns         8100 ns       173012 bytes_per_second=3.7677G/s items_per_second=505.692M/s null_percent=100 size=32.768k
TopKInt64/32768/0/min_time:1.000         213979 ns       213950 ns         6595 bytes_per_second=146.062M/s items_per_second=19.1447M/s null_percent=0 size=32.768k
TopKInt64/1048576/100/min_time:1.000   11343912 ns     11341499 ns          122 bytes_per_second=88.1718M/s items_per_second=11.5568M/s null_percent=1 size=1048.58k
TopKInt64/8388608/100/min_time:1.000  123205686 ns    123179459 ns           12 bytes_per_second=64.9459M/s items_per_second=8.51259M/s null_percent=1 size=8.38861M

This implementation for stable select_k with a stable heap, although it is valid, is still simple and maybe the best choise here is a sort-based algorithm.  IMO, implementation of stable algorithms need more exploration, and it could be implemented in a separate follow up JIRA issue adding an optional parameter to choose between SortType{kStable, kNonStable} implementation.
Besides these updates, instead of a single SortOrder for RecordBatch and Table  a new kernel called Result select_k(datum, options) was created  where options.sort_keys type is std::vector<SortKey<string, order>>.
Looking forward to your thoughts. cc @lidavidm

Some conclusions: Both implementations (partition_nth:intro_select and partition_nth:heap) show similar numbers.

Interesting. Did you double-check that no mistake was made when running the benchmarks (i.e. are you really comparing the two different algorithms)?

IMO, implementation of stable algorithms need more exploration, and it could be implemented in a separate follow up JIRA issue

Hmm, why not, but sort_indices and partition_nth_indices are guaranteed to be stable, so it would be better if topK/bottomK wasn't inconsistent.

Thanks for the benchmarks. It looks like the stable heap is about the same or perhaps slightly slower than just sorting and slicing, which is unfortunate.

Hmm, why not, but sort_indices and partition_nth_indices are guaranteed to be stable, so it would be better if topK/bottomK wasn't inconsistent.

Since the unstable version is quite a bit faster so far here, maybe we should expose a select_k_unstable? (Was the reason why we don't have an unstable sort because it's not useful and/or wasn't meaningfully faster?)

Le 07/09/2021 à 15:46, David Li a écrit :

Hmm, why not, but sort_indices and partition_nth_indices are
guaranteed to be stable, so it would be better if topK/bottomK
wasn't inconsistent.

Since the unstable version is quite a bit faster so far here, maybe we
should expose a |select_k_unstable|?

If "quite a bit" means 2x or 3x rather than 20%, then that sounds good
to me indeed.

(Was the reason why we don't have
an unstable sort because it's not useful and/or wasn't meaningfully faster?)

I'm not sure we have actually tried to benchmark an unstable sort.  But
being stable is usually a desirable guarantee when the sort columns
don't span all columns.  Of course, that depends on the use case :-)

Another thought: isn't one attraction of TopK to have a streaming algorithm with O(k) memory consumption? Making a full sort requires to materialize the entire input, hence O(n) memory consumption.

Another thought: isn't one attraction of TopK to have a streaming algorithm with O(k) memory consumption? Making a full sort requires to materialize the entire input, hence O(n) memory consumption.

That is a fair point. However, this kernel as-is is not a streaming implementation and we would have to implement it as an actual aggregate kernel to get that behavior.

Another thought: isn't one attraction of TopK to have a streaming algorithm with O(k) memory consumption? Making a full sort requires to materialize the entire input, hence O(n) memory consumption.

That is a fair point. However, this kernel as-is is not a streaming implementation and we would have to implement it as an actual aggregate kernel to get that behavior.

I have a question related to that, the streaming implementation would be using ExecNodes right?

Some conclusions: Both implementations (partition_nth:intro_select and partition_nth:heap) show similar numbers.

Interesting. Did you double-check that no mistake was made when running the benchmarks (i.e. are you really comparing the two different algorithms)?

My bad, You were right  @pitrou  the numbers are not correct.   Something happenned when I ran this bench both at the same time.  I ran again PartitionNthToIndices with different strategies (nth_element vs heap_based) separetly and I got these numbers:
PartitionNthToIndices_nth_element
--------------------------------------------------------------------------------------------------
Benchmark                                        Time             CPU   Iterations UserCounters...

--------------------------------------------------------------------------------------------------
BottomKInt64/32768/10000/min_time:1.000      55314 ns        55303 ns        25080 bytes_per_second=565.064M/s items_per_second=74.0641M/s null_percent=0.01 size=32.768k
BottomKInt64/32768/100/min_time:1.000        57577 ns        57568 ns        23965 bytes_per_second=542.835M/s items_per_second=71.1505M/s null_percent=1 size=32.768k
BottomKInt64/32768/10/min_time:1.000         59858 ns        59847 ns        22977 bytes_per_second=522.168M/s items_per_second=68.4416M/s null_percent=10 size=32.768k
BottomKInt64/32768/2/min_time:1.000          54008 ns        53995 ns        24750 bytes_per_second=578.753M/s items_per_second=75.8583M/s null_percent=50 size=32.768k
BottomKInt64/32768/1/min_time:1.000           5929 ns         5927 ns       235385 bytes_per_second=5.14856G/s items_per_second=691.028M/s null_percent=100 size=32.768k
BottomKInt64/32768/0/min_time:1.000          55751 ns        55741 ns        24636 bytes_per_second=560.626M/s items_per_second=73.4823M/s null_percent=0 size=32.768k
BottomKInt64/1048576/100/min_time:1.000    4542982 ns      4541548 ns          323 bytes_per_second=220.189M/s items_per_second=28.8606M/s null_percent=1 size=1048.58k
BottomKInt64/8388608/100/min_time:1.000   53349325 ns     53333611 ns           26 bytes_per_second=149.999M/s items_per_second=19.6607M/s null_percent=1 size=8.38861M

IMO, implementation of stable algorithms need more exploration, and it could be implemented in a separate follow up JIRA issue

Hmm, why not, but sort_indices and partition_nth_indices are guaranteed to be stable, so it would be better if topK/bottomK wasn't inconsistent.

Note that both algorithms uses NonStablePartitioner to separete Nulls and both are unstable.
Clearly, PartitionNthToIndices_nth_element is faster (5-6x) but PartitionNthToIndices kernel is not enough to implement TopK/BottomK because the first K elements needs to be sorted. Besides in order to Implement a stable version most probably we will need to use   StablePartitioner + std::stable_partition + std::stable_sort.  However  the attraction of  the heap-based implementation  is to have a streaming algorithm.
IMO this PR should first  expose a select_k_unstable and look in a follow up PR the best implementation for select_k_stable.
Looking forward to your thoughts. cc @lidavidm, @pitrou

Note that both algorithms uses NonStablePartitioner to separete Nulls and both are unstable.

Oh, you're right! I had forgotten that partition_nth_indices was unstable, unlike sort_indices.

Clearly, PartitionNthToIndices_nth_element is faster (5-6x) but PartitionNthToIndices kernel is not enough to implement TopK/BottomK because the first K elements needs to be sorted.

But if K is small, sorting them should be cheap, right? I'm not sure what the cutoff would be... (sqrt(N) perhaps?)

IMO this PR should first expose a select_k_unstable and look in a follow up PR the best implementation for select_k_stable

Agreed!

Another thought: isn't one attraction of TopK to have a streaming algorithm with O(k) memory consumption? Making a full sort requires to materialize the entire input, hence O(n) memory consumption.

That is a fair point. However, this kernel as-is is not a streaming implementation and we would have to implement it as an actual aggregate kernel to get that behavior.

I have a question related to that, the streaming implementation would be using ExecNodes right?

It's unclear to me. The API for scalar aggregate functions expects you to handle parallelism and streaming, but doesn't handle larger-than-memory state. I would say it should just be a scalar aggregate function if we were to implement it right now, though, since we haven't really started thinking about larger-than-memory state.

I updated this PR  exposing  only select_k_unstable using a optional parameter to choose strategy kind (Stable|NonStable).  Moreover python binding were added and their respectives tests. As we agreed In a follow up PR  a implementation for select_k_stable will be added.    cc @pitrou @lidavidm

Thanks @lidavidm I updated this PR addressing last feedback comments.  cross-fingers, hope this time will be OK for merging.

Thanks again for the comments @lidavidm. Besides the minor latest changes addressing the feedback I filed follow-up JIRA issues:
[C++][Compute] Improve top_k/bottom_k Selecters via CRTP
https://issues.apache.org/jira/browse/ARROW-13971
[C++][Compute]Implement SelectKStable
https://issues.apache.org/jira/browse/ARROW-13969
[C++][Compute]Implement streaming  version for SelectK
https://issues.apache.org/jira/browse/ARROW-13970
The first one is an improvement of the selecter and template specialization for specific type.  The last two are tasks to implement a streaming version of it and SelectKStable.
Apart from that, I think it is ready for final review / merging, let me know what you think.

@edponce or @cyb70289 any other comments?

@lidavidm, I don't have comments. Thanks @aocsa !

Thanks @aocsa we can tackle some of these in followups.

Sorry Eduardo, I had thought that comment was your review. Thanks for filling ARROW-13974, we can fix up things there.


Grapher deploy can overwrite manually edited variables metadata

Problem
Datasets pushed via ETL should be non-editable. Otherwise users might change metadata manually and ETL could then overwrite it back on next automatic (or manual) deploy.
Dataset metadata from non-owid namespace can't be edited, but you can still edit its variables that are saved to display column. An example

You can edit everything for datasets under owid namespace. Only Key Indicators are currently there.
Proposal 1 - make everything non-editable
Everything would need to be done in ETL. This means creating a PR, changing YAML metadata file and merging (which triggers automatic deploy) or pushing to master directly. Would it be annoying for authors? (I'll be working with @bastianherre to see how much pain can he endure).
Proposal 2 - don't update display if it has been changed manually
We could detect if display has been manually updated and don't update it in ETL deploy. However, this might bite us when e.g. we release new version of a dataset and remap everything to new variables (thereby losing the old display).
This is related to the idea of separating ETL from admin and overriding immutable ETL metadata by metadata from admin (cc @danyx23).

@Marigold to create a new grapher ticket to prevent admin update of display for variables from the ETL.

All fields in admin have been made non-editable.


Uncaught Error: Could not call remote function 'emit'. Check that the function signature is correct. Underlying error: Invalid template for MenuItem: must have at least one of label, role or type

Uncaught Error: Could not call remote function 'emit'. Check that the function signature is correct. Underlying error: Invalid template for MenuItem: must have at least one of label, role or type
/app/share/atom/resources/electron.asar/renderer/api/remote.js:222
Show Stack Trace

This is likely a bug in Atom. This issue has already been reported by the issue is closed.
https://github.com/atom/atom/issues/13109
I always get this error message when I right click in the Atom editor. I am using Atom 1.45.0 on Linux Mint 19.3 using the Atom Flatpak.

I am having the same issue. Any solutions yet?

I switched over to the DEB installer and I still have this issue.

Same here, when I make a right click on some spelling error, I get the error:
Atom: 1.47.0-beta0 x64
Electron: 5.0.13
OS: Mac OS X 10.15.4
Thrown From: Atom Core
Stack Trace
Uncaught Error: Could not call remote function 'emit'. Check that the function signature is correct. Underlying error: Invalid template for MenuItem: must have at least one of label, role or type
At /Applications/Atom Beta.app/Contents/Resources/electron.asar/renderer/api/remote.js:222

Error: Could not call remote function 'emit'. Check that the function signature is correct. Underlying error: Invalid template for MenuItem: must have at least one of label, role or type
    at callFunction (/Applications/Atom Beta.app/Contents/Resources/electron.asar/browser/rpc-server.js:260:17)
    at /Applications/Atom Beta.app/Contents/Resources/electron.asar/browser/rpc-server.js:411:10
    at EventEmitter.<anonymous> (/Applications/Atom Beta.app/Contents/Resources/electron.asar/browser/rpc-server.js:275:21)
    at EventEmitter.emit (events.js:194:13)
    at WebContents.<anonymous> (/Applications/Atom Beta.app/Contents/Resources/electron.asar/browser/api/web-contents.js:420:21)
    at WebContents.emit (events.js:194:13)

Commands
  3x -0:35 sublime-word-navigation:move-to-beginning-of-word (input.hidden-input)
     -0:34.3.0 core:move-right (input.hidden-input)
  2x -0:34 core:backspace (input.hidden-input)
     -0:33.5.0 intentions:highlight (input.hidden-input)
     -0:33.3.0 sublime-word-navigation:move-to-end-of-word (input.hidden-input)
     -0:32.5.0 intentions:highlight (input.hidden-input)
  2x -0:32.4.0 sublime-word-navigation:move-to-end-of-word (input.hidden-input)
     -0:31.9.0 intentions:highlight (input.hidden-input)
     -0:31.8.0 sublime-word-navigation:move-to-beginning-of-word (input.hidden-input)
     -0:31.5.0 core:move-left (input.hidden-input)
  3x -0:31.2.0 sublime-word-navigation:select-to-end-of-word (input.hidden-input)
     -0:29.7.0 intentions:highlight (input.hidden-input)
     -0:29.6.0 core:select-left (input.hidden-input)
     -0:29.2.0 core:backspace (input.hidden-input)
     -0:27.4.0 core:move-right (input.hidden-input)
     -0:27.1.0 core:move-down (input.hidden-input)

Non-Core Packages
atom-material-syntax 1.0.8
atom-material-ui 2.1.3
atom-runner 2.7.1
atom-wrap-in-tag 0.6.0
auto-update-plus 0.5.8
browse 2.6.2
build 0.70.0
busy-signal 2.0.1
city-lights-icons 1.1.1
city-lights-syntax 1.1.8
city-lights-ui 1.5.3
ctrl-dir-scroll 0.2.5
highlight-selected 0.17.0
indent-guide-ext 0.2.3
intentions 1.1.5
linter 2.3.1
linter-jsonlint 1.4.0
linter-ui-default 1.8.1
minimap 4.29.9
multi-cursor 3.0.0
pretty-json 2.1.2
python-indent 1.2.6
rainbow-tabs 2.5.1
satisfy-dependencies 0.4.2
set-syntax 0.4.0
sublime 0.5.0
sublime-block-comment 0.5.1
Sublime-Style-Column-Selection 1.7.5
sublime-word-navigation 0.2.1
sublimify 0.10.0
tag 0.5.0
text-manipulation 0.6.0
website-minifier 1.4.0
wordcount 3.2.0

not stale

Not stale.
Same issue here on Mac OS 11.6.5 Big Sur with Atom 1.60.0 (Electron: 9.4.4, Chrome: 83.0.4103.122, Node: v12.14.1).
Uncaught Error: Could not call remote method 'emit'. Check that the method signature is correct. Underlying error: Invalid template for MenuItem: must have at least one of label, role or type Underlying stack: TypeError: Invalid template for MenuItem: must have at least one of label, role or type at Function.u.buildFromTemplate (electron/js2c/browser_init.js:73:4668) at new ContextMenu (/Applications/Atom.app/Contents/Resources/app.asar/src/main-process/context-menu.js:7:23) at BrowserWindow. (/Applications/Atom.app/Contents/Resources/app.asar/src/main-process/atom-window.js:185:14) at BrowserWindow.emit (events.js:223:5) at electron/js2c/browser_init.js:233:7839 at IpcMainImpl. (electron/js2c/browser_init.js:233:4244) at IpcMainImpl.emit (events.js:223:5) at WebContents. (electron/js2c/browser_init.js:173:8760) at WebContents.emit (events.js:223:5)
electron/js2c/renderer_init.js:83
Error: Could not call remote method 'emit'. Check that the method signature is correct. Underlying error: Invalid template for MenuItem: must have at least one of label, role or type Underlying stack: TypeError: Invalid template for MenuItem: must have at least one of label, role or type     at Function.u.buildFromTemplate (electron/js2c/browser_init.js:73:4668)     at new ContextMenu (/Applications/Atom.app/Contents/Resources/app.asar/src/main-process/context-menu.js:7:23)     at BrowserWindow.<anonymous> (/Applications/Atom.app/Contents/Resources/app.asar/src/main-process/atom-window.js:185:14)     at BrowserWindow.emit (events.js:223:5)     at electron/js2c/browser_init.js:233:7839     at IpcMainImpl.<anonymous> (electron/js2c/browser_init.js:233:4244)     at IpcMainImpl.emit (events.js:223:5)     at WebContents.<anonymous> (electron/js2c/browser_init.js:173:8760)     at WebContents.emit (events.js:223:5)     at electron/js2c/browser_init.js:233:7867     at IpcMainImpl.<anonymous> (electron/js2c/browser_init.js:233:4244)     at IpcMainImpl.emit (events.js:223:5)     at WebContents.<anonymous> (electron/js2c/browser_init.js:173:8760)     at WebContents.emit (events.js:223:5)
Error invoked via right-click in any (in my case, a simple HTML) file.
Would be nice to see a solution for this.
Thank you!


Invalid Request Body Parameters Tiktok

Failed to log in with TikTok because the request body parameter requires a client key, but client id given.
https://developers.tiktok.com/doc/client-access-token-management/

When i tryna to die and debug

We're going to be tagging a new version tomorrow that may resolve this. I'll keep you posted. If it does not resolve this we'll investigate further 😉

Wow that's really awesome, I thank the team who made this package, it really saves time. I really apreciate it.

Ok, can you go ahead and try with the latest release 1.0.2 https://github.com/thedevdojo/auth/releases/tag/1.0.2.
If not, keep me posted and we'll try and replicate this issue and get it resolved 😊 Thanks!

Closing for now, but let me know if you've gotten it working with 1.0.3
Thanks!