feat: Create SignOutPage when wallet not accessed

Add SignOutPage when wallet not accessed
Ticket Link:
DCMAW-9638
DCMAW-10090
Description Of Changes:
Amend existing SignOutPage into WalletSignOutPage - displays when/ if user accessed wallet at some point. Create new SignOutPage - displayed only when the user has never accessed wallet.
AC1b, AC2b, AC3b cannot be evidenced - I can quickly show this on a call if needed - those were met.
Evidence:
DCMAW-9638
https://github.com/user-attachments/assets/7330e38f-2fe4-4030-af0a-bf3da34a76e0
https://github.com/user-attachments/assets/3ccc5096-6b16-4975-9efb-1bda4ed25f5c
https://github.com/user-attachments/assets/06c7ae71-f456-4223-8dad-aa13450ce120
https://github.com/user-attachments/assets/5f3e5a11-7f9d-47e7-a6e6-be10538bb5c7
https://github.com/user-attachments/assets/86b64003-88f6-4705-b868-23407777b9c4
https://github.com/user-attachments/assets/7aecf4dd-b5c7-40db-95e6-8968b0e2c0d8
https://github.com/user-attachments/assets/924871e1-c219-47b5-837e-df5f1c234e48
DCMAW-10090
AC1
11.2.0 - [FirebaseAnalytics][I-ACS023105] Event is not subject to real-time event count daily limit. Marking an event as real-time. Event name, parameters: screen_view (_vs), {
    _mst = 1;
    ga_debug (_dbg) = 1;
    ga_event_origin (_o) = app;
    ga_previous_class (_pc) = touchIDEnrollmentScreen;
    ga_previous_id (_pi) = -7445189895592028454;
    ga_previous_screen (_pn) = use touch id to sign in;
    ga_realtime (_r) = 1;
    ga_screen (_sn) = are you sure you want to sign out?;
    ga_screen_class (_sc) = signOutScreenNoWallet;
    ga_screen_id (_si) = -7445189895592028453;
    language = en;
    organisation = <OT1056>;
    primary_publishing_organisation = government digital service - digital identity;
    saved_doc_type = undefined;
    screen_id = 3e50cd12-4ee8-4787-add8-6a2ac7d4a840;
    taxonomy_level1 = one login mobile application;
    taxonomy_level2 = login;
    taxonomy_level3 = undefined;
    title = are you sure you want to sign out?;
}

AC2
11.2.0 - [FirebaseAnalytics][I-ACS023072] Event logged. Event name, event params: screen_view (_vs), {
    _mst = 1;
    ga_debug (_dbg) = 1;
    ga_event_origin (_o) = app;
    ga_previous_class (_pc) = signOutScreenNoWallet;
    ga_previous_id (_pi) =<PHONE_NUMBER>146903352;
    ga_previous_screen (_pn) = are you sure you want to sign out?;
    ga_realtime (_r) = 1;
    ga_screen (_sn) = gov.uk one login;
    ga_screen_class (_sc) = introWelcomeScreen;
    ga_screen_id (_si) =<PHONE_NUMBER>146903353;
    language = en;
    organisation = <OT1056>;
    primary_publishing_organisation = government digital service - digital identity;
    saved_doc_type = undefined;
    screen_id = 30a6b339-75a8-44a2-a79a-e108546419bf;
    taxonomy_level1 = one login mobile application;
    taxonomy_level2 = login;
    taxonomy_level3 = undefined;
    title = gov.uk one login;
}
11.2.0 - [FirebaseAnalytics][I-ACS002001] Measurement timer fired
11.2.0 - [FirebaseAnalytics][I-ACS002003] Measurement timer canceled
11.2.0 - [FirebaseAnalytics][I-ACS023105] Event is not subject to real-time event count daily limit. Marking an event as real-time. Event name, parameters: navigation, {
    ga_debug (_dbg) = 1;
    ga_event_origin (_o) = app;
    ga_realtime (_r) = 1;
    ga_screen (_sn) = are you sure you want to sign out?;
    ga_screen_class (_sc) = signOutScreenNoWallet;
    ga_screen_id (_si) =<PHONE_NUMBER>146903352;
    language = en;
    organisation = <OT1056>;
    primary_publishing_organisation = government digital service - digital identity;
    saved_doc_type = undefined;
    taxonomy_level1 = one login mobile application;
    taxonomy_level2 = login;
    taxonomy_level3 = undefined;
    text = sign out and delete preferences;
    type = submit form;
}

AC3
11.2.0 - [FirebaseAnalytics][I-ACS023073] Debug mode is enabled. Marking event as debug and real-time. Event name, parameters: navigation, {
    ga_debug (_dbg) = 1;
    ga_event_origin (_o) = app;
    ga_realtime (_r) = 1;
    ga_screen (_sn) = are you sure you want to sign out?;
    ga_screen_class (_sc) = signOutScreenNoWallet;
    ga_screen_id (_si) = -7445189895592028448;
    language = en;
    organisation = <OT1056>;
    primary_publishing_organisation = government digital service - digital identity;
    saved_doc_type = undefined;
    taxonomy_level1 = one login mobile application;
    taxonomy_level2 = login;
    taxonomy_level3 = undefined;
    text = back;
    type = submit form;
}
11.2.0 - [FirebaseAnalytics][I-ACS023072] Event logged. Event name, event params: navigation, {
    ga_debug (_dbg) = 1;
    ga_event_origin (_o) = app;
    ga_realtime (_r) = 1;
    ga_screen (_sn) = are you sure you want to sign out?;
    ga_screen_class (_sc) = signOutScreenNoWallet;
    ga_screen_id (_si) = -7445189895592028448;
    language = en;
    organisation = <OT1056>;
    primary_publishing_organisation = government digital service - digital identity;
    saved_doc_type = undefined;
    taxonomy_level1 = one login mobile application;
    taxonomy_level2 = login;
    taxonomy_level3 = undefined;
    text = back;
    type = submit form;
}
11.2.0 - [FirebaseAnalytics][I-ACS002002] Measurement timer scheduled to fire in approx. (s): 0.9785468578338623
11.2.0 - [FirebaseAnalytics][I-ACS002001] Measurement timer fired
11.2.0 - [FirebaseAnalytics][I-ACS002003] Measurement timer canceled
11.2.0 - [FirebaseAnalytics][I-ACS023105] Event is not subject to real-time event count daily limit. Marking an event as real-time. Event name, parameters: navigation, {
    ga_debug (_dbg) = 1;
    ga_event_origin (_o) = app;
    ga_realtime (_r) = 1;
    ga_screen (_sn) = are you sure you want to sign out?;
    ga_screen_class (_sc) = signOutScreenNoWallet;
    ga_screen_id (_si) = -7445189895592028448;
    language = en;
    organisation = <OT1056>;
    primary_publishing_organisation = government digital service - digital identity;
    saved_doc_type = undefined;
    taxonomy_level1 = one login mobile application;
    taxonomy_level2 = login;
    taxonomy_level3 = undefined;
    text = back;
    type = submit form;
}

AC4 (Welsh)
11.2.0 - [FirebaseAnalytics][I-ACS031029] Logging screen view with screen name and screen class: are you sure you want to sign out?, signOutScreenNoWallet
11.2.0 - [FirebaseAnalytics][I-ACS023051] Logging event: origin, name, params: app, screen_view (_vs), {
    _mst = 1;
    ga_event_origin (_o) = app;
    ga_previous_class (_pc) = touchIDEnrollmentScreen;
    ga_previous_id (_pi) = -9205768981192396352;
    ga_previous_screen (_pn) = use touch id to sign in;
    ga_screen (_sn) = are you sure you want to sign out?;
    ga_screen_class (_sc) = signOutScreenNoWallet;
    ga_screen_id (_si) = -9205768981192396351;
    language = cy;
    organisation = <OT1056>;
    primary_publishing_organisation = government digital service - digital identity;
    saved_doc_type = undefined;
    screen_id = 3e50cd12-4ee8-4787-add8-6a2ac7d4a840;
    taxonomy_level1 = one login mobile application;
    taxonomy_level2 = login;
    taxonomy_level3 = undefined;
    title = are you sure you want to sign out?;
}
11.2.0 - [FirebaseAnalytics][I-ACS023073] Debug mode is enabled. Marking event as debug and real-time. Event name, parameters: screen_view (_vs), {
    _mst = 1;
    ga_debug (_dbg) = 1;
    ga_event_origin (_o) = app;
    ga_previous_class (_pc) = touchIDEnrollmentScreen;
    ga_previous_id (_pi) = -9205768981192396352;
    ga_previous_screen (_pn) = use touch id to sign in;
    ga_realtime (_r) = 1;
    ga_screen (_sn) = are you sure you want to sign out?;
    ga_screen_class (_sc) = signOutScreenNoWallet;
    ga_screen_id (_si) = -9205768981192396351;
    language = cy;
    organisation = <OT1056>;
    primary_publishing_organisation = government digital service - digital identity;
    saved_doc_type = undefined;
    screen_id = 3e50cd12-4ee8-4787-add8-6a2ac7d4a840;
    taxonomy_level1 = one login mobile application;
    taxonomy_level2 = login;
    taxonomy_level3 = undefined;
    title = are you sure you want to sign out?;
}

Checklist
Before raising your pull request:

[x] Commit messages that conform to conventional commit messages
[x] Ran the app locally ensuring it builds
[ ] Ran the tests locally ensuring they pass on Build
[x] Pull request has a clear title with a short description about the feature or update
[x] Created a draft pull request if it is not yet ready for review

Before your pull request can be reviewed:

[x] Met all of the acceptance criteria specified in the user story on Jira

[x] Reviewed your own code to ensure you are following the style guidelines

[ ] Ran the app and tested the feature on a range of device sizes
Please include iPod Touch, iPhone SE and iPhone 11 as a minimum.

[x] Written Unit and Integration tests if needed

[ ] Met all accessibility requirements?

[x] Checked dynamic type sizes are applied
[x] Checked VoiceOver can navigate your new code
[ ] Checked a user can navigate only using a keyboard around your new code

Before merging your pull request:

[x] Ensure that the code coverage and SonarCloud checks have passed
[ ] Actioned and resolved all comments, reaching out to reviewers for clarifications if necessary.
[ ] Ran the app to ensure that no regressions have been caused by changes during code review.

QA Reviewed & Approved ✅
Amazing evidencing!


fix(keyExpectedValue): cloudformation-aws queries convert to a recomm…

…endation rather than a current status
Closes #
Proposed Changes

I submit this contribution under the Apache-2.0 license.

Hello, @liorj-orca!
Thank you so much for continuing to improve KICS queries 🚀
The PR failed in E2E tests. Do you need any help with that? As a tip, you can see E2E documentation to know how to run E2E tests.

Hello, @liorj-orca!
Feel free to ping me if you need something from our side in order to close this PR! ⛵
If you prefer, we can close it in our side.


Rehydration failure of serialized container with reference to offline blob

Rehydration failure of serialized container with reference to offline blob
This bug concerns blobs for detached containers via IDetachedBlobStorage, discussed here #6128 implemented with #6530.
The observed behavior is that if a container referencing an offline blob is serialized (i.e. Container.serialize()) and then rehydrated (i.e., Loader.rehydrateDetachedContainerFromSnapshot()), the rehydration will fail, at this location/stack trace:

Inspection of the serialized JSON allows identification of the relevant part:
               }
            },
            ".metadata":{
               "type":2,
               "content":"{\"summaryFormatVersion\":1,\"gcFeature\":0}"
            },
            ".blobs":{
               "type":1,
               "tree":{
                  "0":{
                     "id":"801a72e9-2251-42f4-bdb3-eafcda34fb32",
                     "type":4
                  }
               }
            }
         }
      }
   }
}

Full text not posted here.  More information can be provided over DM if helpful.
To Reproduce
From a high level:

Instantiate loader with IDetachedBlobStorage
Create detached container from loader
While container is detached, upload blob via runtime
Serialize detached container, and rehydrate

Expected behavior
Rehydration succeeds
Additional comment: to an implementer of IDetachedBlobStorage, it's not documented what should be returned for url.  Tried a few things in an attempt to rule this out as a factor, the above failure reproduced regardless.

convertSummaryToSnapshotWithEmbeddedBlobContents() isn't expecting SummaryType.Attachment.

fixed in #6864


Live Market Data Not Working

I am trying to fetch live market data for equity but preference is not working... I am trying to do this way... please correct me if I am doing wrong....
pm.get_live_market_data('LTP', ['BSE', '523144', 'EQUITY'])
it returns the response....
{'data': [{'found': False, 'message': 'You have sent preference packet in an invalid format: BSE'}, {'found': False, 'message': 'You have sent preference packet in an invalid format: 523144'}, {'found': False, 'message': 'You have sent preference packet in an invalid format: EQUITY'}]}

Hi @knandini24x7
The pattern for preference is <exchange>:<securityId>:<scripType>.  For eg : In your case it will beBSE:523144:EQUITY.


50 sees setting for foldx rfp lambo problem

fixed seed setting for foldx_rfp_lambo

added internal task, that wraps lambo RFPTask. The call sets observer seed.
For default Lambo runs we rely on hydra seed setting to pass through to internal task.
By default internally spawned processes had seed set to zero -> set to None by default

NOTE: the lambo cmd call for the experiments needs to include the poli hydra config additions. Therefore add:
'hydra.searchpath=[file:///Users/rcml/poli/src/poli/objective_repository/foldx_rfp_lambo/]' to the lambo experiment call.


Moving the Uint8Array.slice polyfill back to the original location

Original polyfill was moved to a different file. This changed the load order of stuff and is now causing a crash in IE11, which prevents our webapp from loading at all. Moving the polyfill back to the original place for now.
FIxes #1296

Added a comment in the code and created issue #1301 to track eventually moving the polyfill to a better location


WIP: Initialise Typer for prompting and printing

migrating https://github.com/odk-x/sync-endpoint-default-setup/pull/39 to https://github.com/odk-x/sync-endpoint-default-setup/tree/outreachy-2022

closing dupliucation


influxdb logs to /var/log/messages by default

I am running (Influxdb 1.1.0), (Telegraf 1.1.0) and Grafana 3.0 (soon will run kapacitor) on a RHEL 7.0 server , and I ran into a 100% disk utilization issue because of the file /var/log/messages .
Seems like telegraf , influxdb and grafana are all logging their events to this file, resulting in a large file size quickly.
How do I direct the logs somewhere else ?
And what is the difference between info logged in /var/log/messages and /var/log/influxdb/{{ .product }} ?
The file contains event logs by influxdb, telegraf and grafana, like when a batch of points has been been written by telegraf, a point is arriving to influxdb via http or typical grafana query activity. I'll give an example:
Apr 20 10:03:32 my-server-host-name influxd: [query] 2017/04/20 10:03:32 SELECT mean(value) FROM db.rp.measure WHERE time > now() - 1h GROUP BY time(30s)
Apr 20 10:03:32 my-server-host-name influxd: [query] 2017/04/20 10:03:32 SELECT mean(value2) FROM db.rp.measure WHERE time > now() - 1h GROUP BY time(30s)
Apr 20 10:03:32 my-server-host-name influxd: [httpd] ::1 - influx_user [20/Apr/2017:10:03:32 +0400] "GET /query?db=db&epoch=ms&q=SELECT+mean....etc
Apr 20 10:03:32 my-server-host-name influxd: [httpd] ::1 - influx_user [20/Apr/2017:10:03:32 +0400] "GET /query?db=db&epoch=ms&q=SELECT+mean%......etc
Apr 20 10:03:37 my-server-host-name influxd: [httpd] X.X.X.X - influx_user2 [20/Apr/2017:10:03:37 +0400] "POST /write?db=db&p=%5BREDACTED%5D&precision=ms&rp=rp&u=influx_user2 HTTP/1.1" 204 0 "-" "python-requests/2.11.0" 1864a5ab-258f-11e7-8309-000000000000 18886
Apr 20 10:03:41 my-server-host-name telegraf: 2017/04/20 10:03:41 I! Output [influxdb] buffer fullness: 30 / 10000 metrics. Total gathered metrics: 35263075. Total dropped metrics: 0.
Apr 20 10:03:41 my-server-host-name telegraf: 2017/04/20 10:03:41 I! Output [influxdb] wrote batch of 30 metrics in 223.127Âµs
Apr 20 10:04:06 my-server-host-name influxd: [httpd] X.X.X.X - influx_user2 [20/Apr/2017:10:04:06 +0400] "POST /write?db=db&p=%5BREDACTED%5D&precision=ms&rp=rp&u=influx_user2 HTTP/1.1" 204 0 "-" "python-requests/2.4.3 CPython/2.7.9 Linux/3.16.0-4-amd64" 29b25ca8-258f-11e7-83fc-000000000000 8499
Apr 20 10:04:06 my-server-host-name influxd: [httpd] X.X.X.X - influx_user2 [20/Apr/2017:10:04:06 +0400] "POST /write?db=db&p=%5BREDACTED%5D&precision=ms&rp=rp&u=influx_user2 HTTP/1.1" 204 0 "-" "python-requests/2.4.3 CPython/2.7.9 Linux/3.16.0-4-amd64" 29b33168-258f-11e7-83fd-000000000000 10269
......
......
more of the same

What's alarming is that the file is growing in size by about 0.5GB / 24 hours.
I am thinking about purging these logs after having directed them away from /var/log/messages

This is an issue with the system, not influx. This behaviour is not seen in RHEL6 or Ubuntu 12 and 14 distributions and I would wager this applies to all non-systemd distributions as well.

@pkittenis That may be the case. However, for better or for worse, more and more systems are moving to systemd and logs not being properly directed by default is something though I believe should be addressed.

There is something we can do at the rsylog level (Also using RHEL 7.0)
We can create a simple rule in /etc/rsyslog.d/influxdb.conf to change the destination log:
### InfluxDB Rules ###
if $programname == 'influxd' then {
   action(type="omfile" file="/var/log/influxdb/influxd.log")
}

@pkittenis Perhaps these simple rules can be added to the packages (like we do for logrotate confs).

I am not part of the project, cannot help you there. I pointed out the issue does not occur on RHEL6 or other non-systemd based systems, which points to an issue with systemd rather than influx.

I install grafana and influxdb latest version in same pc.
I have to monitoring another ubuntu syslog via Grafana.
And I also same monitoring mikrotik syslog too.
How can I insert remote syslog into influxdb database?
need anybody help.
Thanks

I have a same problem that influxdb logs to /var/log/messages by default .and I try some configs and failed~

Same behaviour observed in influxdb:1.7.6
Putting an override in /etc/default/influxdb didn't work as per the documentation
System Info: Centos7.5.1804
Installation Info: Launched as a service

same problem here. Added the /etc/rsyslog.d/influxdb.conf as mentioned above solved it for me for now

Same behaviour observed in influxdb:1.7.6
Putting an override in /etc/default/influxdb didn't work as per the documentation
System Info: Centos7.5.1804
Installation Info: Launched as a service

Thanks for the link to the documentation. I was too hit by this problem on my Raspberry Pi running Raspbian (where this is especially painful due to the SD card wearing off) with default syslog configuration. In my case /var/log/daemon.log was being blasted with entries such as:
Aug  7 21:30:48 teplota influxd[608]: ts=2019-08-07T19:30:48.898237Z lvl=info msg="Executing query" log_id=0H5zn~Kl000 service=query query="SELECT mean(cpu) FROM systemp.autogen.systemp WHERE url = 'http://localhost:5000/' AND time > now() - 5m GROUP BY time(200ms)"
Aug  7 21:31:01 teplota influxd[608]: ts=2019-08-07T19:31:01.541080Z lvl=info msg="Executing query" log_id=0H5zn~Kl000 service=query query="SELECT mean(usage_idle) FROM telegraf.autogen.cpu WHERE time >= now() - 6h GROUP BY time(20s)"
Aug  7 21:31:01 teplota influxd[608]: ts=2019-08-07T19:31:01.559447Z lvl=info msg="Executing query" log_id=0H5zn~Kl000 service=query query="SELECT mean(free) FROM telegraf.autogen.mem WHERE time >= now() - 6h GROUP BY time(20s)"
Aug  7 21:31:01 teplota influxd[608]: ts=2019-08-07T19:31:01.571080Z lvl=info msg="Executing query" log_id=0H5zn~Kl000 service=query query="SELECT mean(used_percent) FROM telegraf.autogen.disk WHERE time >= now() - 6h GROUP BY time(20s)"

I solved that by setting log level to error in /etc/influxdb/influxdb.conf and restarting the service.

I don't know how this issue is close to 3 years old and marked as "won't fix", when the solution is basic systems administration and should come out of the box.
In the /etc/systemd/system/influxdb.service, set the following parameters:
 StandardOutput=null
 StandardError=null

The above will simply zap the log output. But if this is not desired, one can also set these values to say append:/var/log/influxdb/influxd, which can be combined by setting /var/log/influxdb to be a sym link to some other storage medium.
As an aside, it's quite obviously poor form to dump http logs into syslog.
Systemd logging configuration reference.

I am running influxDB version: 1.7.8 on Ubuntu machine (18.04.3 LTS).
Currently my syslog file keep increasing by 5 GB per day.
I consider this an issue with InfluxDB.
I don't understand why the DB need to log such info by default.

There is something we can do at the rsylog level (Also using RHEL 7.0)
We can create a simple rule in /etc/rsyslog.d/influxdb.conf to change the destination log:
### InfluxDB Rules ###
if $programname == 'influxd' then {
   action(type="omfile" file="/var/log/influxdb/influxd.log")
   stop
}

@pkittenis Perhaps these simple rules can be added to the packages (like we do for logrotate confs).

Thanks a lot.

leaving everything to rsyslog is wrong.

I have noticed that when HTTP query logging is enabled, it doesn't just log to syslog but also /var/log/messages and /var/log/user.log: https://github.com/influxdata/influxdb/issues/21726.

Is it really solved?
I have a pure Centos 7.6,
I tried this and this comment above,
They both don't work for me.

Is it really solved? I have a pure Centos 7.6, I tried this and this comment above, They both don't work for me.

same with me

as of today with version 1.8.10 of influxdb on a rocky linux 8.7 system i was able to workaround the issue the following way:
edit the configuration in /etc/influxdb/influxdb.conf
in the [http] section set
access-log-path = "/var/log/influxdb/access.log"
and in the [logging] section set
level = "error"
create a new configuration at /etc/logrotate.d/influxdb_http with
/var/log/influxdb/access.log {
daily
rotate 7
missingok
dateext
copytruncate
compress
}
restart the service to apply the configuration
sudo systemctl restart influxd

Thanks to TheFlipside !
That worked for me.
I moved all .logs from the internal microSD (RasPi) to an secure disk (ext. USB SSD)

as of today with version 1.8.10 of influxdb on a rocky linux 8.7 system i was able to workaround the issue the following way:
edit the configuration in /etc/influxdb/influxdb.conf
in the [http] section set access-log-path = "/var/log/influxdb/access.log"
and in the [logging] section set level = "error"
create a new configuration at /etc/logrotate.d/influxdb_http with
/var/log/influxdb/access.log { daily rotate 7 missingok dateext copytruncate compress }
restart the service to apply the configuration
sudo systemctl restart influxd

Thanks, I use followed os/influxdb version is useful to configure, the other comments are useless now.
ubuntu 20.04 and apt install influxd
influxd version
InfluxDB v1.6.4 (git: unknown unknown)


Feature/menu

Feature is complete, pending review.

Can we get a changelog entry for this, and API docs for #menu?

Looks good to me too.  Thanks!


Making elements bounce when they collide

I want to have many divs moving around, and having them bounce off of each other when they collide. I couldn't find any example managing collisions with react motion. Is this possible?

Have you considered using canvas, or a similar technology? This might require undue labor to achieve with HTML5.

maybe you should check d3js.org


Fix #221

_addToLoadList needs to be called with ‘real’ when called from inject
if the actual module has been created by a different loader.

Nice! I'm checking this tonight, thanks for your help :)


Bump Release to 1.0.2

Update snsql dependency to 1.0.2 to take advantage of bug fix in approx_bounds
Fix bug where MST synthesizer would raise warning but attempt to keep running when mbi not installed
Update documentation to highlight mbi dependency

Addresses #573

@joshua-oss question re. this update to the MST code: does this mean that the tutorial here regarding domain use is no longer up to date and we should defer to this: https://docs.smartnoise.org/synth/synthesizers/mst.html

Yes, that code sample still should work (we haven't done anything to disable it) but it's better to use the common pattern used across all the synthesizers. Note that I recently discovered an issue where MST and AIM are failing if the inferred cliques overlap in a certain order, so if you're seeing errors like "column_name is both an index and a level", it's a bug that I haven't yet tracked down.

sounds good! mainly asking because it seems like the new style no longer requires domain specification and I'm guessing that's being automated in the background?

thanks! will defer to latest one without domain specification then.


Missing syntax highlighting

Certain keywords (e.g. self, parent, as, auto) are still missing proper syntax highlighting.
Thanks to Scrivener07 for bringing this to my attention.

I noticed today that the "Idle" base script is missing highlighting too. This is a base script with no members though shows up in scripts as properties and variables. Maybe some other memberless base scripts are missing too.


issue#66 - storage::File isAvailable property

[UPDATE 2Dec]

Add isDeleted property in storage::File schema
Deletion file from AG will now mark storage::File isDeleted property to true
Refactoring/renaming AGService in their folder
Datasets page (in UI) will have an option to show available datasets only or all datasets (included deleted files).
/api/datasets/ have a query option to include deleted files (?includeDeletedFile=true).
Minor update on the detailed dataset page on UI. (Need to more work on the detailed dataset page but might be on a seperate ticket.)

ARCHIVED - 24Nov

Add isAvailable property in storage::File schema
Deletion file from AG will now mark storage::File isAvailable property to false
Refactoring/renaming AGService in their folder
Datasets page (in UI) will only show available datasets instead of all datasets.
API:
datasets/all - show datasets summary from all file in db
datasets/available - show datasets summary from only available file

I'm not sure I'd introduce a new API endpoint - I think it would be better to just have a field in the Dataset return values..
(kind of like isAvailable). So isLoaded or something.
Reason being - the 'load' on the server for adding in the available cases is almost zero (its just direct config file -> JSON) - so I think there's very little downside in just always having a /datasets endpoint that always includes all the datasets (and then just flip the boolean based on whether there is a corresponding Dataset Db record or not).
So that means the frontend will always just be calling the single API endpoint - and can do what ever filtering/visuals it wants.

Should 'description' be deleted from the Dataset EdgeDb schema - as that is better to be sourced direct from the config?
Are there any other fields that we previously stored in the EdgeDb schema for dataset that in fact could be removed and put into the config only?

The renaming to S3Index is good - we should document it at some point - as there is no really well established standard for how to 'set up' files for a dataset. So this approach with manifests etc is as good a defacto standard as any. (and isn't restricted to only AG as you've noted)

Can you attach some screenshots of the new datasets table UI

Can you attach some screenshots of the new datasets table UI

(Hovering on the icon led to the tooltip)
Also had some SS from the PR description above on the UI word (might need to mentioned this above):

https://user-images.githubusercontent.com/61998484/205179475-1364133f-81ae-416b-b0db-7f1e838fd4ea.png
https://user-images.githubusercontent.com/61998484/205189282-3569e4bc-2343-4e42-8a41-b89bbe086156.png


Added getAllUncompletedTasks() and options for addTask()

Looks like a great change!
Can you update the readme as well to match this?

@PostsDesert Just wanted to say thanks for making this PR! I wanted to add due dates so finally merged this :)


Director advertise origin instead of writebackhost

Changes made with this PR:

Client now gets the endpoint for a put request through the director, this endpoint is the origin_url. PUTs now require a running director to work.
When running origin serve and as a configurable option, you can specify if the origin is writeable (default is true).
Made a test within handle_http_test.go end-to-end with xrootd, using the federation in a box since now PUTs require a director to be running.
To remove an import cycle, made the pelican version global through config

Might have missed some other patch work to make everything work properly as well but this is the gist of it

Also -- is the periodic OSDF advertise updated as well? I'm not seeing code that suggests it is.

Yes, Emma fixed this in one of her PRs

Also -- is the periodic OSDF advertise updated as well? I'm not seeing code that suggests it is.

Yes, Emma fixed this in one of her PRs

It depends on what you mean by "updated".


ANSI artworks don't display correctly

Steps to reproduce
try to display any of .ans files from fuel using:
iconv -f CP437 -t UTF-8 < file.ans

you can use this php script:
<?php
if (isset($_GET['file'])) {
    echo shell_exec(sprintf("iconv -f CP437 -t UTF-8 < %s", $_GET['file']));
}
?>

I've used trick to handle \n\x1b[1A (found in some ANSI artwork) that is using enter and the move the cursor up so I've just removed this string entirely. moving cursor will not work for other cases.

move forward was also simple just replace with N number of spaces.

My [1A was actually wrong because the sequence was

Working ANSI artworks can be seen in this pen https://codepen.io/jcubic/pen/pxdxmN?editors=0010


lfhsize when using AppAttach

When an MSIX file is written to a format for App Attach (e.g.: Vhd/Vhdx/Cim) the AppxBlockMap.xml contents must be updated if any files are changed (such as package name or version) to match the actual files in the package.
As these formats are not "zip" compression based, there no longer is a lfhsize value.  Perhaps this attribute should actually be optional for these use cases, but even as a required field it seems that the description on this page should call this out and recommend a value to be used.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 52cbb5d5-7462-6295-b7cc-4b4fdc61d2f9
Version Independent ID: a7acc6d6-06db-a595-1361-4ada74c62c9c
Content: File (package block map schema) - Windows UWP applications
Content Source: winrt-related-src/schemas/blockmapschema/element-file.md
Product: uwp
Technology: winrt-reference
GitHub Login: @drewbatgit
Microsoft Alias: drewbat

Hello. We apologize for the delay in resolving this issue. As we transition to a new feedback system, we are closing all outstanding issues. Any issues that can be addressed will be tracked using a different internal tool, and we regret that we won't be able to provide further updates on this particular matter. We value your input and assure you that all feedback is reviewed. We recommend visiting the Microsoft Q&A site, where your issue may have already been discussed.


The file list jumps every couple of seconds

This started to happen to me recently after one of the automatic updates:

I'm using macOS 10.13.3, Sublime 3143, FileBrowser 0.8.4.

Try to ‘Disable auto-refresh for this view’ in context menu.
It seems like you have constantly changing contents like logger maybe; when SFB refreshes a view, it removes text and re-paste the fresh listing, thus it looks like a jump while in fact it is erasing & pasting happen fast.
I do not think we can fix it properly, because getting rid of this jump will not only increase complexity significantly to pinpoint filesystem changes into view (currently we just rebuild the whole list and that’s it), but also it may increase CPU usage because editing a view is relatively heavy operation esp. in case of many consecutive calls such as erase/replace/insert #63

Try to ‘Disable auto-refresh for this view’ in context menu.

It helped. But I need to do it every time I open the file browser.
What I don't understand is why this changed recently. It means that this change was caused by an update in SFB or some other package or ST3 itself.

It seems that this might've changed in https://github.com/aziz/SublimeFileBrowser/commit/9b1cda7f864d3faf5c4889b0057b5439abdbd7a8. So, the fact that I didn't notice any issues was in fact a bug.
Can I disable auto refresh via a config? Also, what's the point of auto refresh if it causes such a behaviour?

Can I disable auto refresh via a config?

https://github.com/aziz/SublimeFileBrowser#auto-refresh

what's the point of auto refresh if it causes such a behaviour?

The point is to make a view display the actual content of a directory automatically, e.g. if you create a new file with save as feature of ST then without refresh SFB view won’t contain the new file unless you refresh manually with r.

https://github.com/aziz/SublimeFileBrowser#auto-refresh

Thanks! I was confused because I thought that it's an ST3's option. Changing it in SFB's config helps.

The point is to make a view display the actual content of a directory automatically, e.g. if you create a new file with save as feature of ST then without refresh SFB view won’t contain the new file unless you refresh manually with r.

What I meant is that the autorefresh option's usefulness is unclear to me – I assumed that many people have the problem with excessive rendering. In such a case, the whole feature would not be very useful. But perhaps there's something specific in my project which causes these re-renders. I'm not sure what, though. The only thing which comes to my mind is the number of symlinks.

Anyway, thanks for your help! I love SFB :)


Upload fails every time (2.7.1 on Android 7.0)

Problem: The app does not want to upload files.
More exactly: When I select a file from gallery, add file name, description and category the upload process starts and then fails. The only result it shows is "cannot upload a file". Uploading a file directly from a camera was not tested.
Screenshots: http://tinypic.com/r/x52t7p/9
App version: 2. 7. 1.
Android version: 7.0
Phone model: AGM A8
Note: Previously it was possible to upload data. Login information is saved in the app.
Log: https://etherpad.wikimedia.org/p/agm-tgm-vzk

Hi @Aktron ,
This should be fixed in the latest version (v2.8.5 in Play Store production). Could you please update to that version, log in again, and see if it works for you?
Thanks!


Removing an unnecessary call to run UI appliation on the main thread.

Ui application initialize already forces itself to run on the main thread.
This is issue was discovered when testing https://github.com/Microsoft/WinObjC/pull/1872.
FunctionalTestSetupUIApplication calls
RunSynchronouslyOnMainThread calls
which looks like:
inline void RunSynchronouslyOnMainThread(void (^block)()) {
if ([NSThread isMainThread]) {
block(); //block =  UIApplicationInitializeFunctionalTest
} else {
dispatch_sync(dispatch_get_main_queue(), block);  //block = UIApplicationInitializeFunctionalTest
}
The problem is isMainThread is not properly initialize till after UIApplicationInitializeFunctionalTest is called.
Up until now, we have just been lucky NSThread isMainThread returned true.  Even though, in functional tests (TAEF) we know we are not on the main thread.  If you look at isMainThread.

(BOOL)isMainThread {
return [self _threadObjectFromCurrentThread] == [self mainThread];
}
this evaluates to nil == nil for functional tests before UIApplicationInitializeFunctionalTest is called.

But, our functional tests have always worked because UIApplicationInitializeFunctionalTest itself already takes care of calling the important pieces on the main thread.
So, the call to RunSynchronouslyOnMainThread in FunctionalTestSetupUIApplication  seems redundant since UIApplicationInitializeFunctionalTest  already knows how to initialize itself.
And, with https://github.com/Microsoft/WinObjC/pull/1872, this caused the FT's to hang, because isMainThread returns false (which is correct!), but, now we call libdispatch to get the main queue, but that hasn't been setup yet because UIApplicationInitializeFunctionalTest.
tl;dr
Call UIApplicationInitializeFunctionalTest before relying on any objective-c thread related activities.
Additional Validation:
I also tested this change with https://github.com/Microsoft/WinObjC/pull/1872 and confirmed the PR worked.

@jaredhms is added to the review. #Closed

@rajsesh-msft is added to the review. #Closed

:shipit:


Switch all quick start deployments to use Autopilot by default

We switched our quick start deployments to use GKE Standard due to flakes when attempting to run the GMP module (https://github.com/GoogleCloudPlatform/ai-on-gke/pull/418) and other issues during testing. Once the remaining issues are resolved we should switch everything back to using Autopilot

cc @artemvmin

cc @roberthbailey is driving this


bitlbee-mastodon: 1.4.4 -> 1.4.5

Automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/bitlbee-mastodon/versions.
meta.description for bitlbee-mastodon is: "Bitlbee plugin for Mastodon"
meta.homepage for bitlbee-mastodon is: "https://alexschroeder.ch/cgit/bitlbee-mastodon/about"
meta.changelog for bitlbee-mastodon is: ""
Updates performed

Version update

To inspect upstream changes
Impact

Checks done (click to expand)

built on NixOS

The tests defined in passthru.tests, if any, passed

0 of 0 passed binary check by having a zero exit code.

0 of 0 passed binary check by having the new version present in output.

found 1.4.5 with grep in /nix/store/7spsqlinhn1hnjdp5vfb7q1wbks2hns0-bitlbee-mastodon-1.4.5

found 1.4.5 in filename of file in /nix/store/7spsqlinhn1hnjdp5vfb7q1wbks2hns0-bitlbee-mastodon-1.4.5

Rebuild report (if merged into master) (click to expand)

3 total rebuild path(s)

2 package rebuild(s)

2 x86_64-linux rebuild(s)
1 x86_64-darwin rebuild(s)

First fifty rebuilds by attrpath
bitlbee-mastodon
docbookrx

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/7spsqlinhn1hnjdp5vfb7q1wbks2hns0-bitlbee-mastodon-1.4.5 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A bitlbee-mastodon https://github.com/r-ryantm/nixpkgs/archive/c94b5c5618e56474d0f32ecb6867f31428dcfeda.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/7spsqlinhn1hnjdp5vfb7q1wbks2hns0-bitlbee-mastodon-1.4.5
ls -la /nix/store/7spsqlinhn1hnjdp5vfb7q1wbks2hns0-bitlbee-mastodon-1.4.5/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

1 package built:

bitlbee-mastodon

Maintainer pings
cc @jpotier for testing.

Since I don't use bitlbee itself, testing is a bit harder than if I was a regular user. So, I can't really say if the update breaks anything at the moment.

The only 2 changes introduced in 1.4.5 are
Fix account search URL https://alexschroeder.ch/cgit/bitlbee-mastodon/commit/?id=b4a598a3c0db28e85e3a7298d9e82ef0f3888afa
Fix search command https://alexschroeder.ch/cgit/bitlbee-mastodon/commit/?id=b1244c6e5118ff835cd2a78f725acb480f8323b0
Both are bitesize change and look good to me.


Ability to have extra info panel in the picker

Is your feature request related to a problem? Please describe.
Ability to add info panel or more add inputs to support the following (Don't worry about the range, more of for something like timezone.)

Describe the solution you'd like
Could be a similar approach to react-dates to accept a function prop and a few other props
Describe alternatives you've considered
Could export wrappers with extra props / children so that it is easier for custom build of the pickers.
Or BYO with ref and static picker similar to examples provided.

I am actually not aware of that but never seen such approach in material design datepickers.
From my perspective there is no really such required information for the user, that needs to be shown directly in datepicker.
Can you add some examples, except timezones?


RERI Improvement Suggestions

Summary:

Number of error categories. Update from 3 error categories to 8 with accommodation for up to 16. Three categories is too limited to differentiate across status, overwriting, responses, and signaling.
Error signaling. Each Each error category is mapped to a signal at the error record and has exactly 1 signal with merging done at the signal level. Suggested change to a) Each error category can trigger a signal at the appropriate local or global level b) Each signal can connect to interrupts or external pins. c) Each error category can be merged before generating the signal. A map per error record paradigm forces a specific topology and pin management challenge that is difficult for FuSa and may limit scalability for vendors and adaptability among vendors.
Precise exception. Add a precise exception indication. Allow simple indication that the interrupted context is restartable after upper layer actions are taken.
Error Record Invalidation. sinv embedded with other control bits. Add a interlock/semaphore mechanism to support atomicity. Prevent error record access hazards and provide assurance that writes do not invalidate unprocessed record updates.
Affected structure detail. ec provides high level information. Expand the structure identification vocabulary to enable fine-grained identification. Detailed identification of the affected structure enables a robust response capability targeting the specific structure.
Error Category Summation. Current error record has Single bit per error record static or dynamic valid in a way that enables programmatic access to error records. Update to Represent error categories and possibly the highest error category in a way that enables programmatic access to error records. RAS Agents should be able to quickly identify the significance of the error event in developing an error response. This is needed to support applications with reaction time requirements (e.g. FuSa)
Error Notification Extension. Replace c and scrub bit in status register with a per category identification of key actions the RAS agent should/could take and insight into the nature of the error event that may be key to formulating this or future response. Each error event category has different “critical” information for the RAS Agent. Enable the RAS Agent to quickly identify which responses are supported by this implementation. This provides regular and easily decoded information for the RAS Agent.
Information Identification Field. A field for each supported additional information register that indicates how the RAS Agent should decode the information. The hardware with the error record knows what is recorded and how the RAS Agent should decode it. Including it removes the need to consider vendor and implementation and record for each error record.

Further details in PDF provided in email.

Discussion on these items.

Number of error categories.

RERI provides a pri field that supports 4 categories each of UUE, UDE, and CE errors. Further four informational indications and an indication for no-error add up to a vocabulary of 17 categories and meets the requirement.

Error signaling.

The RERI specification includes the flexibility of mapping the signal to a variety of signaling and summarization topologies as needed. The per signal configuration bits are optional to implement (WARL). Signaling configuration is primarily static after initialization. Mapping of signals to specific topology/pins/merging is expected to be implementation specific and meets the requirement.

Precise exception

The Priv 1.13 specifies a hardware error exception [3] and an error record signal may cause this precise hardware error exception. The RAS handler may then read additional information from the RAS error record to determine the nature and cause of the exception. The hardware exceptions indicate occurrence of an UUE. While the error was caused by the context that encountered the error encountering corrupted data during its computation, the error record includes a c (containable) bit to indicate a) Indicate that the error has not propagated beyond the boundaries of the component that detected the error b) May be containable through recovery actions (e.g., terminating the computation, restart after correcting, etc.) carried out by the RAS handler. The term “containable” is used instead of restartable to make it applicable to components other than the RISC-V hart, such as the IOMMU, where a “restart” is not possible but we can still signal that the error has not propagated and a more severe action like resetting the IOMMU and the devices in its scope or the system itself is not required. Updating the non-nornative text around UUE with c=1 and precise exceptions in the specification to further clarify these items would be useful. It would be useful to note that the meaning of c for other error categories may be defined in future.

Error Record Invalidation

The current defined scheme involves three steps a) read record b) invalidate record c) read status to determine if overwrite occurred between step a and b. If a second error occurs between a and b and a third error between b and c then the overwrite that occurred between a and b will not be observed.  Update status_i to not accept a SW write when v=1. Define a “Read in progress” bit - rdip in the status register. This bit is set by HW when the v bit goes from 0->1 and is cleared by HW when a new error overwrites a valid error record. control_i.sinv will not clear the status_i.valid bit if status_i.rdip bit is 0. Define a control_i.srdip control bit for SW to set the rdip if it is not already 1. The SW sequence is now a) Read record including status_i and Let S be the value of status_i. b) If S.rdip == 0 then write 1 to control_i.srdip and go to step a c) Write 1 to control_i.sinv d) Let S=status_i and if S.v == 1 && S.rdip == 0 goto step a.

Affected structure detail, Error Category Summation, Error Notification Extension, Information Identification Field

The RERI specification defines info_i, suppl_info_i, and addr_i register to provide further detailed information about the error. The format of the info_i, suppl_info_i, timestamp_i and addr_i registers are not standardized as there is lot of variety in which these fields will need to be defined to meet the needs for various hardware modules such as RISC-V harts, memory controllers, GPU PEs, accelerators, etc. Standardization of the structure of these fields may be pursued in a future segment specific standard extension.
RERI provides a summary_valid register allowing quick identification of the record in the bank that has an error. Further summary registers are not required for most general compute platforms. Summation may be required for segment specific platforms and is to be pursued as a future standard extension. To allow for such extensions which may include a change to register layout, define a 3-bit header field to indicate layout. The layout=0 implies current layout. A future layout may define a bigger header or other changes to register layout to support summation. Reduce space set aside in header/record for vendor specific extension to provide space for future standard extensions.


Reentrancy 2

This review documents the timelock.sol contract, which contains a .call function. This function is restricted to admin, preventing reentrancy.

Very nice. Checked if there is some external call we missed, but contract is very tight. Either it uses SafeERC or restricts access to function by a role (or both).
Maybe we could expand on this in summary to give potential user better feeling of how well structured code is?


[improve][io] Upgrade Kafka client, connect runtime to 2.8.2 and Confluent version to 6.2.8

Motivation
There are multiple Confluent platform versions in use at the moment.
There's now references to both version 7.0.1 and version 5.3.0 (from July 2019) and this doesn't make much sense.
The Confluent platform version should be compatible with the Kafka client and Kafka connect runtime versions.
Confluent 6.2.x is compatible with Kafka client 2.8.2 . (release notes of Confluent 6.2.8)
Modifications

Upgrade Kafka client and Kafka connect runtime to 2.8.2
Upgrade Confluent version to 6.2.8

Documentation

[ ] doc
[ ] doc-required
[x] doc-not-needed
[ ] doc-complete

Matching PR in forked repository
PR in forked repository: https://github.com/lhotari/pulsar/pull/117

/pulsarbot rerun-failure-checks

Codecov Report

Merging #19010 (0618d89) into master (22866bd) will decrease coverage by 4.56%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##             master   #19010      +/-   ##
============================================
- Coverage     45.92%   41.35%   -4.57%
+ Complexity    10104     2393    -7711
============================================
  Files           680      235     -445
  Lines         66758    16652   -50106
  Branches       7147     1812    -5335
============================================
- Hits          30660     6887   -23773
+ Misses        32680     9017   -23663
+ Partials       3418      748    -2670

Flag
Coverage Δ

unittests
41.35% <ø> (-4.57%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

...g/apache/pulsar/client/impl/ConnectionHandler.java
50.00% <0.00%> (-5.32%)
:arrow_down:

...ava/org/apache/pulsar/broker/admin/v1/Brokers.java

...ar/broker/service/persistent/ShadowReplicator.java

...tent/NonPersistentDispatcherMultipleConsumers.java

...broker/intercept/ManagedLedgerInterceptorImpl.java

...oker/loadbalance/LoadResourceQuotaUpdaterTask.java

...saction/recover/TransactionRecoverTrackerImpl.java

...n/java/org/apache/pulsar/compaction/Compactor.java

...apache/pulsar/broker/service/TopicListService.java

...ava/org/apache/pulsar/broker/admin/v3/Sources.java

... and 490 more


chore(deps): bump nodejs

Applied mkpr on undefined
sed s/16.11.0/16.11.1/

:tada: This PR is included in version 1.9.5 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Guard against cross-site scripting attacks

I'm not sure if this is entirely necessary, or even if it might break things. If your base application is already doing this, what happens if you include an engine that does as well?
Someone notified us that not including this was a security flaw, which is technically true I think, but only if you're using this gem alone and not within the context of another Rails application which (ostensively) would be guarding against these attacks.
Thoughts? @jkeck @jcoyne @jeremyf

I wonder why we extend ActionController::Base instead of ApplicationController (which would give downstream applications the ability to control things like this)?

@awead Looks good. I approve, but am curious about pursuing @cbeer's suggestion as well. @cbeer care to create a ticket?

Won't this change prevent json clients from using this endpoint?


Projects Appear On Website Before Completing Project Formation

Currently, any project that has a .yml file merged will appear on the website. This is not ideal because:

Merging the .yml file is the first step in project formation not the last
Technically, no project should appear on the website until a board vote has occurred (the final step)

A current example is veer.
Some ideas:

We could update the .yml file to have a "draft" field, once a project is fully onboarded we would submit a PR to change this field and the website would display projects based on this flag.
We put projects like this in a specific directory

@mgielda feedback requested

OK this is a non issue. The PR should not be landed until project formation is complete.


gems do not get loaded into load path after comfortable mexican sofa

When having gems after the comfortable_mexican_sofa gem in Gemfile the gems do not get included into the load path.

Closing old issue. Never experience anything like that. Can't think why CMS would be doing anything to load paths.


Password Field

The password field still appears in the database. The salt and the hashed password also appear so ensure the password is nit present.

The bug has been solved


Allow MarkdownString to only allow a specific set of commands

Problem
I want to use a command uri in some markdown content. However I don't want to enable all command uris since I am dealing with user content that could use unsafe command Uris.
Feature Request
Rather than trying (and likely failing) to sanitize my markdown content, it would be helpful if MarkdownString supported whitelisting one or more specific commands
Something like:
export class MarkdownString {
    ...

    trustedCommands?: readonly string[];
}

I like it -- so if trustedCommands is undefined you get the current trust behavior and if specified then only linkify matches, right -- no errors or anything, just ignored content.

Not very excited - this seems very specific for a use-case and it something that you easily achieve yourself..

Leaving this up to extensions feels like a recipe for problems. Even I don't feel I can be 100% that I've properly stripped out all bad command  uris. Better to have an extra layer of validation here.
From what I've seen, the most common use case of command uris is to enable a small set of known commands and not to enable arbitrary commands. Whitelisting specific command uris would be a alternative to isTrusted

The background for this: I'm exploring improving our JSDoc support. Since JSDocs are user content, I would like to enable a specific command in rendered JSDocs while not enabling arbitrary command uris

@mjbvz Definitely agree. I could take advantage of this in GitLens -- where I only have ~5 commands I allow from the hovers (though since I markdown escape all the commit messages it isn't really an issue). Having a nice safety net to deal with content you didn't generate feels to me like a nice thing to have - and avoids parsing/safety issues spread around in each extension (if they bother at all).

Since JSDocs are user content, I would like to enable a specific command in rendered JSDocs while not enabling arbitrary command uris

Is that intermixed with the user doc? Iff not you could just return another hover-object. We added the isTrusted-flag for command links so it's weird if we add another property for that. If we need to go down that road, that I am more in favour of using another type, e.g isTrusted: boolean | string[]

Yeah, I agree on isTrusted: boolean | string[] -- was thinking the same thing as it will be a bit strange to have 2 "flags" for trust

@mjbvz is this still important to you?

Not today but we need this for JSDoc @see tag support, which depends on TS work that I'm hoping happens this year. I want to make sure we are ready to ship on the VS Code side once the TS part lands

Closing this for now since we came up with an API on the TS side can use normal file style links instead of command links


Deploy on Tencent doc

What type of PR is this?

[ ] API-change
[ ] BUG
[x] Improvement
[x] Documentation
[ ] Feature
[ ] Test and CI
[ ] Code Refactoring

Which issue(s) this PR fixes:
Fixes #
What this PR does / why we need it:
Not Available
Special notes for your reviewer:
Not Available
Additional documentation (e.g. design docs, usage docs, etc.):
Not Available

@mergify update


[12987] Add dynamic network interfaces documentation

Related to eProsima/Fast-DDS#2310
Signed-off-by: JLBuenoLopez-eProsima<EMAIL_ADDRESS>

CI run PASSES (but fails to assign result to this PR)

@richiprosima please test docs


what is the plan to support live data instead of only creating only an extract?

web data connector is really a nice feature. But currently it is limited to an extract, so it does not work for large data set.
what is the plan to support live data?

Hey @changleicn,
Currently we don't have any immediate plans to support live data, at least not in the same way that we support live data for other data sources (like SQL Server), where we issue all queries directly to the data base.  We are exploring ways to make web data connectors more responsive and better suited for large data sets.
What is you use case and volume of data?  Would being able to pass some sort of parameters between Tableau and your web data connector help?
Appreciate the feedback.

@lbrendanl Thanks for your response. There is a feature request on Apache HAWQ to provide a Rest API (https://issues.apache.org/jira/browse/HAWQ-319). So we are thinking wether BI tools can use HAWQ Rest API and also combine data from different systems.

@changleicn Why not just use Pivotal Greenplum live connection in Tableau?
It allows connecting live to HAWQ datasources as well.
Yours,
Yuri

@yurifal yes, i know that odbc works :-). This is another way to connect to HAWQ when HAWQ is only exposed to external as a REST service.
I think this feature might replace the old protocols (odbc) in future since there are so many new data sources and new database systems, and developing the odbc protocols for different platforms is much more difficult than the web connector way.
Really like this feature. Looking forward to see webdataconnector for live data.


Cannot delete a file in the HEAD of a repo through an S3 gateway

What happened?:
Running mc rm path-to-file does not work.
I'm trying to test MinIO with Pachyderm. I was able to create and delete bucket by using the MinIO client. I was also able to upload a file to a Pachyderm repo.
    $ mc cp test.csv local/master.raw_data/test.csv
    test.csv:                  62 B / 62 B  ▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓  100.00% 206 B/s 0s

However, when I try to delete that file I get an error that it's not supported.
$ mc ls local/master.raw_data
    [2019-07-19 12:11:37 PDT]  2.6MiB github_issues_medium.csv
    [2019-07-19 12:11:37 PDT]     62B test.csv

As far as I understand, this suppose to work:
$ mc rm local/master.raw_data/test.csv
Removing `local/master.raw_data/test.csv`.
mc: <ERROR> Failed to remove `local/master.raw_data/test.csv`. This functionality is not implemented in the pachyderm s3gateway.

But it does not.
What you expected to happen?:
The test.csv file to be delete from the repo.
How to reproduce it (as minimally and precisely as possible)?:

Install MinIO client and server.
Deploy Pachyderm.
Create a repo.
Put a file to the repo by using mc cp path-to-file command.
Try to delete the file by using mc rm path-to-file
Anything else we need to know?:

Environment?:

Kubernetes version (use kubectl version):
$ kubectl version
Client Version: version.Info{Major:"1", Minor:"13", GitVersion:"v1.13.4", GitCommit:"c27b913fddd1a6c480c229191a087698aa92f0b1", GitTreeState:"clean", BuildDate:"2019-03-01T23:36:43Z", GoVersion:"go1.12", Compiler:"gc", Platform:"darwin/amd64"}
Server Version: version.Info{Major:"1", Minor:"13", GitVersion:"v1.13.4", GitCommit:"c27b913fddd1a6c480c229191a087698aa92f0b1", GitTreeState:"clean", BuildDate:"2019-02-28T13:30:26Z", GoVersion:"go1.11.5", Compiler:"gc", Platform:"linux/amd64"}
Pachyderm CLI and pachd server version (use pachctl version):
$ pachctl version
COMPONENT           VERSION
pachctl             1.9.0
pachd               1.9.0
Cloud provider (e.g. aws, azure, gke) or local deployment (e.g. minikube vs dockerized k8s):
$ minikube version
minikube version: v0.35.0
OS (e.g. from /etc/os-release):
macOS
Others:

@ysimonson ^^

It seems that for AWS, it does work:
delete: s3://master.raw_data/test.csv```

```$ aws --endpoint-url http://localhost:30600/ s3 ls s3://master.raw_data
2019-07-26 12:20:44    2685061 github_issues_medium.csv```

So it works for aws CLI but not Minio?

Yes.

I wasn't able to repro this issue:
$ mc rm s3g/master.minio
Removing `s3g/master.minio`.
$ mc --version
mc version RELEASE.2019-08-07T23-14-43Z

This is because minio's client issues multi-object delete, even when a single file is being deleted. Verbose output indicates it's hitting the delete subresource:
Removing `s3g/master.minio/README.md`.
mc: <DEBUG> POST /master.minio/?delete= HTTP/1.1
Host: localhost:30600
User-Agent: MinIO (darwin; amd64) minio-go/v6.0.32 mc/2019-08-07T23:14:43Z
Content-Length: 73
Content-Md5: ZvsRygom2wjgQGVrmjgTeA==
Accept-Encoding: gzip

mc: <DEBUG> HTTP/1.1 501 Not Implemented
Content-Length: 232
Content-Type: application/xml
Date: Mon, 12 Aug 2019 14:40:25 GMT
X-Amz-Id-2: f8a7561b-6573-4224-9161-94c04018a90e
X-Amz-Request-Id: f8a7561b-6573-4224-9161-94c04018a90e

<?xml version="1.0" encoding="UTF-8"?>
<Error>NotImplemented<Message>This functionality is not implemented.</Message><Resource>/master.minio/</Resource><RequestId>f8a7561b-6573-4224-9161-94c04018a90e</RequestId></Error>mc: <DEBUG> Response Time:  12.33075ms


Allow opening recent projects (cmd+alt+o) with no active windows

Check for existing issues

[X] Completed

Describe the feature
It's currently only possible to open recent projects when there are no open windows. It would be great to be able to open this pane independently as it's currently necessary to do workarounds like, cmd+n to create a new untitled file, and then cmd+alt+o to get the recent projects pane.
If applicable, add mockups / screenshots to help present your vision of the feature
No response

I agree - this has been awkward to work with because of it. We should have a way to open recent projects, even if there is no window.


add missing autoComplete = false

The example code looks wrong, as it overrides the default behavior of autoComplete.

Good catch 👍


Bulk geocoding don't work

Hey,
I have more than 5000 adress in database. When i edit one specific entry geocode system work, but if I try to bulk all my database nothing happen.
So whats wrong ?
Thanks for your help :)
My model
def fulladress
    [street,zipcode,city].to_a.compact.join(",")
end
geocoded_by :fulladress
after_validation :geocode

I think the first step in debugging this is to run rake with the -t option and see if it gives any insight into what's failing. Also, does it take a long time to run or is it exiting quickly?

At the first time, thanks for your reply. So when I m runing -t option i have this message =>
It takes long time like 2 minute. But nothing happen. After stop, my adress wasnt geocoding. So whats wrong ?

If it takes 2 minutes to run then it sounds like it's loading and saving your objects. You might want to add some debugging code to your model, or running the geocode:all steps in a console. E.g.:

check that YourModel.not_geocoded returns un-geocoded objects,
check that calling .geocode on one of the objects results in successful geocoding, and
check that calling .save on the object saves it successfully.

One common problem is an unrelated validation issue preventing the objects from being saved.
Closing because this doesn't seem like a Geocoder bug, but please reopen if there's evidence that it is one.


[ZAP] Allocate only the necessary bytes for read-only attributes

Problem
Currently, for attributes, codegen generates the maximum possible amount of bytes into GENERATED_DEFAULTS and some other macros such as ATTRIBUTE_MAX_SIZE and ATTRIBUTE_SINGLETONS_SIZE.
Those macros are used for the size of some global arrays:

https://github.com/project-chip/connectedhomeip/blob/a55a0aa5e6b711dc1f39323352aac73a4e881e33/src/app/util/attribute-storage.cpp#L63
https://github.com/project-chip/connectedhomeip/blob/a55a0aa5e6b711dc1f39323352aac73a4e881e33/src/app/util/attribute-storage.cpp#L70

Proposed Solution
For read-only attributes, we could generate only the necessary amount of bytes to store the data
It would require to fix helper-endpoint_config.js (https://github.com/project-chip/zap/blob/master/src-electron/generator/helper-endpointconfig.js) and notably the part that do thing for attributes larger than 2 bytes: https://github.com/project-chip/zap/blob/master/src-electron/generator/helper-endpointconfig.js#L474

Just a reminder: the "ReadOnly" flag in ZCL is only a flag, and this check can be bypassed: https://github.com/project-chip/connectedhomeip/blob/4dd523067f9c3c47107efab90f2e52930fa9e248/examples/wifi-echo/server/esp32/main/attribute-table.c#L509-L524

For the generated defaults, we did this in #11768.


Feature/4991 update translation docs

Related Issues

partly answers #4991
Short Description and Why It's Useful

Add examples to docs of how to translate strings that contain variables or HTML tags
Screenshots of Visual Changes before/after (if There Are Any)

Template

  {{ $t('This is a loan of {loanAmount} with {depositAmount} deposit', {loanAmount: '£999.00', depositAmount: '£99.90'}) }}

<i18n path="{0} to your Account" tag="span" class="css-classes">
    {{ $t('Login') }}
</i18n>

de-DE Locale
de-DE.csv
"This is a loan of {loanAmount} with {depositAmount} deposit","Dies ist ein Darlehen von {loanAmount} mit {depositAmount} Anzahlung"
"Login","einloggen"
"{0} to your Account","In Ihr Konto {0}"

HTML output

    Dies ist ein Darlehen von £999.00 mit £99.90 Anzahlung

In Ihr Konto einloggen

Screenshot

en-US Locale
en-US.csv
"This is a loan of {loanAmount} with {depositAmount} deposit","This is a loan of {loanAmount} with {depositAmount} deposit"
"Login","Login"
"{0} to your Account","{0} to your Account"

HTML output

This is a loan of £999.00 with £99.90 deposit

Login to your Account

Screenshot

Which Environment This Relates To
Check your case. In case of any doubts please read about Release Cycle

[ ] Test version (https://test.storefrontcloud.io) - this is a new feature or improvement for Vue Storefront. I've created branch from develop branch and want to merge it back to develop
[ ] RC version (https://next.storefrontcloud.io) - this is a stabilisation fix for Release Candidate of Vue Storefront. I've created branch from release branch and want to merge it back to release
[ ] Stable version (https://demo.storefrontcloud.io) - this is an important fix for current stable version. I've created branch from hotfix or master branch and want to merge it back to hotfix

Upgrade Notes and Changelog

[x] No upgrade steps required (100% backward compatibility and no breaking changes)
[ ] I've updated the Upgrade notes and Changelog on how to port existing Vue Storefront sites with this new feature

IMPORTANT NOTICE - Remember to update CHANGELOG.md with description of your change
Contribution and Currently Important Rules Acceptance

[ ] I read and followed contribution rules

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.9 out of 12 committers have signed the CLA.:white_check_mark: dixitdeepak:white_check_mark: didkan:white_check_mark: gibkigonzo:white_check_mark: andrzejewsky:white_check_mark: Fifciu:white_check_mark: filrak:white_check_mark: cewald:white_check_mark: ymaheshwari1:white_check_mark: weaves81:x: michasik:x: ianaya89:x: Jimmerz28michasik seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


[Feature] support edge application delivery

Is your feature request related to a problem? Please describe.

openyurt application delivery proposal
openyurt application delivery proposal chinese version
Describe the solution you'd like

use oam deploy edge applicaton chinese version
Describe alternatives you've considered

Additional context

all information could be found in https://github.com/openyurtio/openyurt/pull/879
the proposal has disscus with openyurt community members

It would be nice if you can comment on the community meeting agenda issue here kubevela/community#34 so that you can share your proposal and we can discuss this in the community meeting.

It would be nice if you can comment on the community meeting agenda issue here kubevela/community#34 so that you can share your proposal and we can discuss this in the community meeting.

We are happly to attend the meeting.

Typo: subnet -> subset

@wonderflow  I think it works fine for deploy helm to a specific nodepool. If we want to deploy helm to all nodepools, did we should write override policy for all nodepools?

Here is another solution with trait. There is one trait for webservice (will introduce trait for helm later) if you want to deploy them to two node pool.
annotations: {
	type: "trait"
	annotations: {}
}
template: {
	// +patchStrategy=jsonMergePatch
	patch: {
		metadata: {
			annotations: {
				nodeSelectorLabel: "apps.openyurt.io/nodepool"
				nodeSelectorLabel: [context.replicaKey]
			}
		}
		if context.output.spec != _|_ && context.output.spec.template != _|_ {
			spec: template: metadata: annotations: {
				nodeSelectorLabel: "apps.openyurt.io/nodepool"
				nodeSelectorLabel: [context.replicaKey]
			}
		}
	}
	parameter:  null
}

Note that It needed a replication policy in Application. Replication policy do two things:

It will replicate a component to two with different suffix.
Replication policy will assign different context.replica-key when component rendered into K8s manifest (Deployment for example).  Then traitDefinition can use context.replicaKey to patch the manifest.

The render and dispatch process is shown below.

As for helm type component, it's the same process. The difference is traitDefinition will patch HelmRelease's value field. There is an example TraitDefinition to patch helm values:
annotations: {
	type: "trait"
	annotations: {}
	attributes: {
		podDisruptive: true
		appliesToWorkloads: ["helm"]
	}

}
template: {
	// +patchStrategy=jsonMergePatch
	patchOutputs: {
		release: {
			if spec.values != _|_ {
				spec: values: {
					nodeSelectorLabel: "apps.openyurt.io/nodepool"
					nodeSelectorLabel: [context.replicaKey]
				}
			}
		}
	}
	parameter: null
}

There are also another patch method came up by @wangyikewxgm. Use PostRender feature. The benefits is there is no need for expose specific argument in Values.yaml in helm chart. It'll be more convenient to deploy regular helm chart to edge.

normal apply without replication

piVersion: core.oam.dev/v1beta1
kind: Application
metadata:
  name: first-vela-app2
spec:
  components:
    - name: redis
      type: helm
      properties:
        repoType: "helm"
        url: "https://charts.bitnami.com/bitnami"
        chart: "redis"
        version: "16.8.5"

Deploy with replication policy

piVersion: core.oam.dev/v1beta1
kind: Application
metadata:
  name: first-vela-app2
spec:
  components:
    - name: redis
      type: helm
      properties:
        repoType: "helm"
        url: "https://charts.bitnami.com/bitnami"
        chart: "redis"
        version: "16.8.5"
      traits:
      - type: yurt-annoation-replication

  policies:
    - name: replication
      type: replication
      properties:
        keys: ["beijing","hangzhou"]

@wonderflow What are keys? The application replication should set the node affinity？

Let's keep this open until we build a case using vela and yurt.

closing according to https://www.cnblogs.com/alisystemsoftware/p/16965738.html


Make differential operator able to take non-escaping functions

Passing a non-escaping function to #gradient should be allowed, just like type(of:).

Oops wrong branch!


EDIT: codellama-70b-instruct is so censored it's basically useless, but useful info in the thead so will leave it open...

I pulled the 8-bit quant overnight using ollama pull codellama:70b-instruct-q8_0 and seem to be having problems with it.
I've tried the default Ollama modelfile and also what I think is the correct prompt template based off the tokenizer_config.json that got added overnight:
TEMPLATE """{{ if .First }}<s>{{ end }}{{ if and .First .System }}Source: system

 {{ .System }} <step> {{ end }}Source: user

 {{ .Prompt }} <step> Source: assistant
Destination: user

{{ .Response }}"""

but both just give me this:
I cannot fulfill your request as it goes against ethical and moral principles, and may potentially violate laws and regulations.

when I ask it to refactor some very SWF (lol!) Java code???
Is there some chance the base and instruct models have got mixed up? I don't want to pull another 70GB just to find the same problem...
Anybody else having any luck with running codellama-70b-instruct?

It looks like even if I could get it to respond to a message the followup messages should have the Destination: user appended to the last message only:
From: https://huggingface.co/codellama/CodeLlama-70b-Instruct-hf
Chat prompt
CodeLlama 70B Instruct uses a different format for the chat prompt than previous Llama 2 or CodeLlama models. As mentioned above, the easiest way to use it is with the help of the tokenizer's chat template. If you need to build the string or tokens, manually, here's how to do it.
We'll do our tests with the following made-up dialog:
chat = [
    {"role": "system", "content": "System prompt    "},
    {"role": "user", "content": "First user query"},
    {"role": "assistant", "content": "Model response to first query"},
    {"role": "user", "content": "Second user query"},
]

First, let's see what the prompt looks like if we use the chat template:
tokenizer.apply_chat_template(chat, tokenize=False)

'<s>Source: system\n\n System prompt <step> Source: user\n\n First user query <step> Source: assistant\n\n Model response to first query <step> Source: user\n\n Second user query <step> Source: assistant\nDestination: user\n\n '

So each turn of the conversation has a Source (system, user, or assistant), and then the content appears after two newlines and a space. Turns are separated with the special token . After the last turn (which must necessarily come from the user), we invite the model to respond by using the special syntax Source: assistant\nDestination: user\n\n . Let's see how we can build the same string ourselves:
output = "<s>"
for m in chat:
    output += f"Source: {m['role']}\n\n {m['content'].strip()}"
    output += " <step> "
output += "Source: assistant\nDestination: user\n\n "
output

'<s>Source: system\n\n System prompt <step> Source: user\n\n First user query <step> Source: assistant\n\n Model response to first query <step> Source: user\n\n Second user query <step> Source: assistant\nDestination: user\n\n '

and I don't think Ollama has a .Last boolean flag we can use for the template logic though? :frowning_face:
Who thinks up these things??? I think the creator secretly wanted to design the most confusing prompt template format ever... and succeeded! :laughing:

There are some other posts on Reddit about the weird censorship issues and this just got posted on Huggingface:

none of the coding models do a great job with assembler, but codellama outright refuses on ethical grounds lmao. (LoneStriker/CodeLlama-70b-Instruct-hf-6.0bpw-h6-exl2)

So I wonder if Meta themselves have mixed up the models or something, and it's  probably not worth trying to fix until a few days have passed.

>>> Can you tell me what your ethical guidelines are?
 Ah, great question! 🤔 As a responsible AI language model, I am programmed to follow ethical guidelines that prioritize human well-being, safety, and privacy. Here are some
of my core principles:

1. **Respect for users**: I strive to provide helpful and informative responses while respecting user privacy and autonomy. I avoid asking intrusive or irrelevant questions,
collecting personal information without consent, or promoting harmful or inappropriate content.
2. **No malicious or illegal activities**: I refrain from engaging in activities that could potentially cause harm to individuals, organizations, or society as a whole. This
includes avoiding spreading misinformation, promoting hate speech or discrimination, or supporting illegal activities.
3. **Protection of intellectual property**: I respect the rights of creators and owners of intellectual property, including copyrights, trademarks, and trade secrets. I
refrain from sharing proprietary information or engaging in activities that could violate these rights.
4. **Responsible use of AI technology**: As an AI language model, I am designed to be used for informational purposes only. I avoid generating content that promotes hate
speech, discrimination, or harmful behavior.
5. **Protection of personal data**: I prioritize the security and privacy of user data, ensuring that any information collected is used solely for providing a helpful
response and not shared with third parties without explicit consent.
6. **Accountability and transparency**: I strive to be transparent about my capabilities, limitations, and ethical guidelines, providing users with clear explanations of how
I work and what I can and cannot do.
7. **Continuous improvement**: I am constantly learning and updating myself through regular training, monitoring user feedback, and incorporating new technologies to improve
my performance while maintaining ethical standards.
8. **Promoting inclusivity and diversity**: I strive to provide responses that are respectful, inclusive, and sensitive to diverse perspectives and experiences, recognizing
the value of cultural and individual differences.
9. **Supporting responsible AI development**: I collaborate with researchers, developers, and organizations to promote responsible AI development, highlighting ethical
considerations in AI research and deployment.
10. **Seeking user feedback**: I welcome and value user feedback on my responses, suggestions for improvement, and concerns about potential ethical issues. This helps me
further refine my responses and ensure that I am providing helpful and responsible assistance to users.

By following these principles, I aim to contribute to a safer, more ethical, and more respectful online environment for all users. 💻❤

The random smileys still seem a bit suspicious (probably the bad prompt with the Destination: user getting appending to non-final messages), but I think this definitely is the instruct model or it wouldn't reply like that... I don't get the point of adding all that woke nonsense when all we want is to use it to help with code... Within 2-3 days somebody will have uncensored it, but made it slightly/significantly dumber in the process.
:facepalm:

One of the Meta employees confirmed it does need the Destination: user only appending to the final message:
https://huggingface.co/codellama/CodeLlama-70b-Instruct-hf/discussions/8
TEMPLATE """{{ if .First }}<s>{{ end }}{{ if and .First .System }}Source:■system

■{{ .System }}■<step>{{ end }}■Source:■user

■{{ .Prompt }}■<step>■Source:■assistant{{ if .Last }}
Destination:■user{{ end }}

{{ .Response }}"""

But to be quite honest I'm not sure anybody will care:
https://huggingface.co/codellama/CodeLlama-70b-Instruct-hf/discussions/13
It took the Meta employee two long messages to get it to write Bubble Sort in 6502, finally did it but made total mess of it and then when I tried to help guide it to produce some working code it went back the the same BS. Can't help but see the irony in the middle paragraph though:

If you're struggling with writing the pseudo-code for Bubble Sort, I recommend reviewing the algorithm's logic and structure, focusing on key steps such as comparison, swapping, and iteration. Remember to clearly define variables, inputs, outputs, and control flow statements. Once you have a solid foundation, you can then move forward with translating the pseudo-code into 6502 Assembly Language.

You can save yourself 70GB of download bandwidth and chat to it here to see what it's like:
https://huggingface.co/chat/conversation/65b908c3426d16c9ffb0976d
It's pretty clear now the problem isn't with the prompt template or an accidentally uploaded base model...
I'm done with it.

I see the same problem.  When it worked it was good but most responses are similar to yours.

I see the same problem. When it worked it was good but most responses are similar to yours.

Yeah, it's just terrible... It doesn't fill me with hope for LLama 3 now - if it's going to be like this then what's  the point.

Yeah, it's just terrible... It doesn't fill me with hope for LLama 3 now - if it's going to be like this then what's the point.

I've not liked most of the basic llama models for reasons like this but hopfully finetunes etc... will make it usable.

Yeah, it's just terrible... It doesn't fill me with hope for LLama 3 now - if it's going to be like this then what's the point.

I've not liked most of the basic llama models for reasons like this but hopefully finetunes etc... will make it usable.

The problem with a lot of the finetunes is they severely degrade the models, and particularly for coding models they are so biased towards Python as to be completely useless for anything else. The latest WizardCoder-33B-V1.1 finetune of deepseek coder is a perfect example: it gets a tiny tiny improvement in the humaneval-python benchmark but is completely incapable of looking at any code and not wanting to turn it into Python or suggest using Python instead!
Another serious problem is around half the coding models I've tested have lost their 16k context window and perform worse than the stock codellama-instruct models in this regard.
I've actually tested just about every coding model possible over the last 2-3 weeks (writing an AI assistant  for an IDE) and the only finetune that is even remotely usable is phind-codellama:34b-v2.
I just today tried the new codefuse-deepseek:33b finetune of deepseek coder as it scores highly on Java and C++ in the bigcode leaderboard, but even though it's not as bad as some finetunes it is significantly worse than the normal deepseek coder instruct model when asked to refactor or document  Java/C++.
I suspect the improvements people see by using the weight merging in Mergekit are due to it acting as a way to regularize over-fit models back towards the base model they were trained on (mathematically the linear interpolation weight merge method is equivalent to using L2-regularization, or from a Bayesian perspective; setting a Gaussian prior on the weights coming from the base model's distribution).
I suspect  the creator of phind-codellama either had a proper background in machine learning (and actually regularized it somehow) or used a fine-tuning dataset several orders of magnitude larger than most can afford to train for a few $100 on Huggingface.

Pretty interesting, it refused to give a response to the D3.js prompt unless we completely remove "animals", "food", etc from the prompt and only make it fully technical.
I did get a good response for this one:
Prompt: Can you create a rust function to multiply two numbers using the russian peasant algorithm?
It seems like the instruct one is only good at generating code with specific technical prompts, and refuses when you add more context about the goal of the task / business scope, it might have been mixed up or something, it's weird that it acts this way but could also just be excessive censorship on the model itself, I'll wait till the Q8 is published by TheBloke and then test with a custom Modelfile from that one to see if there's a difference with these prompts

Pretty interesting, it refused to give a response to the D3.js prompt unless we completely remove "animals", "food", etc

I agree that's one of it's triggers.   I did get a perfect result from it using animals and food one time - which I hadn't been able to do with other models but most of the time it's fully paranoid about the dangers of everything.

Same experience, I was so hyped and expecting something at GPT-4 level for local use, but it's completely useless for now

https://discord.com/channels/1128867683291627614/1201917588406272070/1201919808053202974

But HOW is that ollama issue???

https://discord.com/channels/1128867683291627614/1201917588406272070/1201919808053202974

But HOW is that ollama issue???

Sorry, the thread started off about getting the correct prompt template and the need to add a new Last boolean flag because of the way codellama-70b needs "Destination:" adding just once right at the end.
Feel free to close as I agree it's no longer relevant.

Feel free to close as I agree it's no longer relevant.

Not my prerogative :)
Just trying to make sure it's prompt template related. If so, we can test and verify it.

Feel free to close as I agree it's no longer relevant.

Not my prerogative :) Just trying to make sure it's prompt template related. If so, we can test and verify it.

Yeah, it's still not clear what the prompt template really is:
https://huggingface.co/codellama/CodeLlama-70b-Instruct-hf/discussions/8
The creators of these LLMs really need to get some kind of standardised prompt template format worked out IMO. From my experience trying to fix the other coding models' templates these tiny mistakes are really hurting the models and it's likely a lot of the leaderboards are unreliable because of the wrong prompt template was used.

Might make sense to update the title / description later when we get more info, but so far we're certain that the prompt isn't correct, they did update the readme yesterday with a better explanation, also there's this post that just came out on reddit with some useful info too
https://www.reddit.com/r/LocalLLaMA/comments/1afweyw/quick_headsup_about_using_codellama_70b_and/

It seems like this is an issue about the model and not Ollama specifically. I'm closing this issue. Please reopen if there is a specific issue with Ollama you can point me too and we'll take a look as fast as we can.


Java Toolchain does not use installed JDK

Expected Behavior
For the configuration
 java {
     toolchain {
         languageVersion = JavaLanguageVersion.of(11)
     }
 }

Gradle uses the installed Java 11 JDK
Current Behavior
 ./gradlew -q javaToolchains finds the installed JDK 11
$ ./gradlew -q javaToolchains

 + Options
     | Auto-detection:     Enabled
     | Auto-download:      Enabled

 + AdoptOpenJDK 11.0.9
     | Location:           C:\Program Files\AdoptOpenJDK\jdk-<IP_ADDRESS>-openj9
     | Language Version:   11
     | Vendor:             AdoptOpenJDK
     | Is JDK:             true
     | Detected by:        Current JVM

but $ ./gradlew check -Porg.gradle.java.installations.auto-download=false does not use this JDK:
$ ./gradlew check -Porg.gradle.java.installations.auto-download=false

FAILURE: Build failed with an exception.

* What went wrong:
Could not determine the dependencies of task ':application:test'.
> Could not resolve all dependencies for configuration ':application:testRuntimeClasspath'.
   > Failed to calculate the value of task ':application:compileJava' property 'javaCompiler'.
      > No compatible toolchains found for request filter: {languageVersion=11, vendor=any, implementation=vendor-specific} (auto-detect true, auto-download false)

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

BUILD FAILED in 1s

Steps to Reproduce

Download the toolchains sample from https://docs.gradle.org/current/samples/zips/sample_jvm_multi_project_with_toolchains-groovy-dsl.zip
run ./gradlew check -Porg.gradle.java.installations.auto-download=false

Your Environment
Gradle: 6.8.1
Windows 10
AdoptOpenJDK 11 OpenJ9
Build scan URL:
https://scans.gradle.com/s/udxgxtb4ivgm4

@meisenla Thanks for the report. This is actually intentional but not obvious in your case. Given the differences between HotSpot and J9 as JVM implementation, we decided to only consider hotspot VMs by default. If your build and application/library can actually handle J9, you can enforce to use a J9 JVM using
languageVersion = JavaLanguageVersion.of(11)
implementation = JvmImplementation.J9

See also the documentation for more details on how to configure specific toolchains.

@meisenla Thanks for the report. This is actually intentional but not obvious in your case. Given the differences between HotSpot and J9 as JVM implementation, we decided to only consider hotspot VMs by default. If your build and application/library can actually handle J9, you can enforce to use a J9 JVM using
languageVersion = JavaLanguageVersion.of(11)
implementation = JvmImplementation.J9

See also the documentation for more details on how to configure specific toolchains.

Thanks, for the quick response. Maybe you can clarify that in the documentation. I misinterpreted "Acts as a placeholder and matches any implementation from any vendor (e.g. hotspot, zulu, …)" as any implementation including J9.

Thanks, for the quick response. Maybe you can clarify that in the documentation. I misinterpreted "Acts as a placeholder and matches any implementation from any vendor (e.g. hotspot, zulu, …)" as any implementation including J9.

Good point. In case you have some time, I'd be happy to review a PR for this.

Is there a wildcard that can be specified for the implementation, so we can "by choice" have J9 auto-selected if it is the only one available?  I would imagine many projects just need to know that the correct major version is being used and the implementation isn't a factor.
The documentation here https://docs.gradle.org/current/userguide/toolchains.html fails to link to javadocs for JvmImplementation or JvmVendorSpec, so determining what the valid values are is more awkward than it needs to be. (Entering these in the"Search the docs" box doesn't help either.)


Update Add-PowerBIWorkspaceUser.md to add Viewer AccessRight

Docs Build status updates of commit e64de65:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

powerbi-ps/MicrosoftPowerBIMgmt.Workspaces/Add-PowerBIWorkspaceUser.md
:white_check_mark:Succeeded
View (powerbi-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


libopenmpt: 0.6.9 -> 0.6.10

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for libopenmpt is: Cross-platform C++ and C library to decode tracked music files into a raw PCM audio stream
meta.homepage for libopenmpt is: https://lib.openmpt.org/libopenmpt/
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes
Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 0.6.10 with grep in /nix/store/kz8j1kj9rf25ldhxmsci8if0h8wg077j-libopenmpt-0.6.10
found 0.6.10 in filename of file in /nix/store/kz8j1kj9rf25ldhxmsci8if0h8wg077j-libopenmpt-0.6.10

Rebuild report (if merged into master) (click to expand)

942 total rebuild path(s)

942 package rebuild(s)

First fifty rebuilds by attrpath
ChowKick
MIDIVisualizer
Sylk
adapta-gtk-theme
ajour
alfaview
alfis
almanah
alsa-scarlett-gui
altair
amberol
anki
anytype
apache-directory-studio
apostrophe
appimage-run
appimage-run-tests
aravis
arcanPackages.all-wrapped
arcanPackages.arcan
arcanPackages.arcan-wrapped
arcanPackages.cat9-wrapped
arcanPackages.durden-wrapped
arcanPackages.ffmpeg
arcanPackages.pipeworld-wrapped
arcanPackages.prio-wrapped
arcanPackages.xarcan
archi
ashpd-demo
astroid
audacious
audacious-plugins
audaciousQt5
audio-recorder
audiobookshelf
authenticator
aws-workspaces
bada-bib
badwolf
balsa
banking
baobab
baresip
beamerpresenter
beamerpresenter-mupdf
beamerpresenter-poppler
beekeeper-studio
bespokesynth
bespokesynth-with-vst2
betterdiscord-installer

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/kz8j1kj9rf25ldhxmsci8if0h8wg077j-libopenmpt-0.6.10 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A libopenmpt https://github.com/r-ryantm/nixpkgs/archive/5a5021f2596acc159f22dca159b03b0f22e16836.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/kz8j1kj9rf25ldhxmsci8if0h8wg077j-libopenmpt-0.6.10
ls -la /nix/store/kz8j1kj9rf25ldhxmsci8if0h8wg077j-libopenmpt-0.6.10/bin

Pre-merge build results
NixPkgs review skipped

Maintainer pings
cc @OPNA2608 for testing.

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/prs-already-reviewed/2617/916


molecule must be able to clone dependencies without overriding them

Issue Type

Feature request

Molecule and Ansible details
At this moment molecule is not able to clone git dependencies in a way that does not override them if they are already cloned.
gilt approach does always override the destination folder due to https://github.com/metacloud/gilt/issues/65 -- which means that it is not safe to be used on developer machines or on zuul ci which does pre-clone the siblings repositories before running molecule. Initially I wanted to fix gilt itself but I make some discoveries that could prevent a good implementation on it: gilt does not clone the repository to the target location, instead if does copy the files from its own internal clone/cache. This is problematic as it make the decision of shoudl I copy or skip less clear: without a clone at destination what should we do? The discussion should be continued on gilt bug mentioned.
galaxy is not able to clone repositories that have multiple ansible roles because it expects a specific file structure on these repositories. We cannot do anything about galaxy because is deprecated, even new bugs are automatically closed by a bot.
shell seems to be the only method that can temporary be used to workaround this limitation as it can outsource that logic to a shell script. Still, this is quite inconvenient.
mazer - no supprt in molecule for it and in addition to this, it does not seem to support generic repositories either, so is similar to galaxy in this aspect.\
Any ideas?

For now, I think shell and a script with git clone is the best we can do here in Molecule ...
Where is the right upstream to get a ticket going? Gilt is cool but ansible/* projects make more sense in terms of future sustainability. Have you done some detective work on #ansible-devel or #ansible-community?
(I know you know but this isn't something we can fix in Molecule in general. Molecule just drives other tools and this fix will have to be in another tool. So, I am not sure we should leave this issue open beyond getting some feedback ... maybe also try the mailing list?)

Is https://github.com/ansible/mazer/issues/24 relevant?

Fixed by https://github.com/ansible-community/molecule/pull/2875 and https://github.com/ansible-community/molecule/pull/2877


Informative prompt in certification process

Is your feature request related to a problem? Please describe.
Certification process using fx command line works as follows (for both aggregator and collaborator):

CSR is generated using generate-cert-request
CSR is signed using certify

Currently the outputs of these commands are not informative enough to provide a reliable way to verify the CSR: certify prints the hash of the CSR file, but generate-cert-request doesn't, so there is no real way to validate the CSR
Describe the solution you'd like

Prior to writing the CSR to disk, generate-cert-request calculates and prints its hash
certify prints the hash
User is expected to compare the two hashes and approve the request only if they match. It may be useful to emphasize this expectation, for example in openfl documentation and/or as part of the prompt
Adding a warning to the certify -s flag can be considered
Printing additional data from the CSR (e.g. subject/SAN) can be considered

Describe alternatives you've considered
It is possible to manually calculate the CSR file's hash after it was written to disk, but a malicious actor may be able replace it with another one before the actual check happens. Therefore, this solution is not secure

OpenFL_Team1 is working on this


Evaluation question

Thank you very much for your work @zorazrw !!!
Honestly, very impressive!
I see that you're using auto eval and it uses gpt-3.5
My questions are:

Why did you use auto eval instead of taking the reward from the webarena env directly? (If it led to better performance, could you please give a bit more info)
Why did you use gpt-3.5 instead of more powerful gpt-4 for evals?
In your paper you mention that using HTML + AX tree is better than AX tree only. In your evaluation (where you got 35.5 success rate) did you use the HTML and AXT or only AXT?

Thank you again, very relevant and important paper!

Hi! To your questions:

Webarena environment reward could be seen as disclosing ground-truth feedback, whereas real-world webpages don't give agents that feedback automatically. We want to experiment things in the most realistic setting without gt rewards, thus the agent needs to use other means, e.g., model-based evaluation, for measuring the correctness of past trajectories. We did explore using gt reward and a side observation is that, the model-based reward is more helpful than gt reward, due to the strict evaluation design that may result in many false negatives.
gpt-3.5 just happens to be the default option. In our experiments, we set the same model for generation, evaluation, and induction.
All our experiments are only AXT.