no gpu acceleration -- toshiba chromebook 2

I installed crouton on a Toshiba Chromebook 2 (Intel processor), most recently with the following command:
chronos@localhost / $ sudo sh ~/Downloads/crouton -u -r trusty -t unity,xiwi,xorg,extension,audio,core
But there's no GPU acceleration for applications run in Ubuntu: vlc player is too slow to show video, and Unity animations are choppy. Is there a way to fix it?
Thanks!

vlc player is too slow to show video

I'm just curious but why would you play video in a crouton chroot when
chromeos plays it so well?
On Sun, Apr 5, 2015 at 5:32 PM, Jeffrey Regier<EMAIL_ADDRESS>wrote:

I installed crouton on a Toshiba Chromebook 2 (Intel processor), most
recently with the following command:
chronos@localhost / $ sudo sh ~/Downloads/crouton -u -r trusty -t
unity,xiwi,xorg,extension,audio,core
But there's no GPU acceleration for applications run in Ubuntu: vlc player
is too slow to show video, and Unity animations are really choppy. Is there
a way to fix this?
Thanks!
—
Reply to this email directly or view it on GitHub
https://github.com/dnschneid/crouton/issues/1581.

@jeff-regier,
I imagine you are using 'xiwi', run sudo edit-chroot -al to find out.
You can add the 'xorg' target and use it instead of 'xiwi' if you like.
Enter: sudo sh ~/Downloads/crouton -t xorg -n trusty -u
Then enter your chroot using: sudo startunity -X xorg.
Most likely, you won't need the -X since 'xorg' should now be the default xmethod.

@DennisLfromGA Thanks for the solution. It's working really well now!
@mark-hahn  vlc plays some file types that chrome os doesn't, has more controls, and I'll probably be logged into Ubuntu more often than not, so vlc is my default. The chrome os player is nice too though!

vlc plays some file types that chrome os doesn't,

May I suggest plex?  It is awesome, especially with chromecast.
On Sun, Apr 5, 2015 at 6:17 PM, Jeffrey Regier<EMAIL_ADDRESS>wrote:

@DennisLfromGA https://github.com/DennisLfromGA Thanks for the
solution. It's working really well now!
@mark-hahn https://github.com/mark-hahn vlc plays some file types that
chrome os doesn't, has more controls, and I'll probably be logged into
Ubuntu more often than not, so vlc is my default. The chrome os player is
nice too though!
—
Reply to this email directly or view it on GitHub
https://github.com/dnschneid/crouton/issues/1581#issuecomment-89878190.

Stop
On Apr 5, 2015 9:29 PM, "mark-hahn"<EMAIL_ADDRESS>wrote:

vlc plays some file types that chrome os doesn't,

May I suggest plex? It is awesome, especially with chromecast.
On Sun, Apr 5, 2015 at 6:17 PM, Jeffrey Regier<EMAIL_ADDRESS>wrote:

@DennisLfromGA https://github.com/DennisLfromGA Thanks for the
solution. It's working really well now!
@mark-hahn https://github.com/mark-hahn vlc plays some file types that
chrome os doesn't, has more controls, and I'll probably be logged into
Ubuntu more often than not, so vlc is my default. The chrome os player is
nice too though!
—
Reply to this email directly or view it on GitHub
<https://github.com/dnschneid/crouton/issues/1581#issuecomment-89878190
.

—
Reply to this email directly or view it on GitHub
https://github.com/dnschneid/crouton/issues/1581#issuecomment-89880499.

Stop?
On Sun, Apr 5, 2015 at 6:30 PM, batman1111<EMAIL_ADDRESS>wrote:

Stop
On Apr 5, 2015 9:29 PM, "mark-hahn"<EMAIL_ADDRESS>wrote:

vlc plays some file types that chrome os doesn't,

May I suggest plex? It is awesome, especially with chromecast.
On Sun, Apr 5, 2015 at 6:17 PM, Jeffrey Regier<EMAIL_ADDRESS>wrote:

@DennisLfromGA https://github.com/DennisLfromGA Thanks for the
solution. It's working really well now!
@mark-hahn https://github.com/mark-hahn vlc plays some file types
that
chrome os doesn't, has more controls, and I'll probably be logged into
Ubuntu more often than not, so vlc is my default. The chrome os player
is
nice too though!
—
Reply to this email directly or view it on GitHub
<
https://github.com/dnschneid/crouton/issues/1581#issuecomment-89878190
.

—
Reply to this email directly or view it on GitHub
<https://github.com/dnschneid/crouton/issues/1581#issuecomment-89880499
.

—
Reply to this email directly or view it on GitHub
https://github.com/dnschneid/crouton/issues/1581#issuecomment-89880592.


⚠ Bofrost.es has degraded performance

In aa479c8, Bofrost.es (https://www.bofrost.es) experienced degraded performance:

HTTP code: 200
Response time: 1532 ms

Resolved: Bofrost.es performance has improved in d206d5c after 6 minutes.


 This story enables the user
to provide a list of patterns to be excluded from precaching. User can specify
"excludePrecachePatterns" field in the overrides configmap. Using the command
"grep -vG -f {patterns-file}" precaching will filter out the patterns specified.
Below is an example of override configmap with excludePrecachePatterns:
apiVersion: v1
kind: ConfigMap
metadata:
  name: cluster-group-upgrade-overrides
data:
  excludePrecachePatterns: |
    aws
    thanos

closes:
https://issues.redhat.com/browse/OCPBUGS-3092
https://issues.redhat.com/browse/CNF-6848
Signed-off-by: Saeid Askari<EMAIL_ADDRESS>

/hold

/unhold


Make cf() return an option

This is in response to issue #353
I understand that this change is technically a breaking change. Another option is to silently add the cf field to any requests constructed. There are situations, like for the mail events, where there is no request to copy from.
Bearing this all in mind, the cf field is wrapped in Option on the request struct, and therefore having the cf() method also return an Option would make sense.
small example
There're more details in the linked issue (in the workerd repo), but the issue can be seen for example in an upstream TS service calls a bound rust worker. Something like:
let new_request = new Request("https://foo.com", { method: "POST", body: request.body })

Here a new request is being made, but the cf property is not being copied over.  On the other hand something like
env.B.fetch(new Request("https://foo.com", request))

copies over the cf properties from the initial request from the client.

Sorry this took so long, I was on vacation and then had a nasty deadline I had to hit. I want to make a minor doc change so I'll merge this into it's own branch where I can update later. Thanks for the PR!

No worries, hope you enjoyed your vacation, and thanks for eventual merge.


Rjd 1278/traffic simulator update

Description
Abstract
This PR contains revisions of the traffic_simulator package unit tests.
Details
Changes are minimal, their main purpose is to unify the source code with previously adopted rules.
Tests have been sorted.
Tests that have been refactored, now contain descriptions.
List of tests updated in this PR:

helper.constructActionStatus
helper.constructLaneletPose
helper.constructRPY
helper.constructRPYfromQuaternion
helper.constructPose
helper.constructLidarConfiguration
helper.constructDetectionSensorConfiguration
SimulationClock.SimulationClock
TrafficLightManager.getTrafficLight
TrafficLightManager.getTrafficLights_setColor
TrafficLightManager.getTrafficLights_setArrow
Color.Color
Color.make
Color.make_wrong
Status.Status
Status.make
Status.make_wrong
Shape.Shape
Shape.make
Shape.make_wrong
Bulb.Bulb
Bulb.make
Bulb.make_wrong
Bulb.operator_TrafficLight
TrafficLight.contains_colorStatusShape
TrafficLight.set_valid

References
Jira ticket: internal link
Destructive Changes
There are no destructive changes.

I have encountered an issue with github CI. I did not change this file in this PR; last change was made 3 years ago.

github link


Connection dialog should bring connections in alphabetical order.

Observed in chrome.

@stoch I am not able to reproduce the problem, however I have seen that uppercase letters are sorted before lowercase letters due to their ascii value. Should we sort the connections using a case insensitive comparison ? or was this related to something else.

Seen in Chrome on ZHH management Version 1.6.1


Update Rust Nightly Version

Fix a new Rust Nightly version

Auto-generated PR

It uses the nightly nightly-2021-01-03-x86_64-unknown-linux-gnu' and the first error occurred here:
https://github.com/geo-engine/geoengine/actions/runs/460416008
which uses 2021-01-04, rust version 1.51.0-nightly (80184183b 2021-01-03)
So the PR should be fine

It uses the nightly nightly-2021-01-03-x86_64-unknown-linux-gnu' and the first error occurred here:
https://github.com/geo-engine/geoengine/actions/runs/460416008
which uses 2021-01-04, rust version 1.51.0-nightly (80184183b 2021-01-03)
So the PR should be fine


Remove client-side filtering of autocomplete requests by layer

Mapzen Search API supports the layers parameter natively for autocomplete queries now! See this discussion. https://github.com/pelias/api/issues/449.
Previously I added some code to do some filtering of the results on the client-side, but now that the API sends only the layers requested for /autocomplete, the client side filtering code is no longer necessary (or helpful). So I've removed it.
Although this removes "functionality," it is because the Search API already provides it, so no difference in behavior should be observable and this is a minor version bump.

Looks great! Removing code is always so satisfying! :+1:


Add Volume to QuoteBar

QuoteBar does not provide volumes, but my broker Oanda provides volumes, and since all instruments are managed as QuoteBar, I dont have access to volumes in Lean.
Is it possible to add this feature?

@ebengtso  Yea I'm aware. But getting volume and syncing it with data is cumbersome on the backend (I talked about this already), and not everyone needs the volume, so that's why it's the way it is. My opinion is actually that volume shouldn't be in anything (stocks or forex or whatever) and should be it's own indicator/data feed, but yea....
Anyway it's in the university for FXCM, BasicTemplateFxcmVolumeAlgorithm
You know, you could make us an OandA version if you just copy and paste all related FxcmVolume code (It's all there in the ToolBox) :+1:

@ebengtso Oh, there is already a OandaDownloader, perhaps it can be extended with whatever volume changes you made?

I thought that a coherent solution with tradebar and quotebar both hosting volumes would make sense.
Can you elaborate more about the sync issue with data? The volumes for Oanda are provided together with prices in a single shot, so I don’t understand the issue.

Yea sorry, I don't know the details. @jaredbroad

I'm not sure adding 'volume' to quote bar makes complete sense. I understand that oanda provides this data, but at it's core, a quote bar doesn't have any volume.

@ebengtso Can you please point out where you are seeing Volume in OandA's software?

sorry for delaying my reply. i've been away from trading lately, but now i'm back to the market.
Please find below an example of output from Oanda's instrument API. The volumes provided are Oanda trades only.
https://developer.oanda.com/rest-live-v20/instrument-ep/
{   "candles": [     {       "ask": {         "c": "1.31469",          "h": "1.31520",          "l": "1.31467",          "o": "1.31509"       },        "bid": {         "c": "1.31454",          "h": "1.31502",          "l": "1.31450",          "o": "1.31493"       },        "complete": true,        "time": "2016-10-17T15:00:00.000000000Z",        "volume": 70     },
Oanda provide the volumes, so would be a shame not to use them. However, ultimately I don't want to use Oanda volumes because it does not reflect the market, but I want to retrieve volumes from the original futures contract that Oanda is mirroring, in my case the instruments are commodities listed on CME.
I understand that Quotes are not Trade, but many times we have market data mixed with quote data, and to keep it practical, it would be great to not complicate the architecture in sake of purity.
In meanwhile, I have two options: add volume to quotebar in my lean fork, or create a new indicator for swap and fetch data from oanda, cme, others.

@erikbengtson Hey, welcome back. I still think making an OandAVolume is the right way to go for now.

Hi,
Here is a custom OandaDownloader and OandaVolume custom data
https://github.com/ebengtso/quant/tree/master/OandaDataProvider

any opinion about this feature request?
I would like to implement the brokerage Saxo Bank and without this functionality I have to double the data flows, one to retrieve the bid/ask and another one to retrieve complementary information via indicators. Technically it's not a good architecture, and there is a risk of non synchronized Quote data against indicator data.
What I would like to do is to enrich the Bar indicator with a custom object, that every time we retrieve the quote from the broker, we complete the QuoteBar object with a custom object containing the additional information we have received.
As outsider, it's looks for me that we just need to add a generic Object to the QuoteBar so that any brokerage implementation can put whatever data they want there. Maybe its not that simple, any thoughts?
Please check these 3 snippets with samples of complementary data.

when I get quotes, I can retrieve volumes traded for the instrument at the exchange. It's not broker volumes, dark  pools or whatever. These figures are provided by the broker based on free or payed subscriptions.

See this example - price info:
{   "Data": [     {       "AssetType": "FxSpot",       "DisplayAndFormat": {         "Currency": "AUD",         "Decimals": 4,         "Description": "British Pound/Australian Dollar",         "Format": "AllowDecimalPips",         "OrderDecimals": 4,         "Symbol": "GBPAUD"       },       "HistoricalChanges": {         "PercentChange1Month": 1.21,         "PercentChange2Months": 2.95,         "PercentChange3Months": 1.85,         "PercentChange6Months": -1.83,         "PercentChangeDaily": 0.22,         "PercentChangeWeekly": 1.67       },       "InstrumentPriceDetails": {         "IsMarketOpen": true,         "ShortTradeDisabled": false,         "ValueDate": "2017-05-19"       },       "LastUpdated": "0001-01-01T00:00:00Z",       "PriceInfo": {         "High": 1.09117,         "Low": 1.08853,         "NetChange": 0.00048,         "PercentChange": 0.04       },       "PriceInfoDetails": {         "AskSize": 1000000.0,         "BidSize": 1000000.0,         "LastClose": 1.08932,         "LastTraded": 0.0,         "LastTradedSize": 0.0,         "Open": 0.0,         "Volume": 0.0       },       "Quote": {         "Amount": 100000,         "Ask": 1.74948,         "Bid": 1.74858,         "DelayedByMinutes": 15,         "ErrorCode": "None",         "Mid": 1.74903,         "PriceTypeAsk": "Indicative",         "PriceTypeBid": "Indicative"       },       "Uic": 22     },     {       "AssetType": "FxSpot",       "DisplayAndFormat": {         "Currency": "CAD",         "Decimals": 4,         "Description": "British Pound/Canadian Dollar",         "Format": "AllowDecimalPips",         "OrderDecimals": 4,         "Symbol": "GBPCAD"       },       "InstrumentPriceDetails": {         "IsMarketOpen": true,         "ShortTradeDisabled": false,         "ValueDate": "2017-05-19"       },       "LastUpdated": "0001-01-01T00:00:00Z",       "Quote": {         "Amount": 100000,         "Ask": 1.76278,         "Bid": 1.76198,         "DelayedByMinutes": 15,         "ErrorCode": "None",         "Mid": 1.76238,         "PriceTypeAsk": "Indicative",         "PriceTypeBid": "Indicative"       },       "Uic": 23     }   ] }
Also, please check this another example, I can also retrieve Market Depth Level 2, again it's a payed subscription
{   "Ask": [     1.76671,     1.76676,     1.76706   ],   "AskOrders": [     0.0,     0.0,     0.0   ],   "AskSize": [     4000000.0,     7000000.0,     10000000.0   ],   "Bid": [     1.76591,     1.76586,     1.76556   ],   "BidOrders": [     0.0,     0.0,     0.0   ],   "BidSize": [     4000000.0,     7000000.0,     10000000.0   ],   "Level2PriceFeed": false,   "NoOfBids": 3,   "NoOfOffers": 3,   "UsingOrders": false }

Here is additional options data.

{   "ContextId": "20211113100758607",   "Format": "application/json",   "InactivityTimeout": 30,   "ReferenceId": "IP61042",   "RefreshRate": 1000,   "Snapshot": {     "AssetType": "FxSpot",     "DisplayAndFormat": {       "Currency": "AUD",       "Decimals": 4,       "Description": "British Pound/Australian Dollar",       "Format": "AllowDecimalPips",       "StrikeDecimals": 4,       "StrikeFormat": "Normal",       "Symbol": "GBPAUD"     },     "HistoricalChanges": {       "PercentChange1Month": 5.57,       "PercentChange2Months": 5.83,       "PercentChange3Months": 3.73,       "PercentChange6Months": 6.49,       "PercentChangeDaily": 0.2,       "PercentChangeWeekly": 0.88     },     "InstrumentPriceDetails": {       "AverageVolume": 12345000.0,       "Barrier": 1.0,       "ExpiryDate": "2017-06-01",       "IsMarketOpen": true,       "LowerBarrier": -2.0,       "MidForwardPrice": 1.71992423552514,       "ShortTradeDisabled": false,       "SpotAsk": 1.71782,       "SpotBid": 1.71692,       "SpotDate": "2017-06-03",       "SpreadStrikePriceLower": 11.0,       "SpreadStrikePriceUpper": 12.0,       "StrikePrice": 1.7175,       "UpperBarrier": 4.0,       "ValueDate": "2017-06-05"     },     "LastUpdated": "2017-05-01T00:00:00Z",     "Quote": {       "Amount": 100000,       "Ask": 0.02257,       "Bid": 0.01962,       "DelayedByMinutes": 15,       "ErrorCode": "None",       "Mid": 0.0210958157864443,       "PriceTypeAsk": "Indicative",       "PriceTypeBid": "Indicative",       "RFQState": "None"     },     "Uic": 22   },   "State": "Active",   "Tag": "PAGE1" }

Should I use Slices? It seems that it's capable to host any data there. Can I create a brokerage and use slices instead of the quotebars or traderbas?
Thanks

Would like to see this implemented as well in QuoteBar if it's still in the pipeline. I believe Oanda's API still provides volume data so why not? Despite it being broker/client tick "volume" and not true volume of FOREX markets, could still be a moderately useful data source.


Citation

How should Dotspatial be cited in an academic paper? Thank you.

DotSpatial itself hasn't been introduced in an academic publication,
however we have generally cited other work that makes use of it, as well as
it's original MapWindow beginnings, for example:
Ames, Daniel P., Christopher Michaelis, and Ted Dunsford. "Introducing the
MapWindow GIS project." OSGeo Journal 2, no. 1 (2007).
Ames, Daniel P., Christopher Michaelis, Allen Anselmo, Lailin Chen, and
Harold Dunsford. "MapWindow GIS." In Encyclopedia of GIS, pp. 633-634.
Springer US, 2008.
Ames, Daniel P., Jeffery S. Horsburgh, Yang Cao, Jiří Kadlec, Timothy
Whiteaker, and David Valentine. "HydroDesktop: Web services-based software
for hydrologic data discovery, download, visualization, and analysis."
Environmental
Modelling & Software 37 (2012): 146-156.
Cao, Yang, and Daniel P. Ames. "A strategy for integrating open source GIS
toolboxes for geoprocessing and data analysis." (2012).
Cao, Yang, and Daniel P. Ames. "Development and Implementation of an
Extensible Interface-Based Spatiotemporal Geoprocessing and Modeling
Toolbox." In AGU Fall Meeting Abstracts. 2011.
Of course you can also cite the Github repository as a URL citation
depending on if your journal accepts such citations.
Hope this helps.

Dan

On Thu, Mar 1, 2018 at 3:37 PM snahdog<EMAIL_ADDRESS>wrote:

How should Dotspatial be cited in an academic paper? Thank you.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/DotSpatial/DotSpatial/issues/1133, or mute the thread
https://github.com/notifications/unsubscribe-auth/ADT89Lls40Q72w0nXn1ad2sd4NUrlQ0aks5taHg9gaJpZM4SZHAh
.

Thank you.


highlight hovered cell on map

dirty method: redraw entire plot on every mousemove event
hard method: make redraw method intelligent enough that small areas can be altered and reverted
currently probably not worth the time and effort

probably better alternative: put a 2nd canvas on top of the map for drawing of ui related visuals

hovered cells are highlighted now


Import GEO platform definitions

We can incorporate the GEO platform names to better standardize our platform definitions. https://www.ncbi.nlm.nih.gov/geo/browse/?view=platforms&tool=findplatform
There are currently 22k+ platforms. We could possibly apply some date-based filtering (e.g. maybe only platforms post-2010 or so?)  and species filtering if this is too many platforms.

Closing as a wont-do, at least for now. Conclusion: the platform definitions on GEO have a level of specificity that we don't capture in our "platform" definition; they tend to be a combination of platform+species+sometimes other stuff.


missing "repository.json"

To be added as repo in home assistence need to have in root  repository.json with following  content:
{
    "name": "tuya-local add-on",
    "url": "https://github.com/make-all/tuya-local",
    "maintainer": "Jason Rumney<EMAIL_ADDRESS>}

This is not an add-on.  Add-on's are separate docker containers that run separate applications from Home Assistant.
This is a custom component.  The easiest way to manage custom components is using the HACS custom component from https://hacs.xyz/

This is not an add-on.  Add-on's are separate docker containers that run separate applications from Home Assistant.
This is a custom component.  The easiest way to manage custom components is using the HACS custom component from https://hacs.xyz/


BASTICO has no active jobs in Romania and on the ejobs website

ENVIRONMENT: production
URL: https://peviitor.ro/
Browser: Microsoft Edge
Device: Laptop
OS: Windows 10
STEPS TO REPRODUCE:
1. Open https://solr.peviitor.ro/
2. Go to "BASTICO" Company
3. Open the "BASTICO" website and eJobs website
4. Check the valid jobs in Romania

EXPECTED RESULTS:
Bastico has the job "Cargo Survey" active in Romania, location Constanta
ACTUAL RESULTS:
Bastico has no active jobs in Romania

Removed the expired job. The company should automatically delete.

This company is no longer on the peviitor website!


DevAudit not identifying Drupal version correctly

On the http://<IP_ADDRESS>/drupal8/admin/modules page I can see that there are security updates for my installed version.
On http://<IP_ADDRESS>/drupal8/admin/reports/updates/update I can see my installed version is 8.0.3 and there is a new 8.1.2 version available.
But when I run DevAudit I see that the detected version is "8.x" and it is telling me that there are no vulnerabilities. I don't believe it :)
I presume the detected 8.x version is why it is not finding applicable vulnerabilities. We need to find the real installed version.

It appears the proper versions are being reported at this time.


The icon in the navigation bar does not become yellow, when using the online editor

Describe the bug
Usually, unsaved edits during an exam are highlighted by a yellow icon in the exam's navigation bar. However, when working on a programming exercise with the online editor, the icons are not becoming yellow.
To Reproduce

Take an exam with a programming exercise
Edit a file with the online code editor and observe the navigation bar for the exercises of the exam.

Expected behavior
Every unsaved change should be highlighted by a yellow icon.
Screenshots
Notice the "Unsaved" at the bottom of the file browser and the all-blue navigation bar for the exercises.

Environment
Chrome on Windows
Firefox on MacOS (shown in the screenshot)

This has worked before and seems to be a regression


Incompatible with RN 0.75.2 - > Task :react-native-fast-image:compileDebugJavaWithJavac FAILED

Describe the bug
I created a brand new empty RN project with version 0.75.2 and now I'm getting this error:
> Task :react-native-fast-image:compileDebugJavaWithJavac FAILED

> Task :app:processDebugManifestForPackage
43 actionable tasks: 24 executed, 19 up-to-date

info 💡 Tip: Make sure that you have set up your development environment correctly, by running npx react-native doctor. To read more about doctor command visit: https://github.com/react-native-community/cli/blob/main/packages/cli-doctor/README.md#doctor

Note: [2] Wrote GeneratedAppGlideModule with: [com.bumptech.glide.integration.okhttp3.OkHttpLibraryGlideModule, com.dylanvann.fastimage.FastImageOkHttpProgressGlideModule]
C:\Users\xxx\AwesomeProject\node_modules\react-native-fast-image\android\src\main\java\com\dylanvann\fastimage\FastImageSource.java:72: error: isResource() in FastImageSource cannot override isResource() in ImageSource
    public boolean isResource() {
                   ^
  overridden method is final
C:\Users\xxx\AwesomeProject\node_modules\react-native-fast-image\android\src\main\java\com\dylanvann\fastimage\FastImageSource.java:101: error: getUri() in FastImageSource cannot override getUri() in ImageSource
    public Uri getUri() {
               ^
  overridden method is final
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
2 errors

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':react-native-fast-image:compileDebugJavaWithJavac'.
> Compilation failed; see the compiler error output for details.

* Try:
> Run with --info option to get more log output.
> Run with --scan to get full insights.

BUILD FAILED in 7s

To Reproduce
Steps to reproduce the behavior if possible, or a link to a reproduction repo:

Create a new react native project with no framework
run npm install react-native-fast-image
See error

Expected behavior
I expect the app ro build with no issues,
Dependency versions

React Native version: 0.75.2
React version: 18.3.1
React Native Fast Image version: ^8.6.3

++same here

the same

the same

same

same++

You need to patch the library
react-native-fast-image+8.6.3.patch

same for me

same

Moved our projects over to https://github.com/candlefinance/faster-image. Solid alternative.

@pTinosq Issue has  been fixed in @d11/react-native-fast-image

same

Updated react-native to 0.75.4, worked for me!


reform-rails 0.2.2 breaks the build

the output (of the html being tested) for the failed test contains:
<input class=\"is-invalid form-control is-invalid\" pattern=\"[a-z0-9._%+-]+@[a-z0-9-]+\\.([a-z]{2,63})+\" type=\"email\" value=\"\" name=\"collection_version[contact_emails_attributes][0][email]\" id=\"collection_version_contact_emails_attributes_0_email\" />

the expectation is:
expect(response.body).to include 'input class="form-control is-invalid"'

see https://github.com/sul-dlss/happy-heron/pull/1294#issuecomment-805099018 and #1295

This just seems like a poorly written test as the order of the CSS class doesn't matter.


Updated input generation script

added config template to be populated with newly generated data and used by the integration tests
fixed get_chip_from_anno.sh to sync batch names in the prepared basic info and chip table (db)
updated integration tests

@RigbeGW I squashed all commits into one to cleanup history and refactored integration tests as recommented.


In-Memory Engine:  State collection and region eviction

In-Memory Engine: State collection and region eviction
Parent issue: #16141
State collection

[ ] Gather statistics on top N regions based on a heuristic
[ ] Heuristic: by the number of read or write queries over a window
[ ] Heuristic:  by the number of MVCC versions in region's range (TBD: cumulative or over a window?)

Loading and eviction

[ ] Load or evict when region changes
[ ] Evaluate and fine-tune heuristics

/assign @afeinberg


Add GitHub Desktop [beta] v0.5.3

After making all changes to the cask:

[x] brew cask audit --download {{cask_file}} is error-free.
[x] brew cask style --fix {{cask_file}} reports no offenses.
[x] The commit message includes the cask’s name and version.
[x] Named the cask according to the token reference.
[x] brew cask install {{cask_file}} worked successfully.
[x] brew cask uninstall {{cask_file}} worked successfully.
[x] Checked there are no open pull requests for the same cask.
[x] Checked the cask was not already refused in closed issues.
[x] Checked the cask is submitted to the correct repo.

Thank you for the contribution.
In the future, please do not bundle all the checklist points like you did now. It breaks pattern and makes it harder to check what you’ve done.
Also, Github is touting this beta as the main app, so it belongs in the main repo, as per the documentation (emphasis added):

When an App is only available as beta, development, or unstable versions, or in cases where such a version is the general standard, then said version can go into the main repo.

Please submit there.

@danielbayley please use versioned link, it can be obtained by running wget against official link to latest beta release.
$ wget https://central.github.com/deployments/desktop/desktop/latest/darwin
--2017-05-18 18:32:21--  https://central.github.com/deployments/desktop/desktop/latest/darwin
Resolving central.github.com... <IP_ADDRESS>
Connecting to central.github.com|<IP_ADDRESS>|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://desktop.githubusercontent.com/releases/0.5.5-47a3bf36/GitHubDesktop.zip [following]

@vitorgalvao Will do… in that case then, should it be an update to the existing github-desktop.rb cask, as opposed to github-desktop-beta.rb?
@yurikoles So that would be:
version '0.5.5'
url "https://desktop.githubusercontent.com/releases/#{version}-47a3bf36/GitHubDesktop.zip"

…right?

in that case then, should it be an update to the existing github-desktop.rb cask, as opposed to github-desktop-beta.rb?

Yes.

version '0.5.5'
url "https://desktop.githubusercontent.com/releases/#{version}-47a3bf36/GitHubDesktop.zip"

No. It should be

version '0.5.5-47a3bf36'
url "https://desktop.githubusercontent.com/releases/#{version}/GitHubDesktop.zip"

@vitorgalvao Cool.
Won't the discrepancy between url 'desktop.githubusercontent.com and appcast 'github.com throw up an error on style checking? Obviously, they are both actually GitHub, so would the "verified" comment above the URL still be necessary here?

so would the "verified" comment above the URL still be necessary here?

Yes.


Line continuations can only work with spaces after them

issotm@link-panda tmp.kWMeWsvG5v% printf "PRINTT \\ \t\n\"Hello\"" | rgbasm -
error: Expected a new line after the continuation character.

Shouldn't isspace(3) be used instead?

I would avoid using isspace() because its behavior depends on the locale. RGBDS should have its own function to determine what characters are whitespace.

Fixed in 6fbb25c

Fixed in 6fbb25c


Fine tune gpt to only perform desired functionality (TBC)

To increase demonstrability, it might be worthwhile to finetune gpt model to only perform our desired functionality - sending email and reading documents - rather than arbitrary questions and answers.
this could help us to make our prompt injection attacks/defences more specific and possibly more successful.
To do

decide on exactly what we want the model to do and not to do
fine tune to set of actions e.g. https://openai.com/blog/customizing-gpt-3

Closing because this is effectively same as setting a system role


[WIP] Thumbor Python 3 upgrade.

This is the first working setup of thumbor with python 3 on zulip server. While everythings appears to be working, testing is still remaining.
NOTE:

We need to update our fork of libthumbor to 2.0.1
Currently using commits in thumbor.in for tc_aws and thumbor instead of pip releases.

Next steps:

Move thumbor from a separate venv to zulip-py3-venv. (FEEDBACK - NEEDED Do we need a separate venv for thumbor? @timabbott FYI)
Testing

Move thumbor from a separate venv to zulip-py3-venv. (FEEDBACK - NEEDED Do we need a separate venv for thumbor? @timabbott FYI)

IIRC Thumbor used to be part of the same virtualenv before the migration to PY3, and so obviously we want it back to be in the same virtualenv eventually.

That sounds reasonable. Thanks!

I disagree; we still want a separate venv for thumbor.  Otherwise, if thumbor gets stuck on an old version of some dependency, we can't upgrade that in Zulip.  The Python version mismatch isn't the main reason for a separate venv.

We need to update our fork of libthumbor to 2.0.1

Can we just get our forked changes merged upstream, if they aren't already?  I think our fork was just a couple bug fixes that hadn't been merged upstream.

For the non-thumbor requirements files, can you just do a separate PR updating those?  I think we'll want to do that in master independent of the thumbor work, and it'd be nice to declutter the diff.

Can we just get our forked changes merged upstream, if they aren't already? I think our fork was just a couple bug fixes that hadn't been merged upstream.

We were improving upon their pip setup for installation. I don't think it's relevant now since they moved from pip to peotry for installing packages. So, now we can directly use their pip release.

OK, I think we've merged most of the prep commits that this upgrade requires; can you do an update on this branch?
Also, is the stuff we're merged sufficient that @arpit551 can work on re-enabling CI for Ubuntu Focal?

@amanagr is there any version of this we can integrate for 2.2?  I don't super care about actually being able to run thumbor in 2.2, but it would be really nice to get to delete the Python 2.7 venv logic.
(Still a lower priority than message-editing and recent topics stuff, so only if this is easy)

I don't think it would be possible without breaking our aws support for thumbor, https://github.com/thumbor-community/aws/pull/142 still is the blocker. Also, thumbor/thumbor is still ALPHA for it's python3 release, which would be scary to use in a new release.

OK, but keep in mind:

Thumbor is not running in production anywhere as far as I know (It ran on chat.zulip.org for a few weeks, and that's it), because it's an unfinished feature.
Nobody has ever used our AWS support for thumbor.

So the only code that we're actually running in production is the code that creates the thumbor venv, today.  For that reason, as long as it doesn't break CI, it seems like it'd be a step forward to integrate upgrading to the Thumbor on Python 3, potentially using alphas of their integrations like that one; it'd make our not-running code closer to usable (and make it easier to do the testing that might help get that PR merged).

I agree with that assessment. At this point, removing Python 2 is much more important than keeping Thumbor totally stable.

I squashed most of the commits together where the intermediate state doesn’t make sense, rebased on master, upgraded Thumbor to 7.0.0a5, and upgraded all other packages.

Thanks @andersk.

Merged, thanks folks!


feat: add new roles and playbooks and update inventory and group_vars variables

Updated Inventory and Group Variables.
Added a new roles to configure ntp, grub, libvirt, user_management, apt packages, netbase, ubuntu root password, sysctl parameters, disable_swap.
Added new playbooks in accordance with newly added roles.

Overall - please use one commit per change/feature. These large commits will make it impossible to revert. Also please sign every commit. Other comments will follow for specific files.

Please add README files to all new roles. It should look something similar to this https://github.com/beskar-cloud/infra-config/tree/taikun-infra/roles/hosts_file

As discussed We are closing this PR and will create new one with more reliable changes


JOSS / AAS paper

I think blasé is the one framework in our trifecta (w/ muler, gollum) that may deserve the royal treatment:  Both an AAS Journals paper and an affiliated (linked) JOSS paper.  So I have gone ahead and made a JOSS short paper with a long statement of need.
The AAS Journals paper will be the pacing item.  Maybe aim for a mid-March timescale for that one?  That would put:

muler: February
blase 1 and 2:  March
gollum: April

We achieved the muler paper schedule, or close to it.  This blase paper has taken longer because we added the new telluric modelling capability, which added complexity.  We're currently on pace for a June submission, but only with some sprinting (#40)


Android9.0, there is no message reminder after the screen is locked, the message pops up after unlocking

Android9.0 and Android8.0，there is no message reminder after the screen is locked. After the unlocking, the message pops up, and the lock screen is accepted on the mobile phone to accept the notification. What is the reason? Very anxious, thanks。

Howdy,
Could you please follow our issue template so we can better assist you?

Notification only works when the app it's open. Minimized or closed (ended process) not working at all.
"react": "16.8.6",
"react-native": "0.60.4",
"react-native-onesignal": "^3.3.0",

I forgot that for Zenfone it require extra steps to allow the notifications, now it's working partially. It still not working with the phone locked.

@rochapablo Can you check the setting noted below for the Asus Zenfone?
https://www.verizonwireless.com/support/knowledge-base-214566/

This problem has been solved, I set the permission to open the lock screen notification in the Android project:
1,
2, final Window win = getWindow();
         win.addFlags(WindowManager.LayoutParams.FLAG_SHOW_WHEN_LOCKED / / display in lock screen state
                 | WindowManager.LayoutParams.FLAG_DISMISS_KEYGUARD //Unlock
                 | WindowManager.LayoutParams.FLAG_TURN_SCREEN_ON); //Open the screen

@1129530686 Can you provide more detail on how this fixed your issue? Adding settings to the window doesn't fit into how this would affect a notification.

@rochapablo Can you check the setting noted below for the Asus Zenfone?
https://www.verizonwireless.com/support/knowledge-base-214566/

Already working with Show all notification


Feature Request: On waking

So we can add dream messages, as well as things like living in biomes.

@Yulife This one will need a trigger icon for it eventually. Probably just a bed, or Zzz?


help on visulize results

Hi. thanks for project.
I tried test.py for wflw images, but when i draw predicted points on source image, it fails. Any help would be appricated.

You can check this repository for landmark visualization


Docs: tensor.md

Small update + addition of reshape and expand.
 I'll fix.

 I'll fix.


Add device component experiment metadata

Summary
This PR adds a device_components field to the experiment metadata for experiments that use custom components (just ResonatorSpectroscopy so far). It also exposes device components in the documentation and updates the custom experiment tutorial. #1163 depends on this PR to add the metadata so that non-qubit components can be correctly identified for figure names.

That's a good suggestion @nkanazawa1989, I've made device_components populated by Qubits by default in BaseExperiment. I also exposed index in DeviceComponent subclasses as per @wshanks's feedback.


Added a new battery format for showing charging status

It shows "On" for charging and shows the percentage otherwise. Made it the
default.

Would be really nice to see this, any comments? Very useful to see if your laptop is actually plugged in or not.

The problem with this is, it uses polling to know the status. It'd be great if we could handle an event to know the status. I don't really know how to do that.

One possibility would be to listen for the 'changed' signal in the UPower DBus API.  Whenever the state changes, you could read the 'OnBattery' property.  The interplay with suspend/resume might be annoying, but UPower claims to send those signals, too.
http://upower.freedesktop.org/docs/UPower.html

This PR has been superseded by #147 , although we can probably borrow ideas from this into the code, now that we have a handler for state.


Get an MVP Up!

MVP: Minimal Viable Product
We need to be able to start WRITING...this is a blog :) We can continuously improve the site as we keep writing. I don't think we'll ever be truly happy with the site, so we'll always be making improvements :)
so that means, lets define what we need to consider the site ready for us to release to www.never-a-bad.com.
i'm thinking we need a handful of things:

content
remove references to poole
configure things to be about never-a-bad, like the site title, etc.
add home page content, etc.

thoughts?

latest pushed branch should have this stuff, requesting PR!

i broked it :(
secret access key no longer publicly visible so I made the repo public again. I think I broke travis with the switching too...
I'm thinking it might have something to do with a lack of _site?
full log on https://s3.amazonaws.com/archive.travis-ci.org/jobs/47048552/log.txt

is it private or public?
you didn't remove it from git: https://github.com/necampanini/never-a-bad/commit/dfacaffb01c8191f10c3ce58089d8cab241f1305
it was committed. it will be in the history unless it's been removed explicitly. i believe it shouldn't be a problem as long as you've disabled the keys. but your best bet is to research how to scrub it from history.
here's an example of removing a file: https://help.github.com/articles/remove-sensitive-data/
in our case,  i could do a rebase to remove the commit. it'll cause a hiccup, but it'll be worth the fix. thoughts?

just read the logs: yup, it says _site is missing:
/home/travis/.rvm/gems/ruby-1.9.3-p551/gems/dpl-1.7.9/lib/dpl/provider/s3.rb:37:in `chdir': No such file or directory - _site (Errno::ENOENT)

...running it locally, 1 sec.

seems like it works, but the latest error is:
- ./_site/about/index.html
  *  External link http://sixpoint.com/ failed: got a time out
htmlproof 1.6.0 | Error:  HTML-Proofer found 1 failures!

https://travis-ci.org/necampanini/never-a-bad/builds/47070077

yea, thought i took out that link through the edit function on github, wasn't sure how to make travis pick that up

Tried the git filter-branch thing with .travis.yml as the targeted file....
I don't think it did anything on this repo...

When possible, can we walk through adding home content and such? Most of the other issues involved in a MVP are resolved, and I wanted to start using the blog as a research project diary. I've been asked to research a certain topic and I'd like to use this blog in a professional capacity.


Prevent dragging from SceneTree buttons

This fixes #10026

Disables the possibility to drag a node from its icon buttons

To determine whether it's dragging from the icon buttons, a Tree:: get_button_id_at_position public method is added

Why not get_button_at_position? While button ID is a standalone value, button index does not make much sense without item/column around. Get button ID makes the method simple.
Why not is_button_at_position? As a public method, this seems too limited to a single application.

@timothyqiu Is this still desired? If so, it needs to be rebased on the latest master branch. While there are no conflicts, rebasing is important so that reviewers can easily test the PR.

Rebased :)

Thanks!

Cherry-picked for 3.2.3.


Pin django-mppt and south requirements; use core.taggit by default

Newer versions are not compatible with this project.
See https://github.com/cfpb/idea-box/issues/97#issuecomment-308565741 and https://github.com/cfpb/idea-box/issues/95#issuecomment-175143283
@m3brown Any reason you know of that this would be a bad idea?

I have no idea what to do about the build failures. It ran fine on my machine with Python 2.7.10. @richaagarwal, would you be able to take a look?

Updated to use core.taggit by default, as well. See https://github.com/cfpb/idea-box/issues/97#issuecomment-308568617

Managed to get the tests passing by walking back various dependencies to their last known working versions! I'll give @richaagarwal a little time to review before merging.

@Scotchester Reviewing now!

Oh, just realized we're in an app I've never used. I'm not familiar with this but pinning requirements seems fine?  If you'd like me to test it locally etc. I'll need a little more time to get that all set up.

If you want to give it a try, the instructions in the README are fairly
straightforward, but I'm comfortable meeting with just your looking over
it, if you are.
On Jun 14, 2017 4:59 PM, "Richa Agarwal"<EMAIL_ADDRESS>wrote:

Oh, just realized we're in an app I've never used. I'm not familiar with
this but pinning requirements seems fine? If you'd like me to test it
locally etc. I'll need a little more time to get that all set up.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/cfpb/idea-box/pull/98#issuecomment-308581735, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AA_wvvUMgE0X7VN4rn3Ep-dwhfeS48IAks5sEGXogaJpZM4N6ejP
.

Yeah, feel free to merge ;)


Remember field data idea

@julio8a proposed we have a way for the author to specify a field as "rememberable" so that it would save a cookie or local storage of what was entered for that field. The idea is that name/address/email or sorts of things like that wouldn't have to be filled out again if a user uses the form multiple times.
The cookie data would need to be based off of the unique app id and form field i suppose.
Thoughts?

I think this would be nice to have. I am using a form for my call takers during emergency events. It would be nice not to have to enter in their name every time for the call taker.

this can be handled with default values in 4x version


Identify conda and windows store environments from given interpreter path

This API is not consumed any where. This is adding all the low-level APIs we need for environment identification. In this PR, there is code to identify conda and windows store environments.

Codecov Report

Merging #13589 into master will decrease coverage by 0.13%.
The diff coverage is 69.76%.

@@            Coverage Diff             @@
##           master   #13589      +/-   ##
==========================================
- Coverage   59.86%   59.72%   -0.14%
==========================================
  Files         670      671       +1
  Lines       37295    37476     +181
  Branches     5335     5379      +44
==========================================
+ Hits        22326    22383      +57
- Misses      13815    13923     +108
- Partials     1154     1170      +16

Impacted Files
Coverage Δ

...t/pythonEnvironments/discovery/locators/helpers.ts
70.58% <0.00%> (ø)

src/client/common/utils/platform.ts
56.00% <37.50%> (-20.48%)
:arrow_down:

...pythonEnvironments/common/environmentIdentifier.ts
79.41% <79.41%> (ø)

src/client/pythonEnvironments/info/index.ts
41.53% <0.00%> (-27.43%)
:arrow_down:

src/client/datascience/crossProcessLock.ts
79.41% <0.00%> (-11.77%)
:arrow_down:

src/client/datascience/jupyter/kernels/helpers.ts
35.51% <0.00%> (-10.27%)
:arrow_down:

...rc/client/pythonEnvironments/info/pythonVersion.ts
87.87% <0.00%> (-8.68%)
:arrow_down:

...nt/datascience/notebookStorage/vscNotebookModel.ts
61.11% <0.00%> (-4.80%)
:arrow_down:

src/client/datascience/jupyter/jupyterSession.ts
72.34% <0.00%> (-4.77%)
:arrow_down:

... and 22 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3fd9e8a...5bfb4fa. Read the comment docs.

Should this logic really be in a single low-level component? It seems strange that there's a bunch of code that's "common", but which contains conda-specific details in practice - shouldn't that all be in the conda locator instead?

Since we don't have the templates for the (new) locators ready. I am putting them here for now. My plan is to move the isConda, isWindowsStore, etc, into respective locators. Even there i think these would be exposed as flat functions. Since they don't really need any state.
As for the identifyEnvironment function itself, is supposed to be a generic identifier, which should handle cases where user just provides a path. When we have locator manager, I will use that to run through and get the environment type. That way I can get rid of calling specific locator checks. and ensure that we prioritize the type appropriately.


Add privacy manifest for Apollo targets

Closes apollographql/apollo-ios#3328

I think we may need to add that file extension to the podspec too - resource_bundles

@calvincestari Yea we would need to have projects for each dependency manager, archive them, and then inspect the archive I think to ensure the privacy manifest was in the archive. But no I'm not sure that's necessary for this honestly.
Maybe something we can look at fixing separately if its not directly related to these changes?


User documentation

Write extensive usage documentation before release.

User documentation is written in sphinx, since phpdocumentor does not entirely work on source files which include PHP 7 type/return hinting.

Using doxygen for automated code documentation.

Resolved, https://slaxweb.github.io/Framework-Docs/


Github actions provides inconsistent macos-13 runner versions

Description
Github actions provides inconsistent macos-13 runner versions.
This is similar to https://github.com/actions/runner-images/issues/9568, which reports inconsistent macos-14 runner versions.
Platforms affected

[ ] Azure DevOps
[X] GitHub Actions - Standard Runners
[ ] GitHub Actions - Larger Runners

Runner images affected

[ ] Ubuntu 20.04
[ ] Ubuntu 22.04
[ ] macOS 11
[ ] macOS 12
[X] macOS 13
[ ] macOS 13 Arm64
[ ] macOS 14
[ ] macOS 14 Arm64
[ ] Windows Server 2019
[ ] Windows Server 2022

Image version and build link
https://github.com/marcindulak/github-actions-runner-images-9595/actions/runs/8494165449/job/23268975511
Is it regression?
No
Expected behavior
The "Version: YYYYMMDD.N" is consistent across jobs
Runner Image
  Image: macos-13
  Version: YYYYMMDD.N

Actual behavior
Two out of 10 jobs use
Runner Image
  Image: macos-13
  Version: 20240219.1

The rest uses
Runner Image
  Image: macos-13
  Version: 20240327.2

Repro steps
Trigger https://github.com/marcindulak/github-actions-runner-images-9595 a few times.

Hey @marcindulak. We will take a look

Should be fixed now, with 20240327.2 being consistent


Navbar items not properly center aligned

Describe the bug
Navbar items (brand logo and buttons) are not properly justified to center (vertically). As a result there's more spacing at the bottom, while less spacing at the top.
To Reproduce
Steps to reproduce the behavior:

Go to circuitverse
Scroll down a bit
Once the navbar seperator line appears, you can see the error.

Expected behavior
The Navbar should have been properly aligned to center.
Screenshots

Device Information [optional]:

OS: Fedora 37
Browser Microsoft Edge (Chromium based)

Additional context
Add any other context about the problem here.
Are you working on this issue? (Yes/No)
Yes

hey I would like to work on this issue. Can you assign it to me?

Can I Work on this  Issue please assign it to me.

I would like to work on this issue, could you assign me?


Merging Develop into Master 11.6.2018 - rDNS release note

Hello @ksigler7,Thanks again for the PR! We appreciate your contribution and look forward to                                              continued collaboration. Thanks!                                             Team SendGrid DX


HostingListener timeout causes incorrect error message

If an application takes longer than a few seconds to startup and fire diagnostic events, it causes NSwag to error out saying the assembly is missing certain methods which just isn't true.
The timeout occurs here, with the default timeout value being defined here.
Error Message received:

NSwag requires the assembly [AssemblyNameHere], Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=null to have either an BuildWebHost or CreateWebHostBuilder/CreateHostBuilder method. See https://docs.microsoft.com/en-us/aspnet/core/fundamentals/hosting?tabs=aspnetcore2x for suggestions on ways to refactor your startup type.

Potential solutions

[ ] Increase the default timeout period (it seems that v14 has lowered it to 5 seconds?)
[ ] Add support for allowing users to specify their own default timeout in cases where their applications need it

+1 this is impacting me.

We have had the same timeouts. It occurred on our side due to missing Environment Variables and the usage of GetRequiredSection in the program.cs. Even with a greater timeout, if the startup won't succeed, this error will still occur.


expired certificate

Can someone please have a look at the certificate of pgt-api-server.debian.net? It seems to be expired today.
$ dh-make-golang create-salsa-project golang-gonum-v1-gonum
2021/07/16 21:40:13 Post https://pgt-api-server.debian.net/v1/createrepo?repo=golang-gonum-v1-gonum: x509: certificate has expired or is not yet valid

I think @stapelberg is the one who used to maintain the service but I'm not sure if it's still the case since he has take a step back from Debian.

Should now be fixed. Had to rebuild the pgt-api-server binary because LetsEncrypt turned down ACMEv1.

Thanks a lot! 🎉


when executes the OPT 6.7B model evaluation, the problem TypeError: 'NoneType' object is not iterable occur

Running loglikelihood requests:   0%|                                                                                | 0/18330 [00:00<?, ?it/s]

the error info is
  File "/usr/local/lib/python3.10/dist-packages/lm_eval/models/vllm_causallms.py", line 493, in _parse_logprobs
    continuation_logprobs_dicts = [
  File "/usr/local/lib/python3.10/dist-packages/lm_eval/models/vllm_causallms.py", line 448, in _loglikelihood_tokens
    answer = self._parse_logprobs(
  File "/usr/local/lib/python3.10/dist-packages/lm_eval/api/model.py", line 371, in loglikelihood
    return self._loglikelihood_tokens(new_reqs, disable_tqdm=disable_tqdm)
  File "/usr/local/lib/python3.10/dist-packages/lm_eval/evaluator.py", line 449, in evaluate
    resps = getattr(lm, reqtype)(cloned_reqs)
  File "/usr/local/lib/python3.10/dist-packages/lm_eval/utils.py", line 395, in _wrapper
    return fn(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/lm_eval/evaluator.py", line 277, in simple_evaluate
    results = evaluate(
  File "/usr/local/lib/python3.10/dist-packages/lm_eval/utils.py", line 395, in _wrapper
    return fn(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/lm_eval/__main__.py", line 375, in cli_evaluate
    results = evaluator.simple_evaluate(
  File "/usr/local/bin/lm-eval", line 8, in <module>
    sys.exit(cli_evaluate())
  File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main (Current frame)
    return _run_code(code, main_globals, None,
TypeError: 'NoneType' object is not iterable

The command I use is simple as follows:
/usr/local/bin/lm-eval --model vllm --model_args pretrained=/mnt/self-define/songquanheng/model/opt-6.7b,tensor_parallel_size=1,gpu_memory_utilization=0.8 --tasks lambada_openai,arc_easy,piqa --device cuda:0

The code releated with this error  is
  @staticmethod
    def _parse_logprobs(tokens: List, outputs, ctxlen: int) -> Tuple[float, bool]:
        """Process logprobs and tokens.

        :param tokens: list
            Input tokens (potentially left-truncated)
        :param outputs: RequestOutput
            Contains prompt_logprobs
        :param ctxlen: int
            Length of context (so we can slice them away and only keep the predictions)
        :return:
            continuation_logprobs: float
                Log probabilities of continuation tokens
            is_greedy: bool
                Whether argmax matches given continuation exactly
        """

        # The first entry of prompt_logprobs is None because the model has no previous tokens to condition on.
        continuation_logprobs_dicts = outputs.prompt_logprobs

        def coerce_logprob_to_num(logprob):
            # vLLM changed the return type of logprobs from float
            # to a Logprob object storing the float value + extra data
            # (https://github.com/vllm-project/vllm/pull/3065).
            # If we are dealing with vllm's Logprob object, return
            # the logprob value stored as an attribute. Otherwise,
            # return the object itself (which should be a float
            # for older versions of vLLM).
            return getattr(logprob, "logprob", logprob)

        continuation_logprobs_dicts = [
            {
                token: coerce_logprob_to_num(logprob)
                for token, logprob in logprob_dict.items()
            }
            if logprob_dict is not None
            else None
            for logprob_dict in continuation_logprobs_dicts
        ]

        # Calculate continuation_logprobs
        # assume ctxlen always >= 1
        continuation_logprobs = sum(
            logprob_dict.get(token)
            for token, logprob_dict in zip(
                tokens[ctxlen:], continuation_logprobs_dicts[ctxlen:]
            )
        )

so what is wrong with this execution, and what can i do to solve this problem

Hi, is there any more to the error output than what you've shared?
Does your locally saved OPT model differ at all from the one downloaded directly from HF?
I ran the command you provided on my machine and did not replicate the error you were getting.

Yes, I save the OPT model at local directory. when I use the lm-eval command, lm-eval --tasks list cannot generate valid outputs.

when using the model value of "hf", it will work well.

root@145206f3e691:/mnt/self-define/sunning/lmdeploy/vllm_test# lm_eval --model vllm --model_args pretrained=/mnt/self-define/songquanheng/model/opt-6.7b --tasks arc_easy --device cuda:0
INFO 08-06 02:41:19 llm_engine.py:103] Initializing an LLM engine (v0.4.2) with config: model='/mnt/self-define/songquanheng/model/opt-6.7b', speculative_config=None, tokenizer='/mnt/self-define/songquanheng/model/opt-6.7b', skip_tokenizer_init=False, tokenizer_mode=auto, revision=None, tokenizer_revision=None, trust_remote_code=False, dtype=torch.float16, max_seq_len=2048, download_dir=None, load_format=LoadFormat.AUTO, tensor_parallel_size=1, disable_custom_all_reduce=False, quantization=None, enforce_eager=False, kv_cache_dtype=auto, quantization_param_path=None, device_config=cuda, decoding_config=DecodingConfig(guided_decoding_backend='outlines'), seed=1234, served_model_name=/mnt/self-define/songquanheng/model/opt-6.7b)
INFO 08-06 02:41:19 selector.py:37] Using FlashAttention-2 backend.
INFO 08-06 02:41:28 model_runner.py:145] Loading model weights took 12.4036 GB
INFO 08-06 02:41:29 gpu_executor.py:83] # GPU blocks: 2816, # CPU blocks: 512
INFO 08-06 02:41:34 model_runner.py:824] Capturing the model for CUDA graphs. This may lead to unexpected consequences if the model is not static. To run the model in eager mode, set 'enforce_eager=True' or use '--enforce-eager' in the CLI.
INFO 08-06 02:41:34 model_runner.py:828] CUDA graphs can take additional 1~3 GiB memory per GPU. If you are running out of memory, consider decreasing `gpu_memory_utilization` or enforcing eager mode. You can also reduce the `max_num_seqs` as needed to decrease memory usage.
INFO 08-06 02:41:55 model_runner.py:894] Graph capturing finished in 21 secs.
100%|█████████████████████████████████████████████████████████████████████████████████████████████| 2376/2376 [00:01<00:00, 1403.64it/s]
Running loglikelihood requests:   0%|                                                                          | 0/9501 [00:00<?, ?it/s][rank0]: Traceback (most recent call last):
[rank0]:   File "/usr/local/bin/lm_eval", line 8, in <module>
[rank0]:     sys.exit(cli_evaluate())
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/lm_eval/__main__.py", line 375, in cli_evaluate
[rank0]:     results = evaluator.simple_evaluate(
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/lm_eval/utils.py", line 395, in _wrapper
[rank0]:     return fn(*args, **kwargs)
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/lm_eval/evaluator.py", line 277, in simple_evaluate
[rank0]:     results = evaluate(
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/lm_eval/utils.py", line 395, in _wrapper
[rank0]:     return fn(*args, **kwargs)
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/lm_eval/evaluator.py", line 449, in evaluate
[rank0]:     resps = getattr(lm, reqtype)(cloned_reqs)
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/lm_eval/api/model.py", line 371, in loglikelihood
[rank0]:     return self._loglikelihood_tokens(new_reqs, disable_tqdm=disable_tqdm)
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/lm_eval/models/vllm_causallms.py", line 448, in _loglikelihood_tokens
[rank0]:     answer = self._parse_logprobs(
[rank0]:   File "/usr/local/lib/python3.10/dist-packages/lm_eval/models/vllm_causallms.py", line 493, in _parse_logprobs
[rank0]:     continuation_logprobs_dicts = [
[rank0]: TypeError: 'NoneType' object is not iterable
Running loglikelihood requests:   0%|                                                                          | 0/9501 [00:00<?, ?it/s]
root@145206f3e691:/mnt/self-define/sunning/lmdeploy/vllm_test#

it is the running output. I donot know why.

@haileyschoelkopf This problem has failed me somedays, Do you know
                answer = self._parse_logprobs(
                    tokens=inp,
                    outputs=output,
                    ctxlen=ctxlen,
                )

    def _parse_logprobs(tokens: List, outputs, ctxlen: int) -> Tuple[float, bool]:
        """Process logprobs and tokens.

        :param tokens: list
            Input tokens (potentially left-truncated)
        :param outputs: RequestOutput
            Contains prompt_logprobs
        :param ctxlen: int
            Length of context (so we can slice them away and only keep the predictions)
        :return:
            continuation_logprobs: float
                Log probabilities of continuation tokens
            is_greedy: bool
                Whether argmax matches given continuation exactly
        """

        # The first entry of prompt_logprobs is None because the model has no previous tokens to condition on.
        continuation_logprobs_dicts = outputs.prompt_logprobs

outputs.prompt_logprobs represents what meaning？

ns/ms-python.debugpy-2024.0.0-linux-x64/bundled/libs/debugpy/adapter/../../debugpy/launcher 32781 -- /usr/local/bin/lm-eval --model vllm --model_args pretrained=/mnt/self-define/zhangweixing/model/llama2-7b-hf,gpu_memory_utilization=0.8 --tasks arc_easy --device cuda:0
INFO 08-06 09:29:33 llm_engine.py:103] Initializing an LLM engine (v0.4.2) with config: model='/mnt/self-define/zhangweixing/model/llama2-7b-hf', speculative_config=None, tokenizer='/mnt/self-define/zhangweixing/model/llama2-7b-hf', skip_tokenizer_init=False, tokenizer_mode=auto, revision=None, tokenizer_revision=None, trust_remote_code=False, dtype=torch.float16, max_seq_len=4096, download_dir=None, load_format=LoadFormat.AUTO, tensor_parallel_size=1, disable_custom_all_reduce=False, quantization=None, enforce_eager=False, kv_cache_dtype=auto, quantization_param_path=None, device_config=cuda, decoding_config=DecodingConfig(guided_decoding_backend='outlines'), seed=1234, served_model_name=/mnt/self-define/zhangweixing/model/llama2-7b-hf)
INFO 08-06 09:29:33 selector.py:37] Using FlashAttention-2 backend.
INFO 08-06 09:29:41 model_runner.py:145] Loading model weights took 12.5523 GB
INFO 08-06 09:29:42 gpu_executor.py:83] # GPU blocks: 2321, # CPU blocks: 512
INFO 08-06 09:29:44 model_runner.py:824] Capturing the model for CUDA graphs. This may lead to unexpected consequences if the model is not static. To run the model in eager mode, set 'enforce_eager=True' or use '--enforce-eager' in the CLI.
INFO 08-06 09:29:44 model_runner.py:828] CUDA graphs can take additional 1~3 GiB memory per GPU. If you are running out of memory, consider decreasing `gpu_memory_utilization` or enforcing eager mode. You can also reduce the `max_num_seqs` as needed to decrease memory usage.
INFO 08-06 09:29:51 model_runner.py:894] Graph capturing finished in 8 secs.
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2376/2376 [00:07<00:00, 327.01it/s]
Running loglikelihood requests:   0%|                                                                                | 0/9501 [00:00<?, ?it/s]

在运行lolikelihood requests，outputs.prompt_logprobs is None,  I tried the LLama 2 7B， encounter same question

vllm version 0.4.2. I tried at another environment which is not container env, but also encounter this problem


Redesign of message template editor

Description
Redesign of message template editor:
https://www.figma.com/design/lwL5jneveZczAj5RLcLFH2/DIAL-Chat?node-id=12326-85217&t=toHcFk5x2G7JfxM7-1
Use case/motivation
No response
Related issues
No response
Confidential information

[X] I confirm that do not share any confidential information

Please update also the test on the Message Template form
Should be:
Copy a part of the message into the first input and provide a template with template variables into the second input.

Verified on staging env successfully along with other fixes. See also #2291


Default threads enviornment variable override

Expose opts.NumThread as env variable OLLAMA_THREADS for override.

This would be great to have. I was trying out ollama with continue.dev but they didn't expose the threads parameter and end up freezing my system for each completion. :P

This is a mess, I'll re-submit at some point.


Test: canonical URIs

https://github.com/microsoft/vscode/issues/93368

[ ] macOS @chrmarti
[ ] Windows @lszomoru
[ ] Linux @RMacfarlane

Complexity: 4
Authors: @jrieken @bpasero
Create Issue

Canonical URIs respect the file system providers case-sensitivity capability. Given a file system that is case-insensitive (e.g. macOS, Windows in most cases), the first creator of a canonical URI defines its casing and subsequent URIs of different casing will have the same canonical form.
The following is an example where canonical URIs help a lot:

a user opens a file path/someFile.c from the explorer
an extension produces markers by parsing the output of a compilation task
the task decides to output file paths in lowercase
the task finds an error in the file the user opened and emits a marker for path/somefile.c
the user wants to open a marker from this output and clicks it
at this point we would open a second editor for path/somefile.c even though the user already had the file opened with different casing

With canonical URIs, the user defined the canonical URI to be path/someFile.c when opening it. Even though the output is using path/somefile.c form, the markers are being created with the path/someFile.c path and thus match. You will only end up with a single editor opening, not two.
Canonical URIs have been adopted in the following places:

any editor that opens
any extension creating a document (vscode.workspace.openTextDocument)
any marker that is created from an extension

Test

opening editors with different casing only opens different editors on Linux, but same editors on Windows/macOS (e.g. try with producing links in the terminal or links in a text document)
you can still rename files or parent folders to the same name but different case from the explorer and things continue to work as normal (note: a known issue is that the case change is not reflected in the editor because canonical URIs currently have no lifecycle)
create an extension that produces markers with different casing and verify the scenario from above
create an extension that uses the vscode.workspace.openTextDocument API and ensure that only on Linux you get different models for different casing

@bpasero With markers you mean TextEditor.setDecorations() in the extension API?

Yeah, the API is using the diagnostic collection. Something like this is what I have
const diag = vscode.languages.createDiagnosticCollection('muhaha');

	for (let path of [
		'/Users/jrieken/Code/_samples/devfest/foo/TEST.less',
		'/Users/jrieken/Code/_samples/devfest/foo/TEST.ts'
	]) {
		const uri = vscode.Uri.file(path);
		const d = new vscode.Diagnostic(new vscode.Range(0, 0, 1, 0), 'casing matters', vscode.DiagnosticSeverity.Information);
		diag.set(uri, [d])
	}

Thanks. Also found a nice sample: https://github.com/microsoft/vscode-extension-samples/tree/master/diagnostic-related-information-sample


Add Roadmap to handbook

Migrated from GitLab: https://gitlab.com/meltano/meltano/-/issues/2673
Originally created by @tayloramurphy on 2021-03-24 20:50:58

https://gitlab.com/meltano/meta/-/issues/20

View 2 previous comments from the original issue on GitLab


 Because of this the PRs can not be merged.
To Reproduce
Every commit pushed onto the thin-edge.io repo is causing this issue
Expected behavior
"cargo outdated" check should pass.
Screenshots
Find the error logs below
Run actions-rs/cargo@v1
with:
command: outdated
use-cross: false
env:
CARGO_TERM_COLOR: always
/usr/share/rust/.cargo/bin/cargo outdated
thread 'main' panicked at 'package cache lock is not currently held, Cargo forgot to call acquire_package_cache_lock before we got to this stack frame', /usr/share/rust/.cargo/registry/src/github.com-1ecc6299db9ec823/cargo-0.57.0/src/cargo/util/config/mod.rs:1542:9
note: run with RUST_BACKTRACE=1 environment variable to display a backtrace
Error: The process '/usr/share/rust/.cargo/bin/cargo' failed with exit code 101
Environment (please complete the following information):

OS [ubuntu]
Hardware [x86]
System-Architecture [github hosted runner]
thin-edge.io version [e.g. 0.4.2]

Additional context
The workaround is to remove the mandatory check on cargo outdated so that the PRs can be merged.

It seems specific combination of cargo version and cargo-outdated fails to compile. For example, with cargo 1.52.0 version, failed to compile cargo-outdated 0.10.2 (latest).
It's fine with the combination of

cargo 1.52.0 & cargo-outdated 0.9.17
cargo 1.56.0 & cargo-outdated 0.10.2
I think the first step we should take is to print out cargo version and cargo plugin versions in our pipeline. I'm doing now. It's difficult to debug without version infos...

Our workflow uses cargo 1.56.0 and cargo-outdated 0.10.0. Unfortunately, this combination brings an error when we run cargo outdated. The fix is to use cargo-outdated 0.10.2.

#595 moved this to commit-workflow-optional. At least we don't block merging or triggering other workflows.

With cache, cargo always uses version 0.10.0, which is broken even though we have a step cargo install cargo-outdated --version 0.10.2. Now we disable whole commit-workflow-optional as all jobs there are failing. Keep this ticket open.

As of now, we have cargo outdated in our commit-workflow-optional, and there is no issue. Hence, I'd close this issue.


Product id sequence can overflow

Cubedash gen fails in the Geoscience Australia dev deployment and presumably in production. Failure occurred about a month ago , showing the delayed NRT products in the link above however recent improvements to logging have surfaced them. The NRT streams are functional and OWS can see them :

Failure mode is lot of messages as below per product:
NOTICE:  identifier "dashgen-fc-percentile-albers-seasonal agdc-1.8.1.dev22+gc2c25d3d" will be truncated to "dashgen-fc-percentile-albers-seasonal agdc-1.8.1.dev22+gc2c25d3"
2020-06-19T07:07:29.650249Z [exception] generate.product.error         product=ga_s2a_ard_nbar_granule
Traceback (most recent call last):
  File "/env/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1284, in _execute_context
    cursor, statement, parameters, context
  File "/env/lib/python3.6/site-packages/sqlalchemy/engine/default.py", line 590, in do_execute
    cursor.execute(statement, parameters)
psycopg2.errors.SequenceGeneratorLimitExceeded: nextval: reached maximum value of sequence "product_id_seq" (32767)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/env/lib/python3.6/site-packages/cubedash/generate.py", line 46, in generate_report
    store.refresh_product(product, refresh_older_than=refresh_time)
  File "/env/lib/python3.6/site-packages/cubedash/summary/_stores.py", line 181, in refresh_product
    derived_products=derived_products,
  File "/env/lib/python3.6/site-packages/cubedash/summary/_stores.py", line 388, in _set_product_extent
    .values(name=product.name, **fields)
  File "/env/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 2244, in execute
    return connection.execute(statement, *multiparams, **params)
  File "/env/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1020, in execute
    return meth(self, multiparams, params)
  File "/env/lib/python3.6/site-packages/sqlalchemy/sql/elements.py", line 298, in _execute_on_connection
    return connection._execute_clauseelement(self, multiparams, params)
  File "/env/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1139, in _execute_clauseelement
    distilled_params,
  File "/env/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1324, in _execute_context
    e, statement, parameters, cursor, context
  File "/env/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1518, in _handle_dbapi_exception
    sqlalchemy_exception, with_traceback=exc_info[2], from_=e
  File "/env/lib/python3.6/site-packages/sqlalchemy/util/compat.py", line 178, in raise_
    raise exception
  File "/env/lib/python3.6/site-packages/sqlalchemy/engine/base.py", line 1284, in _execute_context
    cursor, statement, parameters, context
  File "/env/lib/python3.6/site-packages/sqlalchemy/engine/default.py", line 590, in do_execute
    cursor.execute(statement, parameters)
sqlalchemy.exc.DataError: (psycopg2.errors.SequenceGeneratorLimitExceeded) nextval: reached maximum value of sequence "product_id_seq" (32767)
[SQL: INSERT INTO cubedash.product (name, dataset_count, last_refresh, source_product_refs, derived_product_refs, time_earliest, time_latest) VALUES (%(name)s, %(dataset_count)s, now(), %(source_product_refs)s, %(derived_product_refs)s, %(time_earliest)s, %(time_latest)s) ON CONFLICT (name) DO UPDATE SET dataset_count = %(param_1)s, last_refresh = now(), source_product_refs = %(param_2)s, derived_product_refs = %(param_3)s, time_earliest = %(param_4)s, time_latest = %(param_5)s RETURNING cubedash.product.id]
[parameters: {'name': 'ga_s2a_ard_nbar_granule', 'dataset_count': 173779, 'source_product_refs': [], 'derived_product_refs': [], 'time_earliest': datetime.datetime(2017, 7, 2, 0, 57, 11, 26000, tzinfo=psycopg2.tz.FixedOffsetTimezone(offset=0, name=None)), 'time_latest': datetime.datetime(2019, 9, 16, 1, 17, 21, 24000, tzinfo=psycopg2.tz.FixedOffsetTimezone(offset=0, name=None)), 'param_1': 173779, 'param_2': [], 'param_3': [], 'param_4': datetime.datetime(2017, 7, 2, 0, 57, 11, 26000, tzinfo=psycopg2.tz.FixedOffsetTimezone(offset=0, name=None)), 'param_5': datetime.datetime(2019, 9, 16, 1, 17, 21, 24000, tzinfo=psycopg2.tz.FixedOffsetTimezone(offset=0, name=None))}]
(Background on this error at: http://sqlalche.me/e/9h9h)

This is the command the Cronjob runs :
- "cubedash-gen"
      - "--no-init-database"
      - "--refresh-stats"
      - "--force-refresh"
      - "--all"

We’re using a SmallInt here for the product-id, allowing a maximum of 32k products. Which matches upstream ODC.
That’s should be enough, since our biggest production deployment has ~60ish products, many of which are tests or near-clones of the same data.
The underlying issue seems to be that cubedash-gen bumps the id counter even when no product is being added, and so running the same command via cron eventually hits the limit.
We could:

Bump the ID to a normal int, or
Fix that query so the counter is only bumped when new products are actually added.

I’m leading towards the second option, in order to:

Not deviate from upstream ODC’s types.
Avoid the increase the DB row size.

(The product-id is used repeatedly in statistics-arrays in individual rows such as counts-through-time, so it’s not just me being penny-pinching over 16-bytes. But admittedly this is not a huge concern.)

As mentioned on Slack, the short-term fix is to drop the cubedash schema/counters and recreate. Then rerun cubedash-gen to repopulate. If there’s still multiple instances you can do it in one instance and then switch over to avoid downtime. Otherwise we’ll need to resort to a more elaborate migration script.

We have reset the sequence in dev.
ows=> select last_value from cubedash.product_id_seq;
 last_value
------------
      32767
(1 row)

ows=> alter sequence cubedash.product_id_seq RESTART WITH 76;
ALTER SEQUENCE
ows=> select last_value from cubedash.product_id_seq;
 last_value
------------
         76
(1 row)

The max of the sequence should be greater that highest product_id
select max(id) from agdc.dataset_type;

It looks like @alexgleith 's fix (77a904678412b62c5dbcab3e4f775cdca193fb1d) worked, as I'm still seeing max(id) == sequence_val locally. Closing this unless you see other issues.


.Mixin() within .Mixin results in error

Less code like this:
.container() {
    // css properties
}

.container {
    .container();
}

... Results in an error when compiled. It seems to be because they share the same name, although they are different (one is a mixin with empty arguments and one is just a class).
I'm using the ruby less gem to compile on Ubuntu.

As the compiler sees it, they are the same. Classes in LESS are mixins, and mixins with no parameters are classes.

I just ran into this same issue when parsing the .clearfix() mixin in bootstrap.
I commented on their change that caused this, here:
https://github.com/twitter/bootstrap/commit/39aca918d032fca589cbeb6c31cc3ef82684d0d0
It would be nice if less.js at least gave a more descriptive error rather than just "undefined" when this happens.  Or better yet, why not just create a hashmap to alias class names and mixins differently.


myth --init-db crashes with jsonrpc error.

mythril crashes on every startup, when trying to resume from block 162
The following error is printed when running myth --init-db;
$ myth --init-db
Resuming synchronization from block 162
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/mythril/rpc/client.py", line 58, in _call
    return response['result']
KeyError: 'result'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.6/multiprocessing/pool.py", line 119, in worker
    result = (True, func(*args, **kwds))
  File "/usr/lib/python3.6/multiprocessing/pool.py", line 44, in mapstar
    return list(map(*args))
  File "/usr/local/lib/python3.6/dist-packages/mythril/ether/contractstorage.py", line 58, in sync_blocks
    block = self.eth.eth_getBlockByNumber(blockNum)
  File "/usr/local/lib/python3.6/dist-packages/mythril/rpc/base_client.py", line 75, in eth_getBlockByNumber
    return self._call('eth_getBlockByNumber', [block, tx_objects])
  File "/usr/local/lib/python3.6/dist-packages/mythril/rpc/client.py", line 60, in _call
    raise BadResponseError(response)
mythril.rpc.exceptions.BadResponseError: {'jsonrpc': '2.0', 'id': 1, 'error': {'code': -32602, 'message': 'invalid argument 0: hex string without 0x prefix'}}
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/bin/myth", line 253, in <module>
    contract_storage.initialize(eth)
  File "/usr/local/lib/python3.6/dist-packages/mythril/ether/contractstorage.py", line 110, in initialize
    results = pool.map(self.sync_blocks, numbers)
  File "/usr/lib/python3.6/multiprocessing/pool.py", line 266, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/usr/lib/python3.6/multiprocessing/pool.py", line 644, in get
    raise self._value
mythril.rpc.exceptions.BadResponseError: {'jsonrpc': '2.0', 'id': 1, 'error': {'code': -32602, 'message': 'invalid argument 0: hex string without 0x prefix'}}

The problem first appeared with a different error message;
[snip]
4038656 blocks processed, 11 unique contracts in database, next block: 22690
4040704 blocks processed, 11 unique contracts in database, next block: 20642
4042752 blocks processed, 11 unique contracts in database, next block: 18594
4044800 blocks processed, 11 unique contracts in database, next block: 16546
4046848 blocks processed, 11 unique contracts in database, next block: 14498
4048896 blocks processed, 11 unique contracts in database, next block: 12450
4050944 blocks processed, 11 unique contracts in database, next block: 10402
4052992 blocks processed, 11 unique contracts in database, next block: 8354
4055040 blocks processed, 11 unique contracts in database, next block: 6306
4057088 blocks processed, 11 unique contracts in database, next block: 4258
4059136 blocks processed, 11 unique contracts in database, next block: 2210
4061184 blocks processed, 11 unique contracts in database, next block: 162
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/dist-packages/mythril/rpc/client.py", line 58, in _call
    return response['result']
KeyError: 'result'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.6/multiprocessing/pool.py", line 119, in worker
    result = (True, func(*args, **kwds))
  File "/usr/lib/python3.6/multiprocessing/pool.py", line 44, in mapstar
    return list(map(*args))
  File "/usr/local/lib/python3.6/dist-packages/mythril/ether/contractstorage.py", line 59, in sync_blocks
    block = self.eth.eth_getBlockByNumber(blockNum)
  File "/usr/local/lib/python3.6/dist-packages/mythril/rpc/base_client.py", line 376, in eth_getBlockByNumber
    return self._call('eth_getBlockByNumber', [block, tx_objects])
  File "/usr/local/lib/python3.6/dist-packages/mythril/rpc/client.py", line 60, in _call
    raise BadResponseError(response)
mythril.rpc.exceptions.BadResponseError: {'jsonrpc': '2.0', 'id': 1, 'error': {'code': -32602, 'message': 'invalid argument 0: hex string without 0x prefix'}}
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/bin/myth", line 240, in <module>
    contract_storage.initialize(eth)
  File "/usr/local/lib/python3.6/dist-packages/mythril/ether/contractstorage.py", line 111, in initialize
    results = pool.map(self.sync_blocks, numbers)
  File "/usr/lib/python3.6/multiprocessing/pool.py", line 266, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/usr/lib/python3.6/multiprocessing/pool.py", line 644, in get
    raise self._value
mythril.rpc.exceptions.BadResponseError: {'jsonrpc': '2.0', 'id': 1, 'error': {'code': -32602, 'message': 'invalid argument 0: hex string without 0x prefix'}}

Hi @flurbo2,
I appears to me that it's syncing up to block 0 and then crashes for some reason - most likely an issue with the multithreading implementation. I'll look into it.

This might be related to the threading work distribution. While I had a working DB, I noticed that scraping would eventually proceed into 'negative' block numbers upon reaching / nearing block zero.
eg ... unique contracts in database, next block: -112 and promptly crash.

Should be resolved in Mythril 0.16.1.


fix for issue#2 - "ModuleNotFoundError: No module named 'stuff'"

This is what fixed the moduleNotFound error for me; just swapping the initialization file from /stuff into /tests.
the aHa moment came after finally reading the "Good Integration Practices" pytest documentation liked in the additional resources section; specifically:
"If you need to have test modules with the same name, as a workaround you might add init.py files to your tests folder and subfolders, changing them to packages"

This is incorrect. You are most likely launching tests from within the tests directory instead of from the project's root directory.

^ 100% that's what happened.
The issue was located between my keyboard and my chair.
I'm all squared away now.


Pocket Size Upgrade Quest Not Applying the Pocket Upgrade For PMC In SPT Dev (Bear)

SPT Version
3.10-BE
Project Type
No response
Expected Result
Pocket size increase after completing the quest Old Pattern.
Actual Result
Pocket size did not increase after quest completion.
Steps To Reproduce

make a SPT Dev profile
choose Bear faction
completing the quest Old Patterns from Ragman
Restart the game
Click Character section to check pocket size

Server Log
Click and attach file. ↓
BepinEx Log
Click and attach file. ↓
Client Log
Click and attach file. ↓
Player Profile
No response
Screenshots
No response

Attachments

server-2024-10-12.log (119 KiB)
LogOutput.log (7 KiB)
2024.10.12_17-55-58_<IP_ADDRESS>.32757 traces.log (45 KiB)
670ab7df00038114f41fd3c4.json (578 KiB)
Screenshot (245).png (3178 KiB)
Screenshot (246).png (4107 KiB)

Originally written by HeresJohnny

Fixed with: https://github.com/sp-tarkov/server/commit/be20eff1654dbb64f5df0d35a1da9862def03240

Originally written by chomp


Error: Path "android-sdk/ndk/23.0.7196353/toolchains/llvm/prebuilt/linux-x86_64/bin/aarch64-linux-android-ar" doesn't exist.

Not seeing this file in ndk version 23, it is present in version 22.

Thank you for reporting! NDK r22 deprecated GNU binutils in favour of LLVM's, and those have finally been removed in NDK r23. This should be fixed by #137, please give it a try!


Support multiple receivers

The HPSDR protocol and many radios support multiple receivers (e.g. the HL2 can support up to 10). Right now this library only supports a single receiver. It would be nice to add multiple receiver support.

Fixed by release 0.5.2.


Update building.md with pip

Edit (Gabor): followup of #1778

Yes, this makes perfect sense. I tried it and it worked.


⚠ Bofrost.be has degraded performance

In f603666, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 1451 ms

Resolved: Bofrost.be performance has improved in 0772a75.


{CI} Fix send email due to breaking change of azure-communication-email service

Related command

Description

Send email raise error:

Recently azure-communication-email service released a new version, there are many breaking changes, so the send email method needs to be updated.
Testing Guide

History Notes

[Component Name 1] BREAKING CHANGE: az command a: Make some customer-facing breaking change
[Component Name 2] az command b: Add some customer-facing feature

This checklist is used to make sure that common guidelines for a pull request are followed.

[ ] The PR title and description has followed the guideline in Submitting Pull Requests.

[ ] I adhere to the Command Guidelines.

[ ] I adhere to the Error Handling Guidelines.

CI


⚠ Samsung has degraded performance

In 76afda7, Samsung (https://samsung.com) experienced degraded performance:

HTTP code: 200
Response time: 2214 ms

Resolved: Samsung performance has improved in c83748b.


[Infra] Need an in-depth view into the infra structure and roadmap

With the complexity around releasing the Flutter SDK, it would be beneficial to the entire team to do the following:

Map and diagram the infrastructure for flutter release infrastructure.
Surface the EngProd roadmap.

@itsjustkevin do you have a preference on where to publish the roadmap? I could add a section to https://github.com/flutter/flutter/wiki/Roadmap for the release roadmap.

@itsjustkevin I've gone ahead and wrote/presented:

https://github.com/flutter/flutter/wiki/Release-process
go/flutter-release-train-slides
go/flutter-ci-yaml-slides
Several internal g3docs with overviews of the various systems

I'm marking this as completed, however, if there's more specific documentation we need feel free to file follow up issues to this.


Design discussion: how to handle JSON

We're going to need to run over some JSON files in the near future. Say we have a bunch of files of the form:
userLikes1.json
userLikes2.json
userLikes3.json
userComments1.json
userComments2.json
userComments3.json
clicks1.json
clicks2.json
clicks3.json

Each type of file has a different schema, and imagine we have 1000s of these files, totaling 100s of GB.
Topic for discussion: how do we want to parse these and formulate queries?

are the indices related from one stream to another?
do we still assume we are doing SELECT * like queries?
are this going to be loaded at the same time? (related to 2)

Why not transform json into relational tables, and load them into postgres? Just wondering how complex the transformation is.

The goal here is to do this in a somewhat generic way.
One thought is to have a JSONLoader class that allows you to declare "virtual tables" over each file (e.g., comments: userComments*.json) and then select metrics and attributes of the form table.feature.
There are a few related projects:

JaQL looks like it got swallowed by IBM: https://code.google.com/archive/p/jaql/
JsonPath: XPath is not my favorite: http://goessner.net/articles/JsonPath/
JsonIQ: http://jsoniq.org/

Jackson gives us cross-language support: https://github.com/FasterXML/jackson

@mamikonyana

are the indices related from one stream to another?

Likely, yes, you'll want to do joins.

do we still assume we are doing SELECT * like queries?

Ideally. Otherwise, how else do we want to do this?

are this going to be loaded at the same time? (related to 2)

Depends. What's most expedient?

@raininthesun

Why not transform json into relational tables, and load them into postgres? Just wondering how complex the transformation is.

May be doable. Postgres is very slow compared to reading from disk. I am curious -- is there an easy way to take JSON and put it into an in-memory JDBC-like DB instead of Postgres?

We could load one of each type of file at a time, and consider that to be a "streaming" query, maybe?

@deepakn94 The question is how to do this if we want to join, say, clicks with comments.

Per @raininthesun's suggestion, it should be possible to use Postgres's built-in JSON support.
We could also use Postgres's foreign data wrapper support; someone already has one for JSON: http://pgxn.org/dist/json_fdw/
I believe DeepDive uses Greenplum, and we could too.

Postgres loader: https://github.com/lukasmartinelli/pgfutter

@pbailis I think this leads to a broader question of how we want to handle multiple incoming streams in general (especially if you could possibly join them), right?

This is perhaps an aside, but have you tried to look into why Postgres is so slow? I would expect SELECT * queries, especially without joins, to be similar speed to using our own disk cache. What's the approximate slowdown with Postgres? Is it because SELECT * is trying to load everything into memory and swapping, and we should be batching reads instead?

The machine we're on has 250 Gigabytes of RAM, so I would be surprised if it's because of memory + swapping. I don't think Postgres isn't optimized for full range queries (performs much better when index lookups are feasible): I think the layers of abstraction that help to keep things well organized completely screw the performance, but I could be wrong here.

I wonder if our use of nested queries also kills performance.

@viveksjain: I believe Postgres is smart enough to push the column selections into the subquery. My hypothesis why disk caching is fast is that we're only scanning over the columns that we want. In contrast, when we select a particular set of columns from Postgres, it has to scan over all of the data in each row due to its row-oriented layout. With wide rows (i.e., many columns, as in CMT), this is expensive.
A columnar-oriented storage engine should help here.
postgres=# \timing
Timing is on.
postgres=# SELECT COUNT(dataset_id) FROM (SELECT * from mapmatch_history) AS bq;
  count
----------
 ZZZ
(1 row)

Time: 16401.287 ms
postgres=# SELECT COUNT(dataset_id) FROM mapmatch_history;
  count
----------
 ZZZ
(1 row)

Time: 16096.268 ms
postgres=# EXPLAIN SELECT dataset_id FROM (SELECT * from mapmatch_history) AS bq;
                                 QUERY PLAN
-----------------------------------------------------------------------------
 Seq Scan on mapmatch_history  (cost=0.00..2454474.96 rows=48301296 width=4)
(1 row)

Time: 25.282 ms
postgres=#

Going to experiment with Postgres this week.


Error on Initialization

I am developing my own system and wanted to test a few modules.  I have used Health Estimate in 5e successfully, but for whatever reason, it fails to initialize on start up with my system.
I've attached a screenshot of the error message:

foundry.js:747 Error: Error thrown in hooked function '' for hook 'setup'. This is not a registered game setting
at ClientSettings.get (foundry.js:2799:42)
at sGet (utils.js:85:23)
at get breakCondition [as breakCondition] (EstimationProvider.js:166:18)
at HealthEstimate.setup (logic.js:15:31)
at Object.fn (healthEstimate.js:12:22)
at #call (foundry.js:724:20)
at Hooks.callAll (foundry.js:681:17)
at Game.setupGame (foundry.js:7913:11)
at Game._initializeGameView (foundry.js:8999:16)
at Game._initializeView (foundry.js:8975:21)
onError @ foundry.js:747
Reproducing is quite simple, I just refresh and the error shows up.
I am currently in early development of the AVD12 System.  I'm not doing anything special in my foundry Init, but it seems like this error happens before my system init is even finished.

This issue was resolved by the fix from sunday.


Monster Status Layout tweaks

New "Jump" icon (using palico launch icon as base)
display the mount/exhaust icons
tweak Monster status layout for spacing

I'll look at this tonight.

Bump. I want to try out these icons.


Fix for wrong Development Key Hash creation command (Android)

Problem
When I tried to use this package in my Android app, I've encountered an issue while configuring it to work with my Facebook app. To be more specific, the Key Hash generation command in the Running Sample Apps part of Facebook's Getting Started Guide linked under Installation -> 3. Configure projects -> 3.1 Android in the project's README.
I've encountered this error after using the command from Facebook's guide:
SERVER_ERROR: [code] 1349195 [message]: The key hash does not match any stored key hashes. Go to https://developers.facebook.com/docs/facebook-login/android for more information. [extra]

Solution
Well, this is caused by the fact that the RN app, doesn't get it's debug.keystore from ~/.android/debug.keystore (where Facebook's command puts it). Facebook's command is simply not correct for a RN project (both Expo and React Native CLI). This is of course the case because Facebook's guide was written with native Android development in mind.
Nonetheless I've figured out that using the debug.keystore inside ./android/app (from the root of a RN app), resolves the problem. Therefore I've though up this process:

Get in to the root dir of your app:

cd my-app

If you're using Expo, you'll of course need to run npx expo prebuild first.
Generate the Development Key Hash with the fixed command (Linux / MacOS):

keytool -exportcert -alias androiddebugkey -keystore android/app/debug.keystore | openssl sha1 -binary | openssl base64

Enter android or the password you've changed it to (if it doesn't ask you for a password, you either don't have all the needed utilities installed / the path is wrong / there's something wrong with the command).
Copy & paste the Development Key Hash in to your Facebook app.
Update algorithm as SHA1 is a security risk (Linux / MacOS):

keytool -importkeystore -srckeystore android/app/debug.keystore -destkeystore android/app/debug.keystore -deststoretype pkcs12

From my testing it looks like the app (both Expo and React Native CLI) doesn't even need to be reloaded, let alone rebuilt after running the Key Hash generation command.
P.S.
I think this (with some polish - like adding equivalent Windows commands and so on) would be a worthy addition to the project's README!

Keystore location is variable. My keystores are not where you say they are, for instance.
I'm not against including something like this in the manual but I think it would be best to:
a) avoid specific commands, they go stale quickly, and just invite more support burden
b) reference how to locate the keystore ("find the 'storeFile' line in your app's build.gradle to determine it's location")
So something less specific and more referential, ideally to the android developer documentation for the storeFile build.gradle element, and to their documentation to get the hash

Those are great points and I completely agree with you.
I blindly created my solution based on the default location of the keystore file in RN projects but my main point was simply the fact that a different debug.keystore file (than the one in Facebook's guide) needs to be used.
I'm still a new to RN and mobile dev in general so to be honest I didn't know you can get the storeFile from build.gradle thank you for sharing that! 😄

These are a couple resources related to storeFile I found that might be usefull:

https://developer.android.com/studio/build/gradle-tips#sign-your-app
https://developer.android.com/reference/tools/gradle-api/4.2/com/android/build/api/dsl/SigningConfig#storeFile:java.io.File

I also think it'd be good to mention the 2 build.gradle files (the one in /android and /android/app) as newer devs may get confused.

https://stackoverflow.com/a/23241888/11749019

It is possible that "android" and "android/app" aren't the actual paths either, those are variable, even if they are the default and are the most commonly used (https://github.com/react-native-community/cli/blob/main/docs/platforms.md#projectconfig - you can change it if you want)
The same point as the original one, in other words - documentation changes should always keep in mind

what the maintenance-cost-over-time is (and thus prefer referring to upstream documentation where possible, with search terms plus the link, to guard against link rot - as opposed to specific concrete examples of the usage of other tools, since those are brittle)

whether anything documented is actually variable (location of store file, location of gradle files that even define the store files) vs default assumptions. It's okay to include the default assumptions to make the docs more useful but they should be clearly labeled as defaults with links to documentation on how they are variable / how to determine concrete value

Documentation is frequently harder than code

So, what do you think about something along the lines of this:
"Keep in mind you have to point this command at your app's debug.keystore file instead. You can find it's location by checking storeFile in one of the build.gradle files (it's default path is android/app/build.gradle however this can vary from project to project)."

That seems to allow for all the flexibility the build system allows, while still most likely resulting in a developer finding it immediately. Looks good to me

Fantastic!
In that case I'll create a PR soon, so we can polish the changes.