Shade relocation changes the address of metadata server then compute engine credentials get stuck

I have encountered a corner case which emerges when I generate my shaded uber jar. I have realized that shaded jar is not able to get service account credentials in a VM/GKE pod. When I decompiled the shaded jars, I have realized that the gcp metadata server path is prefixed with /com/google/cloud/spanner/jdbc/shaded .
As a solution I have changed pattern com to com. and I've applied similarly to io., org. and android.
Environment details

spanner-jdbc-driver
macos
Java version: 8
spanner-jdbc version(s): master

Steps to reproduce

mvn package -Pshade -DskipTests
cd target
unzip google-cloud-spanner-jdbc-*-single-jar-with-dependencies.jar
cd com/google/cloud/spanner/jdbc/shaded/com/google/auth/oauth2
decompile ComputeEngineCredentials.class , you will see

public static String getServiceAccountsUrl() {
   return getMetadataServerUrl(DefaultCredentialsProvider.DEFAULT) + "/com/google/cloud/spanner/jdbc/shaded/computeMetadata/v1/instance/service-accounts/?recursive=true";
 }

As you see above the metadata server path is prefixed by shaded address.
Solution
I have excluded the computeMetadata in pom.xml by changing the patterns.
<relocations>
                <relocation>
                  <pattern>com.</pattern>
                  <shadedPattern>com.google.cloud.spanner.jdbc.shaded.com.</shadedPattern>
                  <excludes>
                    <exclude>com.google.cloud.spanner.**</exclude>
                  </excludes>
                </relocation>
                <relocation>
                  <pattern>android.</pattern>
                  <shadedPattern>com.google.cloud.spanner.jdbc.shaded.android.</shadedPattern>
                </relocation>
                <relocation>
                  <pattern>io.</pattern>
                  <shadedPattern>com.google.cloud.spanner.jdbc.shaded.io.</shadedPattern>
                  <excludes>
                    <exclude>io.grpc.netty.**</exclude>
                  </excludes>
                </relocation>
                <relocation>
                  <pattern>org.</pattern>
                  <shadedPattern>com.google.cloud.spanner.jdbc.shaded.org.</shadedPattern>
                  <excludes>
                    <exclude>org.conscrypt.**</exclude>
                  </excludes>
                </relocation>
              </relocations>

Any additional information below
I have encountered this while trying to integrate cloud spanner to an old codebase.
Also I have realized that many libraries are dragged by shaded pom so when I add shaded jar as a dependency I have excluded everything:
<dependency>
      <groupId>com.google.cloud</groupId>
      <artifactId>google-cloud-spanner-jdbc</artifactId>
      <version>2.2.1-shaded</version>
      <classifier>single-jar-with-dependencies</classifier>
        <exclusions>
            <exclusion>
                <groupId>*</groupId>
                <artifactId>*</artifactId>
            </exclusion>
        </exclusions>
    </dependency>

@olavloite Could you help out with this one?
Thanks!


Merge Sort and Quick Sort in Java

Merge Sort:
Merge Sort is a divide-and-conquer algorithm that recursively divides the array into two halves, sorts each half, and then merges them back together in sorted order.

How it works:
The array is recursively split in half until each subarray has one element (base case).
Then, during the merge step, the two halves are combined back together in sorted order by comparing elements from each half.
This continues until the entire array is merged and sorted.
Time Complexity: O(n log n) in all cases (best, average, and worst-case).
Space Complexity: O(n), because of the auxiliary array used for merging.
Key Characteristics:
Stable sorting algorithm (preserves the relative order of equal elements).
Performs well on large datasets, but uses extra space for the merging process.

Quick Sort:
Quick Sort is another divide-and-conquer algorithm that selects a "pivot" element and partitions the array around the pivot so that elements less than the pivot come before it and elements greater than the pivot come after it. It then recursively sorts the two partitions.

How it works:
A pivot is chosen (commonly the last element or a random one).
The array is partitioned into two subarrays: one with elements smaller than the pivot and one with elements larger than the pivot.
The same process is applied recursively to both subarrays until the array is sorted.
Time Complexity:
Best and average case: O(n log n).
Worst case: O(n²) (if the pivot selection is poor, e.g., always the smallest or largest element).
Space Complexity: O(log n) due to the recursion stack, but no extra array is needed like in Merge Sort.
Key Characteristics:
In-place sorting algorithm (requires no extra space).
Not stable (does not preserve the relative order of equal elements).

Hii @strivedi4u , I want to write the solution of two main sorting algorithms in Java. Please assign me this issue under Hacktoberfest 2024.

please assign me this issue under Hacktoberfest 2024

hello sir ,please assign this issue to me under Hacktoberfest'24

Hello SIr, I am a java developer ,please assign this issue for hactoberfest 2024 .


Problems with python in new version from 2021-05-04

Description
This workflow started to fail after the latest update of the virtual environment
https://github.com/pharmpy/pharmpy/actions/runs/817030678
The issue is with python and this error shows up multiple times:
Python 3.8.10 /home/runner/work/pharmpy/pharmpy/.tox/py38/bin/python
  /opt/hostedtoolcache/Python/3.8.10/x64/lib/python3.8/pkgutil.py:415: in get_importer
      importer = sys.path_importer_cache[path_item]
  E   KeyError: PosixPath('/home/runner/work/pharmpy/pharmpy/.tox/py38/lib/python3.8/site-packages/pharmpy/plugins')

  During handling of the above exception, another exception occurred:
  tests/nonmem/conftest.py:43: in pheno
      model = pharmpy.Model(pheno_path)
  .tox/py38/lib/python3.8/site-packages/pharmpy/model_factory.py:27: in Model
      model_class = detect_model(src)
  .tox/py38/lib/python3.8/site-packages/pharmpy/plugins/utils.py:20: in detect_model
      plugins = load_plugins()
  .tox/py38/lib/python3.8/site-packages/pharmpy/plugins/utils.py:41: in load_plugins
      for _, modname, ispkg in pkgutil.iter_modules([plugin_path], 'pharmpy.plugins.'):
  /opt/hostedtoolcache/Python/3.8.10/x64/lib/python3.8/pkgutil.py:129: in iter_modules
      for i in importers:
  /opt/hostedtoolcache/Python/3.8.10/x64/lib/python3.8/pkgutil.py:419: in get_importer
      importer = path_hook(path_item)
  E   AttributeError: 'PosixPath' object has no attribute 'startswith'

Nothing was changed in the call to pkgutil and the error message is between internal calls of the standard library.
Here is the last run without these issues: https://github.com/pharmpy/pharmpy/actions/runs/816357539
Area for Triage:
Python
Question, Bug, or Feature?:
Bug
Virtual environments affected

[ ] Ubuntu 16.04
[ ] Ubuntu 18.04
[x] Ubuntu 20.04
[ ] macOS 10.15
[ ] macOS 11.0
[ ] Windows Server 2016 R2
[ ] Windows Server 2019

Image version
20210504.1
Expected behavior
All tests should pass and the exception should not appear. Running locally works fine.
Actual behavior
A python exception is raised.
Repro steps
Failing workflow: https://github.com/pharmpy/pharmpy/actions/runs/817030678

Hi @rikardn!
It can be the issue not with the image but with the updated Python version 3.8.10, which was released a few days ago. Could you please try to specify the exact Python version 3.8.9 in your workflow and check if the issue persists?

@rikardn and same for 3.9 — it was updated from 3.9.4 to 3.9.5 the same day as 3.8

Thanks @miketimeofeev. This is indeed the problem. I changed from python "3.8" to "3.8.9" and all tests pass again. Still failing with python 3.9 so I will test also 3.9.4.

Python 3.9.4 also works.
So going back to python 3.9.4 and python 3.8.9 resolved the issues.
The passing workflow:
https://github.com/pharmpy/pharmpy/actions/runs/817415441

Ok, I can confirm that it is a regression in python 3.8.10
This snippet:
import pkgutil
from pathlib import Path

for _, modname, ispkg in pkgutil.iter_modules([Path("/home/mypath")], 'somepackage.somesubpackage'):
        print(modname, ispkg)

runs fine using python 3.8.9, but not with python 3.8.10. Changing from Path to a string makes it work.
I'll check if it was reported on the python issue tracker.

I filed this:
https://bugs.python.org/issue44061
Since this issue is not directly related to the github actions virtual environment you can close it if you like.

@rikardn thanks for the confirmation! I'm going to close the issue as it's not related to the images.
Please feel free to contact us if you have any concerns.


take full power of config file

{
  collections: {
    users: {
      skipBeforeSaveHook: true,
      skipValidation: true,
      dependsOn: ["genders"]
    }
  }
}

Now we are using raw mongodb command to seed data. Don't need this anymore.


[Extensibility Request] All Sales / Purchase Document Subform Pages

Hi,
due to the same issue as explained here (https://github.com/microsoft/ALAppExtensions/issues/17972), we would kindly request to add an CurrPage.Update() to the "Item Reference No." field on all sales and purchase document subforms. We need this to have an existing record to run our code for the new price calculation.
f.e.:

Min. requested pages:

page 46 "Sales Order Subform"
page 47 "Sales Invoice Subform"
page 54 "Purchase Order Subform"
page 55 "Purch. Invoice Subform"
page 95 "Sales Quote Subform"
page 96 "Sales Cr. Memo Subform"
page 97 "Purchase Quote Subform"
page 98 "Purch. Cr. Memo Subform"
page 6631 "Sales Return Order Subform"
page 6641 "Purchase Return Order Subform"

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. Please do not reply to this, as we do not monitor closed issues. If you have follow-up questions or requests, please create a new issue where you reference this one.
Build ID: 53019.


Attempt to fix #82

Closes #82
I use try/catch to make the tasks that don't get any elements from the channel return nothing gracefully. Afterwards, I filter out these results before performing the final reduction.
Disadvantages:

We potentially ignore MethodErrors cause by user input (f, `op).
results = fetch.(tasks) allocates

Closed in favor of https://github.com/JuliaFolds2/OhMyThreads.jl/pull/84


flower pedicel (PO:0009052)

flower pedicel (PO:0009052)
Current def'n: An inflorescence branch (PO:0009081) that supports an individual flower (PO:0009046) in an inflorescence (PO:0009049).
Revised def'n: A higher order inflorescence axis (PO:0009081) that terminates in a flower (PO:0009046).
Current comment: The bracteoles are borne on the pedicel, which terminates in a flower. A pedicel is the ultimate branch in an inflorescence.
Revised comment: The pedicel is the ultimate axis in an inflorescence and terminates in a flower.
Synonyms: pedicelo (Spanish, exact), 小花柄 (Japanese, exact)

Comment moved to #89.


update the profile for lino-tadros

Docs Build status updates of commit 1763b6f:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

rd/index.yml
:white_check_mark:Succeeded
View

rd/lino-tadros.yml
:white_check_mark:Succeeded
View

rd/map.yml
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel


Accessing nested params with useParams

Hello, I have a component setup that looks something like this:
<Provider value={client}>
  <!-- some more stuff here -->
  <Route path="/admin" nest>
    <Switch>
      <Route path="/">
        <RedirectToCompany />
      </Route>
      <Route path="/:companyId" nest>
        <AdminLayout menu={menu}>
          <Switch>
            <Route path="/seminare">
              <SeminarPage />
            </Route>
            <Route path="/">
              <Redirect to="/seminare" />
            </Route>
          </Switch>
        </AdminLayout>
      </Route>
    </Switch>
  </Route>
</Provider>

I'd like to access my companyId param within my <SeminarPage> component, which is nested inside another route, via useParams(). However I always get an empty object. I assume because useParams() will always use the params from the closest ancestor <Route> component. With nested routes, is there any way to access "higher up" params?

Hi @pReya, I don't think it's possible at the moment. In the current design, the context where parameters are stored gets overwritten in the Route, so parameters don't inherit.

The way it currently works is pretty counterintuitive and makes using nested routes not an option in many cases.
Intuitively something like this should work, and does work at least in react-router.
<Route path="/:dataset" nest>
    <Route path="/">
        <ChartPicker />
    </Route>
    <Route path="/:type">
        <Chart />
    </Route>
</Route>;

Merging existing params  to the params context in Route seems pretty small change, is that something that could be added at this point?

Minor release sounds reasonable, bit too late at this point with rc3 👍

The way it currently works is pretty counterintuitive and makes using nested routes not an option in many cases.
Intuitively something like this should work, and does work at least in react-router.
<Route path="/:dataset" nest>
    <Route path="/">
        <ChartPicker />
    </Route>
    <Route path="/:type">
        <Chart />
    </Route>
</Route>;

Merging existing params to the params context in Route seems pretty small change, is that something that could be added at this point?

it didn't work for me :(

The way it currently works is pretty counterintuitive and makes using nested routes not an option in many cases.
Intuitively something like this should work, and does work at least in react-router.
<Route path="/:dataset" nest>
    <Route path="/">
        <ChartPicker />
    </Route>
    <Route path="/:type">
        <Chart />
    </Route>
</Route>;

Merging existing params to the params context in Route seems pretty small change, is that something that could be added at this point?

it doesn't work like that, useParams returns just an empty object if you try to use it inside of a nested nest

@molefrog please add this feature, otherwise I will have to go back to react-router-dom v5 :(

We are using these light wrappers, seem to work fine (with the downside of having to import the custom implementations instead of wouter):
import {useParams, Route} from "wouter";

type ParentParamsContextType = Record<string, string>;
const ParentParamsContext = createContext<ParentParamsContextType>({});

export function useNestedParams<T extends ParentParamsContextType>(): T {
    const parentParams = useContext(ParentParamsContext);
    const params = useParams<T>();
    return {...parentParams, ...params} as T;
}

export const CustomRoute: typeof Route = props => {
    const params = useNestedParams();
    return (
        <ParentParamsContext.Provider value={params}>
            <Route {...props} />
        </ParentParamsContext.Provider>
    );
};

Kinda bizarre this is not already possible...
This library is pretty much perfect in every way, except for this.

@mattkrins I know... This feature isn't hard to implement, however this will require every Route in the app to subscribe to the context to get the outer parameters. It will mean that every route down the tree will re-render even if it was wrapped in memo. It's a performance trade-off that we will have to consider.

Released in https://github.com/molefrog/wouter/releases/tag/v3.3.0


Dropbox Integration for Upload Dataset

Design: https://www.figma.com/file/g0L0CfVzRc8r6HQa4NH1wJ/Publisher-Collection?node-id=39%3A793
What:
After finishing this ticket, the user will be able to upload a dataset via Dropbox Chooser, see the dataset processing updates (success, pending, error), and download dataset in all three formats as well as visit the dataset's CXG link

Please implement Dropbox Chooser following the design

Restrict to select ONE file for now / Direct download link

Call the relevant API to kick off the cloud to cloud transfer -- API TBD, since some discussion is still ongoing in Slack #tmp-sc-collection-flow-ux

Render the dataset entry as a row, as shown in design here

API here: https://github.com/chanzuckerberg/single-cell/blob/23bd9e23d17229747b8cf7193fdd40f7a3175352/rfcs/0002-upload-from-dropbox/text.md

Research notes:

Dropbox Chooser library: https://www.dropbox.com/developers/chooser
Need a Dropbox app in App Console
Need to create a CZI Dropbox account
Need to specify deployment web app links (dev, staging, prod)
Embed their script through Dropbox CDN
The Chooser option config section allows direct download link, multiselect, file types, size limit, etc.. Super convenient!
Direct download link expires in 4 hours
Looks like we need to call Dropbox.isBrowserSupported() to see if the browser supports it. (I've confirmed that the latest Chrome, Firefox, and Safari all work)

Keeping this as "Refined Me!", since API calls are not finalized yet!

10/27 Update: Added API doc: https://github.com/chanzuckerberg/single-cell/blob/23bd9e23d17229747b8cf7193fdd40f7a3175352/rfcs/0002-upload-from-dropbox/text.md
Now waiting for design to finalize! Thank you!
CC: @brianraymor @hthomas-czi

Hi all! I just added the following user story:
After finishing this ticket, the user will be able to upload a dataset via Dropbox Chooser, see the dataset processing updates (success, pending, error), and download dataset in all three formats as well as visit the dataset's CXG link
The part I left out is the ability to cancel the process, since I'm a little unclear when we want to stop allowing users to cancel.
One option is to only allow cancel while the dataset is being uploaded, but once upload is complete and validation starts, they can no longer cancel. And then they will be able to delete the dataset when we deliver that feature. Does that sound good?
Thank you!
CC: @brianraymor @hthomas-czi

RE Timmy's question:

The part I left out is the ability to cancel the process, since I'm a little unclear when we want to stop allowing users to cancel.

@mckinsel and @Bento007 - when will the upload RFC be updated based on yesterday's presentation?


[MM-47779] Prevent crash when either URL view or main window was destroyed first

Summary
There's a potential race condition that can crash the app when the app reloads. If a URL view was supposed to disappear as the computer was being locked, on wake the window may not yet be fully re-rendered causing a crash.
This PR just catches that so that the app doesn't crash.
Ticket Link
https://mattermost.atlassian.net/browse/MM-47779
Fixed an issue where the app could crash when logging back in.

Cherry pick is scheduled.


Request Method:OPTIONS Status Code:404 Not Found

Hello,
Im getting
Request Method:OPTIONS
Status Code:404 Not Found
when I use yelp.search

bump.

Can you copy/paste your code here or add a test in test/index.js. I can't reproduce this issue.

(let me know if you want the actual keys)
console: ng new YelpTest
app.componen.tst:
`constructor(){
var Yelp = require('yelp');
var yelp = new Yelp({
  consumer_key: '<actual value here>',
  consumer_secret: '<actual value here>',
  token: '<actual value here>',
  token_secret: '<actual value here>',
});

yelp.search({ term: 'food', location: 'Montreal' })
  .then(function (data) {
    console.log(data);
  })
  .catch(function (err) {
    console.error(err);
  });

}`
returning 404

BOOM. Got it. Not the yelp thingy but with a manual oauth sig and http. observe!
constructor(private http:Http){
    this.getResults()
      .subscribe(
        results => {
          console.log(results)
        },
        err => {
          console.log(err);
        })
  }

  getResults() : Observable<any> {

    var timeStamp = parseInt(n().toString().substring(0, 10))
    var nonce = this.randomString(10)

    var consumerSecret = "-_aq_YJesh129GDQVbcPGYeyqAw"
    var tokenSecret = "OoZ3Av5-a8PsBoznUaZXtS-ga8M"
    var options = {encodeSignature: true}
    var parameters = {
      oauth_consumer_key : '5EowQ8Zq69WUi-8JUn2yFw',
      oauth_token : 'G26j6swsP8671qvfGV6Mq1P2fRce0IBj',
      oauth_nonce : nonce,
      oauth_timestamp : timeStamp,
      oauth_signature_method : 'HMAC-SHA1',
      oauth_version : '1.0',
      location: 93401,
      radius_filter:10000,
      category_filter:'food'
    }
    var preUrl = "https://api.yelp.com/v2/search/"
    var signature = oauthSignature.generate("GET", preUrl, parameters, consumerSecret, tokenSecret, options)
    console.log(signature)
    var url =
      "https://api.yelp.com/v2/search/?location=93401&radius_filter=10000&category_filter=food&oauth_consumer_key=5EowQ8Zq69WUi-8JUn2yFw&oauth_token=G26j6swsP8671qvfGV6Mq1P2fRce0IBj&oauth_signature_method=HMAC-SHA1&oauth_timestamp="
      + timeStamp + "&oauth_nonce=" + nonce + "&oauth_version=1.0&oauth_signature=" + signature

    return this.http.get(url)
      .map((res:Response) => res.json())
      .catch((error:any) => Observable.throw(error.json().error || 'Server error'));
  }

  randomString(length) {
    var text = "";
    var possible = "ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz";
    for(var i = 0; i < length; i++) {
      text += possible.charAt(Math.floor(Math.random() * possible.length));
    }
    return text;
  }

@Dooblr : I'd suggest not revealing your consumerSecret and tokenSecret.

whoops, thanks for that. Copied it over one too many times.

I published<EMAIL_ADDRESS>which uses https instead of http for the API base URL. Maybe that helps? I haven't tested this module in browser. If you can help set up a browser test that'd help

Hmm, that didn't fix the CORS issue. I added a npm run test-browser-local script if anyone wants to try to fix this.

@Dooblr
I've tried using a different snippet of code from  https://arian.io/how-to-use-yelps-api-with-node/ where I have tried to modify the behavior of your ng2 file : https://jsfiddle.net/cs1og5f9/1/ but still seem to be getting the same error.
(No 'Access-Control-Allow-Origin' header is present on the requested resource. Origin 'null' is therefore not allowed access. If an opaque response serves your needs, set the request's mode to 'no-cors' to fetch the resource with CORS disabled.)
Could you possibly help me figure out how to bypass this error please

I'm using a Chrome plugin called **Allow-Control-Allow-Origin: *** .
That allows it to work with the localhost:4200 ng2-cli dev setup. Haven't deployed it yet, so I can't speak to whether or not all this junk works in the real world without said plugin. Still building out the app. Will update as I learn more.

After learning more, it seems that Yelp must allow CORS on their end. Otherwise I'm reading that you have to run every request through a Python server. That makes this entire library useless.
@olalonde, I'm guessing CORS was enabled at one point or how would this library have ever worked? If Node-Yelp is still working for you, please post your code.

@Dooblr it never was meant to be used or tested in a browser (hence why it is called node-yelp). That being said, if someone figures out how to get it to work inside a browser, I'd be happy to merge the pull request.

@Dooblr @olalonde Upon further research, I found that yelp does not support CORS on their end (according to one of their developers) and so if you would wish to create a JS wrapper for the browser then I would suggest using AJAX and JSONP as your data type. I have working code that  makes the request via the browser, but I believe this is outside the scope of this library (node.js). If  you'd wish, @olalonde i would be more than happy to integrate it. Just let me know :)

@denniskkim would you be so kind? Thanks! I would also suggest putting a link to it on the readme for Node-Yelp.

@denniskkim  Sure, a pull request would be welcome 👍


How to override the parameter in the yaml file?

Hello there,
If I wanna set “per_device_batch_size” to 16 in the command, instead of modifying the yaml file, how can I do it? Thank you!
CUDA_VISIBLE_DEVICES=0,1,2,3 llamafactory-cli train llama3_full_sft.yaml

please edit the yaml file


Make FindGMock.cmake more robust

Handle case with multiple invocations (avoid pasting ${CMAKE_THREAD_LIBS_INIT} multiple times).
Also check if target 'gmock' already exists before building GMock to avoid failures if GMock was already
find_packaged() from another subproject.

The diff is a bit hard to read, but there are only two changes:

everything is wrapped into an if(NOT GMock_FOUND)
add_subdirectory(gmock) is inside an if which checks if the gmock target is defined

@gaschler you're right, the estimate of when Catkin would get a release is a couple of weeks, we can't wait that long.
In the meantime, I believe I have a quick dirty fix available, PTAL. I just pushed it to this branch, it's the last line, the rest of the PR is just making this module more robust.
Catkin looks at the variable "GMOCK_FOUND" (all uppercase), and we can set it to false (without consequences) so Catkin doesn't enter this branch.

@ojura, thank you very much for this work-around. I know that most "obvious fixes" don't work and you found a very practical way around.

Thanks a lot for the patch!


Decouples primaries_recoveries limit from concurrent recoveries limit.

Description
Node initial primaries recoveries are counted towards total incoming recoveries on a node, which then throttles the replica recoveries into that node. This is incorrect as per the documentation since both limits should be separately counted. This PR attempts to fix this discrepancy by counting the initial primary recoveries separately. As a side effect of this change, I was able to optimize the time taken by ThrottlingAllocationDecider for primary shard allocation decision from the order of total number of initializing primary shards to constant.
Issues Resolved
#504
Check List

[x] New functionality includes testing.

[x] All tests pass

[x] New functionality has been documented.

[x] New functionality has javadoc added

[x] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.
Duplicate of #505.

@odfe-release-bot Kindly trigger a gradle check or let me know what else is needed on this PR before gradle check could be triggered?

start gradle check

@saratvemulapalli Would you help with merging this?

start dco check
start wrapper validation
start gradle precommit

@opensearch-project/admin Please help with the review.

good


Trezor T support

Hi,
I got electrum-nmc working on an ubuntu 16.04 system. Then I tried the hardware support of electrum-nmc. I am not very experienced with the Trezor T hardware yet, but the device works well via the web interface of the manufacturer. With electrum-nmc I get the following error message:
Traceback (most recent call last):
  File "/home/<user>/.local/lib/python3.5/site-packages/electrum_nmc/plugins.py", line 151, in get_hardware_support
    p = self.get_plugin(name)
  File "/home/<user>/.local/lib/python3.5/site-packages/electrum_nmc/plugins.py", line 179, in get_plugin
    self.load_plugin(name)
  File "/home/<user>/.local/lib/python3.5/site-packages/electrum_nmc/plugins.py", line 104, in load_plugin
    plugin = p.Plugin(self, self.config, name)
  File "/home/<user>/.local/lib/python3.5/site-packages/electrum_nmc_plugins/trezor/trezor.py", line 120, in __init__
    import trezorlib.ckd_public
  File "/home/<user>/.local/lib/python3.5/site-packages/trezorlib/ckd_public.py", line 5, in <module>
    from .tests.support.ckd_public import *  # noqa
ImportError: No module named 'trezorlib.tests.support'

Where can I find this module (trezorlib.tests.support) or do I have to install some additional package? I also installed
https://github.com/trezor/python-trezor
But this did not help.
Any suggestions?
BTW: I do not understand the following message at the beginning of the issues text box:

Do not post issues about non-bitcoin versions of Electrum.

This makes no sense since this is the namecoin fork of electrum. Right?

Same error with electrum-ltc :-(

Ok. I figured the error out.
 I only wanted to say that :-P
Firstly, the Trezor T is not working at all, not for electrum, electrum-ltc and electrum-nmc.
Secondly, if one follows the README.md at
https://github.com/trezor/python-trezor
for the Trezor T with
pip3 install --upgrade setuptools
pip3 install trezor

then the directory
/home//.local/lib/python3.5/site-packages/trezorlib/tests/support
is missing. However, this directory exists in the current github snapshot.
What I did was to install python-trezor as recommended in the corresponding README.md file. Thus, the directory structure in .local/lib/python3.5/site-packages/trezorlib is created. The I clonee the current python-trezor project. Therein exists an folder trezorlib. I renamed the already existing trezorlib directory to trezorlib.old and copied the trezorlib directory from the git clone to this location. Then I copied the file trezorlib.old/coins.json to trezorlib. This is necessary, otherwise the electrums will complain. Then follow the normal electrum procedure for creating a wallet mit hardware wallet support. Make sure that you have connected the Trezor T to your computer and that the device is unlocked. The device should be detected by the system.

FWIW this is fixed in electrum commit https://github.com/spesmilo/electrum/commit/208606beda445c243620727c68ad19b85e47ada2
you can cherry-pick that commit into your repository; it's isolated to the Trezor plugin
i'll also do a point release to fix the packaging issue

BTW: I do not understand the following message at the beginning of the issues text box:

Do not post issues about non-bitcoin versions of Electrum.

This makes no sense since this is the namecoin fork of electrum. Right?

@curiosity81 You've run into https://github.com/namecoin/electrum-nmc/issues/4 .

FWIW this is fixed in electrum commit spesmilo/electrum@208606b
you can cherry-pick that commit into your repository; it's isolated to the Trezor plugin
i'll also do a point release to fix the packaging issue

@matejcik Thanks for the upstream fix, I'll merge that along with the next merge from upstream.

The relevant upstream fix is now merged.


CAMEL-11645 - Add pattern exclusion mechanism similar to the one prov…

…ided by the camel-zipkin component

Thanks the PR has been merged. Can you close this?


SQS create permission required

Type: Bug
Component:
SQS
Describe the bug
Using STS to assume roles on AWS env thrown the error bellow:
Caused by: software.amazon.awssdk.services.sqs.model.SqsException: User: {the user ARN} is not authorized to perform: sqs:createqueue on resource: {the queue ARN} because no identity-based policy allows the sqs:createqueue action (Service: Sqs, Status Code: 403, Request ID: 78c99551-dfbc-5dea-ae56-c81aa731ab40)
From the docs (here), the permission sqs:createqueue isn't required.
I wondering if something is missing to tell awsspring-sqs to not try to create the queue or if this behavior is a bug or something.
Worth to mention, if I use an account with the required permission (via assume role, same config just change the login user) everything works fine.
Sample
Can't provide a sample since basically I'am trying to start the application with assume role configs for authorization, using configs described here

Hi @swagregorio.
The framework will try to create the queue if the queue is not found at startup and ContainerOptions#queueNotFoundStrategy is set to CREATE (which is the default).
If you don't have permissions to create queues, you can set it to FAIL for a more descriptive error.
Let me know if that works for you.
Thanks.

Uhm, thats the point, the queue was there, created but the only thing missing was the permission.
After added the permission to the role everything worked fine, same happened for an SNS topic, it already exists but the role I was assuming didn't have create permission. I was relaying in the docs again to use the required ones described there.
I will have a look in the class you've mentioned to try to figure out what could be happening.

Hi @swagregorio, that's strange - the 2.x version did use the createQueue  method to get information from the queue, but the 3.x version purposely does it differently and only uses the createQueue method if the queue does not exist and the framework is configured to do so.
It'd be great if you could take a look into it and confirm if this was really the case, or if the queue might have been missing at the time for any reason.

I can ensure the Queue is already created, the only thing was missing was the createQueue/createTopic role. I will try to create a test scenario to reproduce it since using localstack I could not do it.

I can ensure the Queue was already created, the only thing was missing was the createQueue/createTopic role. I will try to create a test scenario to reproduce it since using localstack I could not do it.

Thanks @swagregorio.
You can see here that we use the getQueueUrl method, and only if a QueueDoesNotExistException is thrown we use the createQueue method.
https://github.com/awspring/spring-cloud-aws/blob/a45e735ea24686152717683cd524ebd3f2fa9ced/spring-cloud-aws-sqs/src/main/java/io/awspring/cloud/sqs/QueueAttributesResolver.java#L99-L119
I don't see in this logic how the create queue permission might be required, but I might be missing something.

Closing due to lack of feedback

Just in case anyone else should come across this while searching for this error as we did -
In our case we hit this issue when we had been using a queue name in our config. Once we switched to using the queue URL instead, the issue went away. Presumably this is due to the URL containing the account number and region, while the name doesn't.

Hey @dezzak, after you successfully ran it the first time, did you still need to have the url instead of the name?

Hi @tomazfernandes in our case we can't start the application with just a queue name, we need the full url. Our case may be further complicated with it involving cross-account access (the application runs in one AWS account, but the queue is in another)

I encountered the same issue and I realized that my application was not granted permission GetQueueUrl, to fix that, I added permission but had to restart the service as well. Because doResolveQueueUrl was only called at the first time sending the message.

This is still reproducing with 3.0.1 and it is a bug. Because the error message should be e.g. "Failed to resolve queue url from the queue name" whereas, apparently the aws sdk call is made for GetQueueUrl and that is responding with 403 if that permission is not given, and this library is silencing that exception and proceeding to the queue creation code path, just like if it received a "queue doesn't exist" response, but that's not the case, it just received a 403 forbidden error from the sdk. I wish I had time to create a pr to fix this. But at least just taking down what is the bug here. Might be fixed in later versions, we tested with 3.0.1 today.

I had the same problem with 3.1.1. Had to

I encountered the same issue and I realized that my application was not granted permission GetQueueUrl, to fix that, I added permission but had to restart the service as well. Because doResolveQueueUrl was only called at the first time sending the message.

Same here.


Create RPM automation packaging

Created RPM build automation through circleci and local Makefile.

Current coverage is 47.92%

Merging #252 into master will decrease coverage by -20.90% as of d92af82

@@            master    #252   diff @@
======================================
  Files           71      68     -3
  Stmts         2566    2694   +128
  Branches         0       0
  Methods          0       0
======================================
- Hit           1766    1291   -475
  Partial          0       0
- Missed         800    1403   +603

Review entire Coverage Diff as of d92af82

Uncovered Suggestions

+0.78% via ...stone/core/models.py#39...59
+0.70% via ...stone/core/models.py#16...34
+0.66% via ...stone/core/models.py#2637...2654
See 7 more...

Powered by Codecov. Updated on successful CI builds.

:+1: we'll need to build new images to match the versions, but I've merged this to get us started.


Codechecker v6.22.2 doesn't work on Windows

Describe the bug
During source code analyzing CodeChecker fail with an error "AttributeError: module 'os' has no attribute 'uname'"
CodeChecker version
v6.22.2
To Reproduce
C:>CodeChecker analyze project/build/release/compile_commands.json --enable sensitive --output reports
Traceback (most recent call last):
File "c:\python\lib\site-packages\codechecker_common\cli.py", line 167, in main
add_subcommand(subparsers, subcommand,
File "c:\python\lib\site-packages\codechecker_common\cli.py", line 57, in add_subcommand
command_module.add_arguments_to_parser(sc_parser)
File "C:\Python\Lib\site-packages\codechecker_analyzer/cmd\analyze.py", line 456, in add_arguments_to_parser
clang_has_z3 = analyzer_types.is_z3_capable()
File "c:\python\lib\site-packages\codechecker_analyzer\analyzers\analyzer_types.py", line 73, in is_z3_capable
enabled_analyzers, _ = check_supported_analyzers([ClangSA.ANALYZER_NAME])
File "c:\python\lib\site-packages\codechecker_analyzer\analyzers\analyzer_types.py", line 144, in check_supported_anal
yzers
context = analyzer_context.get_context()
File "c:\python\lib\site-packages\codechecker_analyzer\analyzer_context.py", line 314, in get_context
return Context()
File "c:\python\lib\site-packages\codechecker_common\singleton.py", line 20, in call
super(Singleton, cls).call(*args, **kwargs)
File "c:\python\lib\site-packages\codechecker_analyzer\analyzer_context.py", line 68, in init
machine = os.uname().machine
AttributeError: module 'os' has no attribute 'uname'
Expected behaviour
CodeChecker will analyze the source code
Desktop (please complete the following information)

OS: Windows 64

This has been fixed by #4012. Please, try the latest master version. The next release is coming soon, which contains this fix too. I close this ticket, but feel free to reopen if the problem still occurs.


Apple-touch-icon link not converted to data url

I am trying to convert an SPA for adding it to an iPhone's home screen, but inliner does not convert the icon href to a data URL:
<link rel="apple-touch-icon" href="....">

The code for converting would be similar to how the favicon task is handled, and I tested that it works perfectly if I just replace:
favicon: 'link[rel=icon],link[rel="shortcut icon"]',

with
favicon: 'link[rel=icon],link[rel="shortcut icon"],link[rel="apple-touch-icon"]',

Do you want a PR or is this small enough that you would just prefer to patch it yourself?

There is also link[rel="apple-touch-startup-image"] which can be used by a home screen app, which is currently not converted.

Sure, I'll take a PR, cheers.
On Sun, 24 Sep 2017, 03:11 Antti Vähäkotamäki<EMAIL_ADDRESS>wrote:

There is also link[rel="apple-touch-startup-image"] which can be used by
a home screen app, which is currently not converted.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/remy/inliner/issues/159#issuecomment-331681849, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAA1hOgxtMmyps-UAZjQi7MoCNepBgOOks5slbo3gaJpZM4PhvI0
.

#160

Seems to be failing for code style errors. I will fix that ;)

It is green now. Any requests for additions/modifications to the PR?

I'm putting together a presentation where I would love to showcase some cool things you can do with inliner (among other tools), and this feature would be among them. @remy can you tell if there is anything I can do to the pull request #160 that would expedite it getting into the upstream release? The change is quite small and trivial so I did not make additional tests, but I would be happy to do that, or any other changes that you deem necessary.


Collapse FAT16 and FAT32 into one type.

Resolves https://github.com/thejpster/embedded-sdmmc-rs/issues/10

So if anyone wants to give this a spin on real hardware, feel free! I'll probably merge it next week unless anyone finds anything.


clarification needed

"If you expand your VNET after creating the cluster, you must update your cluster before adding a subnet outside the original CIDR block."
when is says UPDATE , can you please add a link to the command referenced ?
https://learn.microsoft.com/en-us/cli/azure/aks?view=azure-cli-latest#az-aks-update()
or can you use update/reconcile  instead?

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 22fbdc3f-fbd1-9cbb-ca03-ad01d145e821
Version Independent ID: ca927327-0132-f406-52e3-033c6a529245
Content: Create node pools in Azure Kubernetes Service (AKS) - Azure Kubernetes Service
Content Source: articles/aks/create-node-pools.md
Service: azure-kubernetes-service
GitHub Login: @MGoedtel
Microsoft Alias: magoedte

@porrascarlos802018
Thanks for your feedback! We will investigate and update as appropriate.

Hi @porrascarlos802018
The documentation mentions that you need to update your cluster after expanding your VNET and before adding a subnet outside the original CIDR block. You can use the az aks update command to update your AKS cluster. Here is the link to the command reference: https://learn.microsoft.com/en-us/cli/azure/aks?view=azure-cli-latest#az-aks-update(). Alternatively, you can use the update or reconcile command to update your node pools. Here is the link to the documentation that explains how to create node pools and the limitations associated with it: https://learn.microsoft.com/en-us/azure/aks/create-node-pools#limitations-2. Let me know if you have any other questions.

@MGoedtel
Can you please check and add your comments on this doc update request as applicable.

The details in this section regarding the use of the Az aks update command for this scenario is accurate. I've considered your suggestion and decided to revise the wording of that sentence and linked to the API reference for az aks update command, even though it's not unreasonable to think that someone would be able to navigate to that page in a separate tab. See PR -  https://github.com/MicrosoftDocs/azure-docs-pr/pull/257678.
Thanks.  #please-close


Release Google.Cloud.Security.PrivateCA.V1 version 2.2.0

Changes in this release:
New features

Add IAM and Location mixins to Google.Cloud.Security.PrivateCA.V1 (commit d2ea336)

Documentation improvements

Mark CaPool.lifetime as IMMUTABLE (commit 0139338)
Add format requirements on custom_sans (commit 0139338)

Created release for Google.Cloud.Security.PrivateCA.V1-2.2.0


Option to allow managers to post as the account (Not just reposting)

There could be moments where you as the group manager want to post an update about the group (i.e. new "rules" you want to enforce for what gets reposted), so an option to send a post as the group account would be quite useful to have.
Maybe also an option to pin a post (for people viewing from Mastodon)?

I think both posting and pinning by the group manager is a good idea!

I have created the interface for posting as the group. Right now it's not possible to undo or edit the message, so I'll keep this open until that's resolved.
@Andre601


Package: noso_template

noso_template is a not-quite-isometric (so, nosometric) template useful for drawing 3d-ish isometric-ish images. Quick outlining of basic woodworking projects is a good example usage.
This adds the default templates included at https://github.com/RobotCaleb/noso_template
I am the author of both this package and the templates.
I have only tested the templates (but not this package, I don't know how to do that) on RM2 but I understand the displays are the same.

Cool, thanks! Could you tell me how to point my instance to the testing repository so I can fiddle with this on my end?

Cool, thanks! Could you tell me how to point my instance to the testing repository so I can fiddle with this on my end?

Testing only contains things that have been merged, so you won't be able to fiddle that way. What you can do though is use toltecmk to test building packages locally. Then you can send the ipk file to your device and install it with opkg install /path/to/file.ipk

@RobotCaleb how are things going? Do you need help getting toltecmk to work?

No. I was playing with templatectl and I think I have the commands fixed
but while using templatectl my rm2 stopped working. It just boots to
"remarkable is starting" and no further. So I ordered hardware and am going
to attempt recovery. :(
On Mon, Mar 28, 2022 at 8:24 AM Nathaniel van Diepen <
@.***> wrote:

@RobotCaleb https://github.com/RobotCaleb how are things going? Do you
need help getting toltecmk to work?
—
Reply to this email directly, view it on GitHub
https://github.com/toltec-dev/toltec/pull/573#issuecomment-1080721552,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAA3V6M3CWARD43U3S7YKLLVCG6JJANCNFSM5RF4DMDA
.
You are receiving this because you were mentioned.Message ID:
@.***>

Are you not able to SSH in over USB?

I ... didn't know that was a thing. I've always gone in over wifi. I appear to be in over USB. I'll see what went wrong. :(
Thanks!

I'm up and running again. Thanks @Eeems, I really appreciate the tip and help.
I will get back to this as soon as the latest update is supported.

@RobotCaleb poke

Thanks for the reminder. Unless there's a way to install the latest supported firmware on my device it looks like I'm back to waiting for the latest version to be supported. I guess I should stop allowing auto updates, but that doesn't seem like it'll necessarily help. As, whenever I do enable it again, it seems there's a good chance that whatever it gets won't be supported by toltec. Is there a way I can download <IP_ADDRESS>6 manually and install it to my device to revert to that?

Is there a way I can download <IP_ADDRESS>6 manually and install it to my device to revert to that?

https://github.com/ddvk/remarkable-update reach out to me on discord if you need help finding the file to install.

reMarkable: ~/ opkg install template-noso-grid_1.0.0_rmall.ipk
Installing template-noso-grid (1.0.0) to root...
Configuring template-noso-grid.
Template file /usr/share/remarkable/templates/templates.json has changed.  You may need to restart xochitl for the changes to take effect.
Template file /usr/share/remarkable/templates/templates.json has changed.  You may need to restart xochitl for the changes to take effect.
Template file /usr/share/remarkable/templates/templates.json has changed.  You may need to restart xochitl for the changes to take effect.
Template file /usr/share/remarkable/templates/templates.json has changed.  You may need to restart xochitl for the changes to take effect.
Template file /usr/share/remarkable/templates/templates.json has changed.  You may need to restart xochitl for the changes to take effect.
Template file /usr/share/remarkable/templates/templates.json has changed.  You may need to restart xochitl for the changes to take effect.```

I think this is now doing the right thing. I have the templates appearing in my UI. I rebased it again testing branch from here.

Okay, updated the template-cartesian-graph package as well

I don't know, then. It wasn't working that way. I will play with it some
more I guess.
On Wed, Sep 28, 2022, 09:35 Nathaniel van Diepen @.***>
wrote:

@.**** requested changes on this pull request.
In package/template-cartesian-graph/package
https://github.com/toltec-dev/toltec/pull/573#discussion_r982562962:

@@ -16,9 +16,9 @@ source=("https://github.com/PeterGrace/template-cartesian-graph/archive/v${pkgve
sha256sums=(d3215546c6fd709bb5988b7042ce5fb990d9a030d783ed7505fcc2dbedbc0e0f)

package() {

install -D -m 755 -t "$pkgdir"/opt/share/remarkable/templates \

templatectl handles copying these files into the correct place. This will
need to be reverted as we don't want this package to install to the root
partition and fill it up.
In package/template-noso-grid/package
https://github.com/toltec-dev/toltec/pull/573#discussion_r982563329:

+pkgnames=(template-noso-grid)
+pkgdesc="Nosometric grid template"
+url=https://github.com/RobotCaleb/noso_template
+pkgver=1.0.0
+timestamp=2022-03-20T18:34Z
+section= https://github.com/RobotCaleb/noso_template+pkgver=1.0.0+timestamp=2022-03-20T18:34Z+section="templates"
+maintainer="Caleb Anderson @.**>"
+license=MIT
+installdepends=(templatectl)
+
+source=("https://github.com/RobotCaleb/noso_template/archive/refs/tags/v${pkgver%-}.zip")
+sha256sums=(cd7cfcb0c2e9b9734a5e79c00182a4d27858e2c6e2501da54f4d58569171a734)
+
+package() {

install -D -m 755 -t "$pkgdir"/usr/share/remarkable/templates \

These should be installed to opt, templatectl handles getting things into
the correct locations.
—
Reply to this email directly, view it on GitHub
https://github.com/toltec-dev/toltec/pull/573#pullrequestreview-1123925365,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAA3V6LJEC7C77MAEJJO26DWARQVZANCNFSM5RF4DMDA
.
You are receiving this because you were mentioned.Message ID:
@.***>

You can find the templatectl source here: https://github.com/PeterGrace/templatectl
The templatectl package also manages doing a bind mount to make sure that templates don't fill up the root partition: https://github.com/toltec-dev/toltec/blob/stable/package/templatectl/package#L36-L37
This makes it so that templates can be stored in /opt/share/remarkable/templates, and the contents of that folder will be mounted to /usr/share/remarkable/templates.

Oh, interesting. That definitely wasn't mounted for me.
reMarkable: ~/ which templatectl
/opt/bin/templatectl
reMarkable: ~/ opkg remove templatectl
No packages removed.
Collected errors:
 * print_dependents_warning: Package templatectl is depended upon by packages:
 * print_dependents_warning:    template-cartesian-graph
 * print_dependents_warning:    template-noso-grid
 * print_dependents_warning: These might cease to work if package templatectl is removed.

 * print_dependents_warning: Force removal of this package with --force-depends.
 * print_dependents_warning: Force removal of this package and its dependents
 * print_dependents_warning: with --force-removal-of-dependent-packages.
reMarkable: ~/ opkg remove templatectl --force-depends
Removing package templatectl from root...
No existing bind mount for '/usr/share/remarkable/templates'
No packages removed.
Collected errors:
 * pkg_run_script: package "templatectl" postrm script returned status 1.
reMarkable: ~/ opkg install templatectl
Installing templatectl (0.1.3-3) to root...
Downloading https://toltec-dev.org/stable/rmall/templatectl_0.1.3-3_rmall.ipk
Configuring templatectl.
Mounting '/home/root/.entware/share/remarkable/templates' over '/usr/share/remarkable/templates'
Created symlink /etc/systemd/system/local-fs.target.wants/usr-share-remarkable-templates.mount → /lib/systemd/system/usr-share-remarkable-templates.mount.
If you perform a system upgrade that adds new templates
Manual intervention may be required to handle adding the new templates

I have reverted and redone a small fix to categories for noso.
My testing log:
➜ toltecmk package/template-noso-grid/
[    INFO] toltec.builder: Fetching source files
[    INFO] toltec.builder: Packaging build artifacts for template-noso-grid
[    INFO] toltec.builder: Creating archive rmall/template-noso-grid_1.0.0_rmall.ipk
[    INFO] toltec.repo: Generating package index

➜ toltecmk package/template-cartesian-graph/
The build directory '/home/caleb/dev/remarkable/toltec/build' already exists.
Would you like to [c]ancel, [r]emove that directory, or [k]eep it (not recommended)? [C/r/k] r
[    INFO] toltec.builder: Fetching source files
[    INFO] toltec.builder: Packaging build artifacts for template-cartesian-graph
[    INFO] toltec.builder: Creating archive rmall/template-cartesian-graph_1.0.0-4_rmall.ipk
[    INFO] toltec.repo: Generating package index

➜ scp dist/rmall/template-* remarkable:
template-cartesian-graph_1.0.0-4_rmall.ipk                                    100%   12KB 205.4KB/s   00:00
template-noso-grid_1.0.0_rmall.ipk                                            100% 1438KB   1.5MB/s   00:00

➜ ssh remarkable

reMarkable: ~/ ls *.ipk
template-cartesian-graph_1.0.0-4_rmall.ipk  template-noso-grid_1.0.0_rm
all.ipk
reMarkable: ~/ opkg install template-cartesian-graph_1.0.0-4_rmall.ipk
Installing template-cartesian-graph (1.0.0-4) to root...
Installing templatectl (0.1.3-3) to root...
Downloading https://toltec-dev.org/stable/rmall/templatectl_0.1.3-3_rmall.ipk
Configuring templatectl.
Mounting '/home/root/.entware/share/remarkable/templates' over '/usr/share/remarkable/templates'
Created symlink /etc/systemd/system/local-fs.target.wants/usr-share-remarkable-templates.mount → /lib/systemd/system/usr-share-remarkable-templates.mount.
If you perform a system upgrade that adds new templates
Manual intervention may be required to handle adding the new templates
Configuring template-cartesian-graph.
Template file /usr/share/remarkable/templates/templates.json has changed.  You may need to restart xochitl for the changes to take effect.

reMarkable: ~/ opkg install template-noso-grid_1.0.0_rmall.ipk
Installing template-noso-grid (1.0.0) to root...
Configuring template-noso-grid.
Template file /usr/share/remarkable/templates/templates.json has changed.  You may need to restart xochitl for the changes to take effect.
Template file /usr/share/remarkable/templates/templates.json has changed.  You may need to restart xochitl for the changes to take effect.
Template file /usr/share/remarkable/templates/templates.json has changed.  You may need to restart xochitl for the changes to take effect.
Template file /usr/share/remarkable/templates/templates.json has changed.  You may need to restart xochitl for the changes to take effect.
Template file /usr/share/remarkable/templates/templates.json has changed.  You may need to restart xochitl for the changes to take effect.
Template file /usr/share/remarkable/templates/templates.json has changed.  You may need to restart xochitl for the changes to
 take effect.
reMarkable: ~/

As far as I can tell this all works fine. I notice you originally said you were testing on rm1, maybe that's different and neither of these packages should target that device?

There should be no differences between rM1 and rM2 for these packages.

Okay. Is there anything else that needs to be addressed here?

For some reason the bind mount was missing for me, even though templatectl was installed. We'll have to solve that in a different PR.


feat: use direct links to download all files

This closes #1887 by using the gateway URLs to download the files. There's two things to mention:

I tried creating an anchor element to download the file with a name via the download attribute, but it seems to still use the name get.tar.gz sadly. Any suggestions?
There's some other code that used to show download progress. Should I remove it? I don't think it is used anywhere else in the code so it feels safe to remove unless it can be used for any planned feature.

License: MIT
Signed-off-by: Henrique Dias<EMAIL_ADDRESS>

The TARs are a thing on the gateway now: https://github.com/ipfs/kubo/pull/9029
This PR can be unblocked and worked on 😃

I decided to revitalise this PR since we now have TAR response formats on our gateway (https://github.com/ipfs/kubo/pull/9029). That lets us download directories directly from the gateway without the need to use the API v0 POST method. Therefore, we do not need to keep anything in memory and it is all streamed to the user. This allows to massively simplify the code, removing a lot of old bits that are no longer relevant 🪩
This can be tested with Kubo from master, and with 0.17.0 RC-1. I'll mark this as ready for review as its been open for many months, but it's finally possible to review and test this PR.

@SgtPooki @whizzzkid I addressed most of your comments (see replies). This is the behaviour of the current PR:
https://user-images.githubusercontent.com/5447088/201318295-aa0d3d56-d6d7-43a7-ba6b-d8e15022bc30.mp4

Do we expect any issues with how this will work within electron?

Do we expect any issues with how this will work within electron?

I think it should be fine. We already had download links we this behaviour before and they were not a problem.


FlywayConfig

First of all, I thank you for sharing your knowledge with us and for the work for having written this blog that has been very useful to me, I have followed all the steps of the blog but in the last point it is failing me with this message
Parameter 0 of method tenantsFlyway in com.amadeuscam.MultiTenantTestApp.jwt.config.FlywayConfig required a bean of type 'io.quantics.multitenant.tenantdetails.TenantSchemaDetailsService' that could not be found.
Action:Consider defining a bean of type 'io.quantics.multitenant.tenantdetails.TenantSchemaDetailsService' in your configuration.
It will be because the Service annotation to that class is missing in the library?

Thank you!!

Perfect, thanks !


WIP: Add [Entity] and [Index] in order to automatically ensure indexes of all entities

Add [Entity] and [Index] in order to automatically ensure indexes of all entities
We want an easy way to declare and ensure indexes on MongoDB collections. The path chosen for this involves marking your entities with [Entity] and the properties you wish indexed marked with [Index].
Compound indexes are also supported - even across inheritance levels and nested documents. Documentation will follow in the docs repository.
An example:
namespace My.Entities
{
	[Entity]
	public class AwesomeEntity
	{
		[Index]
		public string MustBeFast { get; set; }

		public SubDocument Nested { get; set; }
	}

	public class SubDocument
	{
		[Index("with_a_name")]
		public int Important { get; set; }
	}
}

namespace My.Main
{
	public class SetItAllUpAndStuff
	{
		public void Start()
		{
			var client = new MongoClient(connectionString);
			new MongoManager().EnsureIndexes(
				client.GetDatabase("SoAwesome"),
				typeof(AwesomeEntity).GetTypeInfo().Assembly,
				typeof(AwesomeEntity).GetTypeInfo().Namespace
			);
		}
	}
}

@nover We should also find a way to run the functional tests during the AppVeyor build. There is a docker-compose file, so we just need to start that.

@pingvinen yeah we need something there - unfortunately it does not look like AppVeyor have capability for starting docker containers and linking them during the test phase.

There is actually a bug in how the code generates nested indexes.

Fixed the bug with not including a path to nested field in the keys.


forward plugin is not compatible with k8s-gateway?

hello:
I found something wrong when confihured forward in Corefile, like:
.:53 {
  errors
  health
  k8s_gateway test.exampe.com {
     resources Ingress
     ttl 30
     kubeconfig kubeconfig/kube.config
  }
  hosts data/hostsfile {
     fallthrough
  }
  forward . <IP_ADDRESS>:53
  log
  reload
}

and I exec command dig console.test.example.com  , it reply nothing, and log shows
[ERROR] plugin/errors: 2 console.test.exampe.com, A: read udp <IP_ADDRESS>:48199 -> <IP_ADDRESS>:53: i/o timeout

when I remove forward . <IP_ADDRESS>:53, and it works

most likely this means that there was no response from <IP_ADDRESS>. can you "dig @<IP_ADDRESS> console.test.example.com" from your local shell?


Multiple groups of nodes are distributed

Hey,
I have multiple groups of nodes which are not linked together. The algorithm distributes them on my whole viewport leaving a lot of empty space between each group. Is it possible to condense groups together so they use minimal amount of space required?

In fact, we are currently working on a utility for this in a separate repo, and hope to apply it to all algorithms produced by our lab. We'll let you know when it's ready!

Sure thanks. I've just played with gravityRange and putting it to something smaller like 1.3 gives me pretty nice graph. Thanks!

Yes, increasing gravity should work to a certain extent. Tighter drawing can be obtained by some extra work as I said though. We'll keep you posted.


[EPIC] Support TPC-DS benchmarks

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
I would like to be able to run all TPC-DS queries with DataFusion, but some are not yet supported.
I am testing with SQLBench-DS and I am seeing some failures. Many of these affect multiple queries but I have just listed a single example query here for each type of error.
I plan on filing detailed issues for each one and linking here.
I am testing with DataFusion 15.0.0

https://github.com/apache/arrow-datafusion/issues/4794
https://github.com/apache/arrow-datafusion/issues/123
At least two values are needed to calculate variance (q17)
The type of Int32 = Int64 of binary physical should be same (q72)
physical plan is not yet implemented for GROUPING aggregate function (q27)
Projections require unique expression names but the expression "MAX(customer_demographics.cd_dep_count)" at position 6 and "MAX(customer_demographics.cd_dep_count)" at position 7 have the same name. Consider aliasing ("AS") one of them. (q35)
The function Stddev does not support inputs of type Decimal128(7, 2). (q74)

Describe the solution you'd like
Support all the queries.
Describe alternatives you've considered
N/A
Additional context
N/A

I just tried running TPC-DS with DataFusion 39 and these are the failing queries currently:
Executing query 10 from ../../tpcds/queries-spark/q10.sql
Fail: This feature is not implemented: Physical plan does not support logical expression Exists(Exists { subquery: <subquery>, negated: false })
Executing query 11 from ../../tpcds/queries-spark/q11.sql

Executing query 27 from ../../tpcds/queries-spark/q27.sql
Fail: External error: This feature is not implemented: physical plan is not yet implemented for GROUPING aggregate function

Executing query 35 from ../../tpcds/queries-spark/q35.sql
Fail: Error during planning: Projections require unique expression names but the expression "STDDEV(customer_demographics.cd_dep_count)" at position 6 and "STDDEV(customer_demographics.cd_dep_count)" at position 7 have the same name. Consider aliasing ("AS") one of them.
Executing query 36 from ../../tpcds/queries-spark/q36.sql
Fail: External error: External error: This feature is not implemented: physical plan is not yet implemented for GROUPING aggregate function

Executing query 41 from ../../tpcds/queries-spark/q41.sql
Fail: check_analyzed_plan
caused by
Error during planning: Correlated column is not allowed in predicate: item.i_manufact = outer_ref(i1.i_manufact) AND (item.i_category = Utf8("Women") AND (item.i_color = Utf8("cream") OR item.i_color = Utf8("ghost")) AND (item.i_units = Utf8("Ton") OR item.i_units = Utf8("Gross")) AND (item.i_size = Utf8("economy") OR item.i_size = Utf8("small")) OR item.i_category = Utf8("Women") AND (item.i_color = Utf8("midnight") OR item.i_color = Utf8("burlywood")) AND (item.i_units = Utf8("Tsp") OR item.i_units = Utf8("Bundle")) AND (item.i_size = Utf8("medium") OR item.i_size = Utf8("extra large")) OR item.i_category = Utf8("Men") AND (item.i_color = Utf8("lavender") OR item.i_color = Utf8("azure")) AND (item.i_units = Utf8("Each") OR item.i_units = Utf8("Lb")) AND (item.i_size = Utf8("large") OR item.i_size = Utf8("N/A")) OR item.i_category = Utf8("Men") AND (item.i_color = Utf8("chocolate") OR item.i_color = Utf8("steel")) AND (item.i_units = Utf8("N/A") OR item.i_units = Utf8("Dozen")) AND (item.i_size = Utf8("economy") OR item.i_size = Utf8("small"))) OR item.i_manufact = outer_ref(i1.i_manufact) AND (item.i_category = Utf8("Women") AND (item.i_color = Utf8("floral") OR item.i_color = Utf8("royal")) AND (item.i_units = Utf8("Unknown") OR item.i_units = Utf8("Tbl")) AND (item.i_size = Utf8("economy") OR item.i_size = Utf8("small")) OR item.i_category = Utf8("Women") AND (item.i_color = Utf8("navy") OR item.i_color = Utf8("forest")) AND (item.i_units = Utf8("Bunch") OR item.i_units = Utf8("Dram")) AND (item.i_size = Utf8("medium") OR item.i_size = Utf8("extra large")) OR item.i_category = Utf8("Men") AND (item.i_color = Utf8("cyan") OR item.i_color = Utf8("indian")) AND (item.i_units = Utf8("Carton") OR item.i_units = Utf8("Cup")) AND (item.i_size = Utf8("large") OR item.i_size = Utf8("N/A")) OR item.i_category = Utf8("Men") AND (item.i_color = Utf8("coral") OR item.i_color = Utf8("pale")) AND (item.i_units = Utf8("Pallet") OR item.i_units = Utf8("Gram")) AND (item.i_size = Utf8("economy") OR item.i_size = Utf8("small")))

Executing query 45 from ../../tpcds/queries-spark/q45.sql
Fail: This feature is not implemented: Physical plan does not support logical expression InSubquery(InSubquery { expr: Column(Column { relation: Some(Bare { table: "item" }), name: "i_item_id" }), subquery: <subquery>, negated: false })

Executing query 70 from ../../tpcds/queries-spark/q70.sql
Fail: External error: External error: This feature is not implemented: physical plan is not yet implemented for GROUPING aggregate function

Executing query 72 from ../../tpcds/queries-spark/q72.sql
Fail: type_coercion
caused by
Error during planning: Cannot coerce arithmetic expression Date32 + Int64 to valid types

Executing query 74 from ../../tpcds/queries-spark/q74.sql
Fail: Error during planning: No function matches the given name and argument types 'STDDEV(Decimal128(7, 2))'. You might need to add explicit type casts.
	Candidate functions:
	STDDEV(Int8/Int16/Int32/Int64/UInt8/UInt16/UInt32/UInt64/Float32/Float64)

Executing query 75 from ../../tpcds/queries-spark/q75.sql
Fail: External error: External error: External error: External error: Arrow error: Invalid argument error: RowConverter column schema mismatch, expected Int32 got Int64

Executing query 86 from ../../tpcds/queries-spark/q86.sql
Fail: External error: External error: This feature is not implemented: physical plan is not yet implemented for GROUPING aggregate function

I think q41 is the latest one that has to be supported, is that right @eejbyfeldt ?

Actually, some of those errors seem to be runtime errors, so we need to check against some dataset as well.
I'll create some issues for testing this.

If I try to run the version of the queries we have in the datafusion repo against scala factor 1. Only q41 produces a hard error. But there are likely issues with the results for some of them.

I'll create some issues for testing this.

Sounds great! In the long run it would be nice to have it part of CI like we do for TPC-H.

Cool, that sounds promising @eejbyfeldt thanks for the hard work on supporting them!

@andygrove @eejbyfeldt I updated the epic with tasks to support / test / verify the queries.

this problem with q35, taken from the description above:
- `Projections require unique expression names but the expression "MAX(customer_demographics.cd_dep_count)" at position 6 and "MAX(customer_demographics.cd_dep_count)" at position 7 have the same name. Consider aliasing ("AS") one of them.` (q35)

seems to be some sort of bug in query generation for tpc-ds. For me the provided dsqgen binary creates the query 35 as something like:
select
  ca_state,
  cd_gender,
  cd_marital_status,
  cd_dep_count,
  count(*) cnt1,
  max(cd_dep_count),
  stddev_samp(cd_dep_count),
  stddev_samp(cd_dep_count),
  cd_dep_employed_count,
  count(*) cnt2,
  max(cd_dep_employed_count),
  stddev_samp(cd_dep_employed_count),
  stddev_samp(cd_dep_employed_count),
  cd_dep_college_count,
  count(*) cnt3,
  max(cd_dep_college_count),
  stddev_samp(cd_dep_college_count),
  stddev_samp(cd_dep_college_count)
 from
  customer c,customer_address ca,customer_demographics
  ...

This has multiple columns that would resolve to the same name, like stddev_samp(cd_dep_count, violating the unique column name constraint enforced in datafusion logical plan builder.
I believe this is not intentional, as the query template goes like this:
 [_LIMITA] select [_LIMITB]
  ca_state,
  cd_gender,
  cd_marital_status,
  cd_dep_count,
  count(*) cnt1,
  [AGGONE](cd_dep_count),
  [AGGTWO](cd_dep_count),
  [AGGTHREE](cd_dep_count),
  cd_dep_employed_count,
  count(*) cnt2,
  [AGGONE](cd_dep_employed_count),
  [AGGTWO](cd_dep_employed_count),
  [AGGTHREE](cd_dep_employed_count),
  cd_dep_college_count,
  count(*) cnt3,
  [AGGONE](cd_dep_college_count),
  [AGGTWO](cd_dep_college_count),
  [AGGTHREE](cd_dep_college_count)
 from
  customer c,customer_address ca,customer_demographics

latest spec mentions this about q35:
Qualification Substitution Parameters:
• YEAR.01 = 2002
• AGGONE = min
• AGGTWO = max
• AGGTHREE = avg

so all aggregates are different than each other, if the template was used with the substitutions listed in the spec, no duplicates should occur, and this query can be executed successfully with the main branch of datafusion as of now


Dev Prep: E2E Simple Infra

[ ] simple cypris e2e test scripts
[ ]  marker package to share between ui-components and cypris tests
[ ] documentation (a few words about approach and links to resources )

Link with integration https://github.com/zorko-io/zorko-mono/tree/master/packages/e2e-test-suite


[MB-2698 // MB-3647] Create EDI Header // Command Line utility for generating an EDI for testing with US Bank

Description
This PR tracks two JIRA stories:

MB-2698 adds the header lines to the header segment for an EDI
MB-3647 adds a CLI Utility that takes a Payment Request Number and runs the EDI generator to return the EDI858 as a sting

Setup & Review

Run your server make server_run.
Create a payment request with a Domestic Linehaul service item. Create a file called create_payment_request.json in the project root and paste in the JSON payload provided below:

{
  "body": {
    "isFinal": false,
    "moveTaskOrderID": "9c7b255c-2981-4bf8-839f-61c7458e2b4d",
    "serviceItems": [
      {
        "id": "fd6741a5-a92c-44d5-8303-1d7f5e60afbf"
      },
    ]
  }
}

Use the Prime API Client to create the payment request and return the payment request number by running the command below:

prime-api-client --insecure create-payment-request --filename  create_payment_request.json| jq '.paymentRequestNumber'

Use the CLI utility to generate the EDI858 and view it in your terminal. Remember to pass the payment request number of the payment request you just created.

go run ./cmd/generate-payment-request-edi/ --payment-request-number [$paymentRequestNumber]

Check that the output matches this sample expected output:

ISA*00*0084182369*00*_   _*ZZ*GOVDPIBS*12*8004171844*20200911*1523*U*00401*100001272*0*T*|
GS*SI*MYMOVE*8004171844*20200911*1523*100001251*X*004010
ST*858*0001
BX*00*J*PP*4659-6176*TRUS**4
N9*CN*4659-6176-1**
N9*CT*TRUSS_TEST**
N9*1W*Leo, Spacemen**
N9*ML*E_1**
N9*3L*ARMY**
G62*86*2020-09-11*0*
N1*ST**10*CNNQ
N3*Fort Gordon*
N4*Augusta*GA*30813*United States**
N1*SF*dbzwwCCg6o*10*LKNQ
N3*987 Other Avenue*P.O. Box 1234
N4*Des Moines*IA*50309*US**
HL*1**|
N9*PO*38a8822e-2bd9-464a-ac81-df83ccf5341d**
L0*1*373.000*DM*1349.000*B******L
SE*18*0001
GE*1*100001251
IEA*1*100001272

Code Review Verification Steps

[ ] Code follows the guidelines for Logging
[ ] The requirements listed in
Querying the Database Safely
have been satisfied.
Any new migrations/schema changes:

[ ] Follow our guidelines for zero-downtime deploys (see Zero-Downtime Deploys)
[ ] Have been communicated to #g-database
[ ] Secure migrations have been tested following the instructions in our docs

[ ] There are no aXe warnings for UI.
[ ] This works in Supported Browsers and their phone views (Chrome, Firefox, IE, Edge).
[ ] Tested in the Experimental environment (for changes to containers, app startup, or connection to data stores)
[ ] User facing changes have been reviewed by design.
[ ] Request review from a member of a different team.
[ ] Have the Jira acceptance criteria been met for this change?

References

JIRA Story MB-2698
JIRA Story MB-3647
this article explains more about the approach used.

Messages

:book:
:link: MB-2698, MB-3647

  Generated by :no_entry_sign: dangerJS against 0781f7292d44a6423468e38af59b79d21942b52e


added google-sharedlocations adapter

This is an adapter to poll the locations from users from Google Sharedlocations. Some users want this adapter to be in the repo.

@t4qjXH8N please provide common.license in io-package.json thank you

I think it is there, isn't it?

it exists in package.json, but not in io-package.json :-)

Sorry, it is definitely there in the io-package. json line 5. License is also showing up in the adapter list.


Slabs adjacent to snow layers get culled incorrectly

A bottom slab next to 1 layer high snow becomes partially invisible (the side facing the snow doesn't get rendered). This also happens for snow layers of different height next to each other if the difference in height is 7 pixels and neither is a full block.
This is on Forge 36.0.43

You did not specify what version of FC you're using. I assume it's 2.0.1, since this issue was fixed in 2.0.2. If you're actually experiencing this on the latest build (2.0.3) please comment on the closed issue, I'll reopen it in that case.


Support for gRPC Gateway

Mydis is based on gRPC and subsequently HTTP/2. Many environments, namely container-based cloud environments don't support HTTP/2 yet, as their reverse proxies are either based on Nginx (which doesn't support HTTP/2 in anything more than an experimental way) or some other system that hasn't added support for it yet. This limits Mydis usage in these environments.
The remedy for this seems to be to integration gRPC Gateway along with a web socket server that can route through gRPC Gateway (for streaming). Most environments are able to support web sockets since they still use HTTP/1.1. Falling back to using chunked responses would also be an option in the event web sockets aren't supported (at least for server-side push).

Fixed by #7


first version for gwas post and overlapping with qtl

some issues

gwas_results_export_2 is extracting union cs and pip of all datasets and methods. The file size of ouput is 608K for 2 datasets and 7 methods. I think that is acceptable for 8 datasets.
overlapping between qtl and gwas is assuming there is no flip issue, and just intersect with chr:pos:ref:alt , as I believe there are different mutation could occur on same position.

overlapping between qtl and gwas is assuming there is no flip issue, and just intersect with chr:pos:ref:alt , as I believe there are different mutation could occur on same position.

Great point ... no at this point we don't assume that. In TWAS we flip on the fly to make xQTL and GWAS data compatible. We do the same in enrichment analysis. Have to think of what we need to do if anything.
Glad you are starting to even address the overlapping question. We can discuss more tomorrow see what is the best way but i think we should really just try a few things to first learn the data better, and decide what's most reasonable


Support customizing GPU block dimension per map

Yes, nice addition.
However, I don't fully understand how the grid size for a >4D-map is currently computed, but can look it up by myself as it is unrelated to the PR

In the same function, it is computed as follows:

Less than 3 dimensions are rounded up to three dimensions with size=1 for extra dimensions
Anything above 3 dimensions is linearized (flattened) in kernel dimensions and then de-linearized within the map if the index is necessary


Fix Model.ask response parsing

use .chat_completion instead of .completion when parsing Model.ask as it uses the chat endpoint
Some of the LLM models have identical chat_completion and completion (eg: OpenAI), while others have different response structures returned from the API (eg: Ollama)

@mengqing Nice fix, thank you!


Publish VlsirTools/scripts/

Also helpful: stick the script in something like VlsirTools/scripts/, and then folks who pip install vlsirtools get it installed right into their PATH:
https://packaging.python.org/en/latest/guides/distributing-packages-using-setuptools/#scripts
Can make that a separate issue and/or PR if we wanna get this merged.
Originally posted by @dan-fritchman in https://github.com/Vlsir/Vlsir/issues/80#issuecomment-1692278045

I believe this should just require a setup.py option or tow.


Feature: Guardnode bids interface and auction system

Core changes:

RPCs to create bids

Bid model, serialisation, signing, list of bids in request list

Policy to update list with valid bids and load all on rescan

Bid validity check based on current auction price, request list, request height and current height

Potential issue https://github.com/commerceblock/ocean/issues/114, mostly resolved. Any thoughts?

I think that is the best option - if it does come down to it is a coin flip.

Any other comments or should I merge this?


Got "IMAGE_NOT_FOUND"  in   RNQRGenerator.detect

Hi . When I'm trying the example
const onPick = () => {     launchImageLibrary(options, (response) => {       setDetectImageUri({uri: response.uri});       RNQRGenerator.detect({uri: response.uri})         .then((res) => {           if (res.values.length === 0) {             setDetectedValues(['QR code not found']);           } else {             setDetectedValues(res.values);           }         })         .catch((err) => {           console.log('Cannot detect', err);         });     });   };
the URI from launchImageLibrary is :
"content://com.easysandbox.imagepickerprovider/cacheDir/rn_image_picker_lib_temp_10ae8dce-7af8-4bca-b4f4-e7f50ece1157.jpg"
but when it   RNQRGenerator.detect I got error like
Possible Unhandled Promise Rejection (id: 1): "IMAGE_NOT_FOUND"
Do you have any suggestions for my issue?
I'm using
react-native: 0.60.6
version of android is :10
Anyways thank you for creating such a good library it's easy to use and makes everything easier.

Hey @58160703 ,
Thanks for reporting.
Sometimes android cannot detect QR code when there is no padding. Can you please attach the image you picked so I will try to find the issue?
Thanks!

Hi @58160703,
Thanks for reporting.
Is it possible to pass base64 instead of path with content scheme?
Currently there is no support for URIs with content:// scheme.
But it will added soon!
Thanks!

yes, now I'm using the base64 instead, and it's works perfectly!
thank you for your support.


Double entry in browser history when loading data listing page.

In any of the OPub deployments, if we navigate to the data listing page, there are 2 entries in browser history one with filters and another without.
So if someone wants to go back from the data listing page back to the source page, it takes two backs instead of one.

Fixed


chore(docs): Refactor Zenith references to Neon

@kelvich
I was looking at what it would take to refactor the Zenith references to Neon ... looks like it needs to be broken into pieces.
~/lab/neon$ grep -ri zenith | wc -l
1209

Do you have any feedback on places to begin and places that are not ready to be changed yet?
For example, ~200 of those ~1,200 references are in the docs:
~/lab/neon/docs$ grep -ri zenith | wc -l
203

More Pattern Matching Context about what is where:

~/lab/neon/docs$ grep -ri zenith | wc -l
203

~/lab/neon/docs$ grep -r ZENITH_ | wc -l
0

~/lab/neon/docs$ grep -r ZENITH | wc -l
0

~/lab/neon/docs$ grep -r Zenith | wc -l
27

~/lab/neon/docs$ grep -r zenith | wc -l
178

~/lab/neon/docs$ cd ..

~/lab/neon$ grep -r ZENITH | wc -l
25

~/lab/neon$ grep -r Zenith | wc -l
374

~/lab/neon$ grep -r zenith | wc -l
957

~/lab/neon$ grep -r zenith_ | wc -l
539

~/lab/neon$ grep -r 'zenith ' | wc -l
219

~/lab/neon$ grep -r 'zenith' | grep -v 'zenith ' | wc -l
738

...

~/lab/neon$ grep -ri 'zenith' --exclude \*.rs --exclude \*.md | wc -l
728

~/lab/neon$ grep -ri 'zenith' --include \*.rs | wc -l
224

~/lab/neon$ grep -ri 'zenith' --include \*.md | wc -l
257

~/lab/neon$ grep -ri 'zenith' --include \*.py | wc -l
570

Examples:
This could be knocked out pretty directly with some global replace when big/complex PR's are cleared out.
IMO it would be nice to have one band-aid pull on these breaking changes instead of a bunch of small ones.
# EXAMPLE: ZENITH_BIN
~/lab/neon$ grep -r ZENITH_BIN
test_runner/README.md:`ZENITH_BIN`: The directory where zenith binaries can be found.
test_runner/fixtures/zenith_fixtures.py:ZENITH_BIN, POSTGRES_DISTRIB_DIR, etc. See README.md for more information.
test_runner/fixtures/zenith_fixtures.py:    env_zenith_bin = os.environ.get('ZENITH_BIN')
.circleci/config.yml:            - ZENITH_BIN: /tmp/zenith/bin

# EXAMPLE: ZENITH_REPO_DIR
~/lab/neon$ grep -r ZENITH_REPO_DIR
test_runner/fixtures/zenith_fixtures.py:        env_vars['ZENITH_REPO_DIR'] = str(self.env.repo_dir)
.circleci/ansible/deploy.yaml:        ZENITH_REPO_DIR: "/storage/pageserver/data"
.circleci/ansible/deploy.yaml:        ZENITH_REPO_DIR: "/storage/safekeeper/data"
.circleci/ansible/systemd/pageserver.service:Environment=RUST_BACKTRACE=1 ZENITH_REPO_DIR=/storage/pageserver LD_LIBRARY_PATH=/usr/local/lib
.circleci/ansible/systemd/safekeeper.service:Environment=RUST_BACKTRACE=1 ZENITH_REPO_DIR=/storage/safekeeper/data LD_LIBRARY_PATH=/usr/local/lib
control_plane/src/local_env.rs:    // config file itself is. It is read from the ZENITH_REPO_DIR env variable or
control_plane/src/local_env.rs:    match std::env::var_os("ZENITH_REPO_DIR") {

Can put in some cycles around the code refactor if desired.
If this isn't already claimed or WIP by someone let me know.
Best,
Ryan

Hi, Ryan!
The rename is in progress.  Here is an issue about it:
https://github.com/neondatabase/neon/issues/1702
Feel free to join the discussion and review.
We can't rename everything in one take, because cloud components depend on the names of the binary files, config parameters, etc and we need to be careful with migrations.
Besides, the rename of actively changing code causes a lot of merge conflicts and it can be tricky to rebase it.


Add forgiven to Data.mock_invoice

Fixes https://github.com/rebelidealist/stripe-ruby-mock/issues/175

Great, thanks - could you pull master into your branch just so the tests pass?

:heart:


Covariance matrix not PositiveDefinite for larger feature sizes

Hi,
I tried applying the classification example with a different network. To be specific, I tried the Xception network which has a feature size of 2048 (the WideResNet model from your code has a feature size of 128). This introduces an error, raised by PyTorch:
ValueError: Expected parameter covariance_matrix (Tensor of shape (2048, 2048)) of distribution MultivariateNormal(loc: torch.Size([2048]), covariance_matrix: torch.Size([2048, 2048])) to satisfy the constraint PositiveDefinite(), but found invalid values:... Interesting enough, this does not happen with the efficientnet-b5 model (which also has a feature size of 2048). Do you maybe know what is going on?

hi, @jorism1993 , could you post the complete log and code?
I don't think it is related the feature dimension here.
Also, the covariance matrix in the code is always positive-definite since it is calculated in the form of .

Complete log:
{'batch_size': 64, 'calibration': False, 'dataset': 'cifar10', 'decay': 0.0005, 'droprate': 0.3, 'epochs': 100, 'layers': 40, 'learning_rate': 0.1, 'load': '', 'loss_weight': 0.1, 'model': 'xception', 'momentum': 0.9, 'ngpu': 1, 'prefetch': 4, 'sample_from': 10000, 'sample_number': 1000, 'save': './snapshots/baseline', 'select': 1, 'start_epoch': 0, 'test': False, 'test_bs': 200, 'widen_factor': 2}
Files already downloaded and verified
Files already downloaded and verified
Beginning Training

 21%|██▏       | 168/782 [00:20<01:15,  8.10it/s]
Traceback (most recent call last):
  File "/home/joris/Documents/VOS/train_virtual.py", line 336, in <module>
    train(epoch)
  File "/home/joris/Documents/VOS/train_virtual.py", line 230, in train
    new_dis = torch.distributions.multivariate_normal.MultivariateNormal(
  File "/home/joris/.virtualenvs/VOS/lib/python3.8/site-packages/torch/distributions/multivariate_normal.py", line 146, in __init__
    super(MultivariateNormal, self).__init__(batch_shape, event_shape, validate_args=validate_args)
  File "/home/joris/.virtualenvs/VOS/lib/python3.8/site-packages/torch/distributions/distribution.py", line 55, in __init__
    raise ValueError(
ValueError: Expected parameter covariance_matrix (Tensor of shape (2048, 2048)) of distribution MultivariateNormal(loc: torch.Size([2048]), covariance_matrix: torch.Size([2048, 2048])) to satisfy the constraint PositiveDefinite(), but found invalid values:
tensor([[ 0.0126,  0.0041, -0.0008,  ...,  0.0072,  0.0063, -0.0031],
        [ 0.0041,  0.0108, -0.0011,  ...,  0.0050,  0.0043, -0.0011],
        [-0.0008, -0.0011,  0.3559,  ..., -0.0020, -0.0023,  0.3560],
        ...,
        [ 0.0072,  0.0050, -0.0020,  ...,  0.0141,  0.0057, -0.0029],
        [ 0.0063,  0.0043, -0.0023,  ...,  0.0057,  0.0106, -0.0026],
        [-0.0031, -0.0011,  0.3560,  ..., -0.0029, -0.0026,  0.3748]],
       device='cuda:0')

Process finished with exit code 1

Code: here
Run with: python3 train_virtual.py -b 64 --start_epoch 0 --ngpu 1 --sample_number 1000 --model xception

hi, @jorism1993 , I think the problem is that you set the start_epoch to be 0 which leads to a bad quality of the gaussian mixture model estimated. I changed the start_epoch to 2 and the error never occurs.

feel free to reopen the issue if you have further questions on it.

Setting the start_epoch to 2 does not feel like a solution to this problem. You said yourself that the covariance matrix should always be positive-definite since it is calculated in the form of A^T A
Have you been able to reproduce my errors?

i have not reproduced the exact same error as you, but i got this error
RuntimeError: cholesky_cuda: U(677,677) is zero, singular U

i think increase the start_epoch is going to help the estimation of the Gaussian mixture model, which we found will improve the ood detection performance. we highly suggest you don't set the start_epoch to 0. and that will solve this bug.
temp_precision += (0.0001 * torch.eye(2048, device=features.device))

is used to solve the numerical instability for covariance matrix estimation and the later sampling procedure. I remeber i read it somewhere adding a diagonal matrix will help remove the bug. i am happy to share with you but now i cannot find the post.
you can use this trick (increase from 0.0001 to 0.01) to see the ood detection performance.


docs: fix broken link for old nmos-api-security repo

Resolves #56

The new URL seems good, but perhaps should the reference say "Authorization in NMOS Systems" instead of "Best Practice Authorization"?

Good point. I'll amend to match the new title.

Looks good!


WIP: Use git log raw in get last commit

In my continued quest to speed up get lastcommit I've discovered that git log --raw provides a potential faster solution.
This PR hopefully demonstrates the potential for this.

Codecov Report

Merging #16059 (67a1aa9) into main (c1ff59c) will decrease coverage by 0.04%.
The diff coverage is 60.26%.

@@            Coverage Diff             @@
##             main   #16059      +/-   ##
==========================================
- Coverage   44.07%   44.03%   -0.05%
==========================================
  Files         682      683       +1
  Lines       82457    82599     +142
==========================================
+ Hits        36347    36371      +24
- Misses      40189    40312     +123
+ Partials     5921     5916       -5

Impacted Files
Coverage Δ

modules/git/last_commit_cache_nogogit.go
35.84% <0.00%> (+0.66%)
:arrow_up:

modules/git/pipeline/lfs_nogogit.go
0.00% <0.00%> (ø)

modules/indexer/code/bleve.go
68.22% <0.00%> (-0.59%)
:arrow_down:

modules/indexer/code/elastic_search.go
1.64% <0.00%> (-0.02%)
:arrow_down:

modules/git/repo_language_stats_nogogit.go
43.90% <33.33%> (-0.68%)
:arrow_down:

modules/git/batch_reader.go
30.34% <38.27%> (-23.42%)
:arrow_down:

modules/git/commit_info_nogogit.go
60.60% <68.75%> (-7.49%)
:arrow_down:

modules/git/git_log_raw.go
72.58% <72.58%> (ø)

modules/git/notes_nogogit.go
70.00% <100.00%> (ø)

... and 9 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c1ff59c...67a1aa9. Read the comment docs.

Remarking as WIP as there's a pathological test case that this hits on 1.14

So I've discovered something terrible with git log --raw and --name-only and --name-status that seems insurmountable.
If there is a merge commit it appears that the files created in that merge don't appear.
This might simply be a bug with git but it's kinda annoying. From within the git repository:
$ git --version
git version 2.31.1

$ git log --raw --parents faefdd61ec7c7f6f3c8c9907891465ac9a2a1475 -- gitk-git/.gitignore
commit 9a6c84e6e9078b0ef4fd2c50b200e8552a28c6fa
Author: Junio C Hamano<EMAIL_ADDRESS>Date:   Wed Jan 30 13:52:44 2013 -0800

    Merge git://ozlabs.org/~paulus/gitk

    * git://ozlabs.org/~paulus/gitk:
      gitk: Ignore gitk-wish buildproduct

:000000<PHONE_NUMBER>000000 d7ebcaf366 A  gitk-git/.gitignore

$ git log --raw --parents faefdd61ec7c7f6f3c8c9907891465ac9a2a1475 -- gitk-git | grep gitk-git/.gitignore

$ echo $?
1

This might be the cause of slowdowns people are seeing. Same thing happens on 1.7.2!

OK -c and using --name-status should be faster

Tested in https://giteanew2.ttmath.org/FreeBSD/ports and the speed is much better than in 1.14.2.


Database

A lot has changed. Not only am I now using a database (GRDB.swift), but storage code is also way cleaner, there's an intermediate object layer for API en-/decoding, and I'm using submodules for dependency management because library authors don't tend to like Carthage, in turn resulting in GRDB.swift's incompatibility with the same.

i sure hope this still works based on master rather than dev


kubeadm: use --ignore-preflight-errors=all instead of --skip-preflight-checks

With kubeadm v1.9 or newer, --skip-preflight-checks is deprecated. So kubeadm v1.9 prints a warning like "Flag --skip-preflight-checks has been deprecated, it is now equivalent to --ignore-preflight-errors=all" In the future the old option will disappear.
So --ignore-preflight-errors=all should be used instead.

This PR will collide with the refactoring PR https://github.com/kinvolk/kube-spawn/pull/265. So let's not merge it for now.

Will close this PR in favor of https://github.com/kinvolk/kube-spawn/pull/265


Replace mockdata with calls to db

Shakir please delete this issue, I can't. It's a duplicate

No. Hohoho


Extract generic paging logic from EdgeSetBuilder into its own package [phab:D639]

Created by schroederc at 2015-12-10 17:28:40:
Package pager.SetPager is a "Golang generic" version of
assemble.EdgeSetBuilder and uses all of the same logic.  This is planned
to be reused for paging the serving data for the xrefs.CrossReferences
service method.

zarko accepted this revision at 2015-12-10 17:39:01

schroederc closed via commit 10eadf43b5ce8617f44745511f4ae89b710da81e at 2015-12-10 17:44:06


Zwave-js-ui failed control panel

Checklist

[X]  I am not using Home Assistant. Or: a developer has told me to come here.
[X] I have checked the troubleshooting section and my problem is not described there.
[ ] I have read the changelog and my problem is not mentioned there.

Deploy method
Snap
Z-Wave JS UI version
9.0.3
ZwaveJS version
9.0.3
Describe the bug
I had a hard reebot on my machine.
Now Zwave works well, i can piote my windows but with my brower when i go to my control panel i have this message
TypeError: Cannot read properties of undefined (reading 'replace')     at /snap/zwave-js-ui/259/lib/zwave-js-ui/server/app.js:448:51     at Layer.handle [as handle_request] (/snap/zwave-js-ui/259/lib/zwave-js-ui/node_modules/express/lib/router/layer.js:95:5)     at trim_prefix (/snap/zwave-js-ui/259/lib/zwave-js-ui/node_modules/express/lib/router/index.js:328:13)     at /snap/zwave-js-ui/259/lib/zwave-js-ui/node_modules/express/lib/router/index.js:286:9     at Function.process_params (/snap/zwave-js-ui/259/lib/zwave-js-ui/node_modules/express/lib/router/index.js:346:12)     at next (/snap/zwave-js-ui/259/lib/zwave-js-ui/node_modules/express/lib/router/index.js:280:10)     at /snap/zwave-js-ui/259/lib/zwave-js-ui/node_modules/connect-history-api-fallback/lib/index.js:85:5     at Layer.handle [as handle_request] (/snap/zwave-js-ui/259/lib/zwave-js-ui/node_modules/express/lib/router/layer.js:95:5)     at trim_prefix (/snap/zwave-js-ui/259/lib/zwave-js-ui/node_modules/express/lib/router/index.js:328:13)     at /snap/zwave-js-ui/259/lib/zwave-js-ui/node_modules/express/lib/router/index.js:286:9
To Reproduce
I didnt a way to reproduce it
Expected behavior
I expect to see control panel
Additional context
No response

Try with latest 9.2.3 version


calling Log:v() from a coroutine

I'm totally puzzled.
Log:v("lua-print", "MESSAGE")

works fine. But
local pr_trace = 0
local printer = coroutine.create(function()
    for i=1,5 do
      Log:v("lua-print","printing " .. i)
      coroutine.yield()
      pr_trace = i
    end
  end)
while coroutine.resume(printer) do
  Log:v("lua-print","resuming")
end
Log:v("lua-print","done: " .. pr_trace)

shows only V lua-print: done: 0
I already know that it complains like: No such method: v (long debugging fruits) but still can't figure out why.
What's so special calling Log:v/d/i() from a coroutine?

ok, more info:
local status, out
local printer = coroutine.create(function()
    coroutine.yield(tostring(Log))
    coroutine.yield(tostring(Log.v))
    coroutine.yield(tostring(Log:v("Log:v", "test")))
  end)
repeat
  status, out = coroutine.resume(printer)
  print("co:", status, out)
until not status
print("co: done")

shows this:
V lua-print: co:	true	userdata: 0xa1b044d8
V lua-print: co:	true	function: 0xa1b26140
V lua-print: co:	false	...d/data/com.github.ildar.AndroidLuaSDK/files/init.lua:35: No such method: v
V lua-print: co: done

It is upstream issue: https://github.com/jasonsantos/luajava/issues/15


[!WATCH*NOW√FULL+] Subhashree Sahu Viral Leaked Video 2024 Link On Social Media X Twitter [Original01K]

1 sec ago Sophie Rain Spiderman Leaked Video Viral On Social Media. [!WATCH*NOW√FULL+] Subhashree Sahu Viral Leaked Video 2024 Link On Social Media X Twitter [Original01K]

Sophie Rain Spiderman latest video has taken the internet by storm, sparking widespread discussions across various social media platforms. The rising digital creator, known for her engaging content—particularly her latest Spiderman-themed clip—has experienced a remarkable surge in popularity, with fans eagerly searching for the full version. Viewers are flocking to platforms like Instagram, X (formerly Twitter), and Discord to engage with her latest work.
As the excitement continues to grow, fans are actively sharing their reactions online, highlighting the crucial role that social media plays in boosting creators like Sophie Rain Spiderman. With her unique style and creative approach, she has quickly made a significant mark in the digital space, leaving many curious about her future projects.


supabase db reset breaks openapi spec

Bug report
Describe the bug
My OpenAPI spec at http://localhost:54321/rest/v1/?apikey=your-anon-key looks fine after running supabase start. But if I run supabase db reset then definitions in my types are wrong (and maybe more).
Expected behavior
I'd expect the generated types to be the same if no changes were made to migrations.
Screenshots

System information

OS: [e.g. macOS, Windows]
Browser (if applies) [e.g. chrome, safari]
Version of supabase-js: [e.g. 6.0.2]
Version of Node.js: [e.g. 10.10.0]

Additional context
This is pretty bad for DX - e.g. I have a reset pipeline that first resets the DB and then regenerate types based on the openapi spec.

Same problem here! I have to manually restart the rest container for it to reload the schema. It seems like reloading the schema is possible. Would be great to add it to the CLI: https://postgrest.org/en/latest/schema_cache.html


6-PWM BLDC driver

Hi @uLipe , is there any chance we get the update for 6-PWM BLDC driver for same purpose?

@Hiren017  definively yes, I'm working on a new architecture that is now based on Zephyr RTOS which allows the usage of AMP-like support for ESP32 that also I intend to address lots of things like 6-PWM BLDC.

check the initial effort in the feat/nre_arch branch

That's great @uLipe . Thanks.


update to boot2docker and docker v1.12.3

this should be done as bump release to v0.3.1 so that there's an ISO with the updated versions

yup, going through the build scripts now... there be :spider_web:

adding test label, as this still needs to be verified that doesn't break anything (shouldn't, but...)