@brokenthorn No, "Node Debug (legacy)" is not disabled from factory.

@brokenthorn No, "Node Debug (legacy)" is not disabled from factory.
If it is disabled for you, then it was disabled by accident.
The fix is to enable it.
Originally posted by @weinand in https://github.com/microsoft/vscode/issues/51572#issuecomment-402715285
I tried below code in launch.json file
// Configuration used to debug Cypress tests
{
"type": "chrome",
"request": "attach",
"name": "Attach to Cypress",
"port": 9222,
"url": "http://localhost*",
"webRoot": "${workspaceFolder}/src",
"sourceMaps": true,
"skipFiles": [
"cypress_runner.js",
],
}
but getting same error the debug type is not recoginsed
even I have installed Chrome Extension for debug

/needsMoreInfo

I don't understand the problem.
What version of VS Code are you using?
Please provide reproducible steps.

Hi Microsoft/Vscode,
I am using Version: 1.40.2 (user setup)
Commit: f359dd69833dd8800b54d458f6d37ab7c78df520
Date: 2019-11-25T14:54:45.096Z
Electron: 6.1.5
Chrome: 76.0.3809.146
Node.js: 12.4.0
V8: 7.6.303.31-electron.0
OS: Windows_NT x64 10.0.19041
and My launch.json file has below contents
{
"version": "0.2.0",
"configurations": [
// Configuration used to debug the application (default configuration
created by Visual Studio Code )
{
"type": "chrome",
"request": "launch",
"name": "Launch Chrome against localhost",
"url": "http://localhost:3000",
"webRoot": "${workspaceFolder}"
},
// Configuration used to debug Cypress tests
{
"type": "chrome",
"request": "attach",
"name": "Attach to Cypress",
"port": 9222,
"url": "http://localhost*",
"webRoot": "${workspaceFolder}/cypress/integration/examples/Test1.js",
"sourceMaps": true,
"skipFiles": [
"cypress_runner.js",
],
}
]
}
I am trying to Debug line by line using Breakpoints  for Cypress Test File
using the cypress and chrome dev tools.
On Mon, Oct 26, 2020 at 1:46 PM Andre Weinand<EMAIL_ADDRESS>wrote:

I don't understand the problem.
What version of VS Code are you using?
Please provide reproducible steps.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/microsoft/vscode/issues/109397#issuecomment-716716425,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AP76PDUQVHGKFPTB65MDV4TSMWYXHANCNFSM4S7UHK6A
.

--
B.N.Udai Kumar

I am getting this error when I launch the debug" cannot connect to runtime process timeout after 10000 ms - (reason cannot connect to the target:connect ECONNREFUSED"

/duplicate https://github.com/microsoft/vscode/issues/109400


Context data for RMT translator callback (IDFGH-3237)

Allows a pointer to some context data to be supplied to rmt_translator_init, which is subsequently made available in the respective callback.

@boarchuz Thanks for your contribution.

Just what Im hoping to see boardchuz, ty!

See https://github.com/espressif/esp-idf/pull/5919


Documentation of PWA best practices put into FTM JS

We want to create documentation of PWA best practices that we want to include with ALL of our apps in the Curious Reader container app.
This includes:

A walkthrough of turning the web app into a PWA and the components required.
Any recommended settings that need to be set for the PWA / Service Worker / Etc.
Any functions that were created in order to help support the infrastructure of the PWA that could be applicable to ALL types of web apps (e.g. if there are cache-checking functions or functions to prompt a user to connect to the internet to retrieve content that needs to be placed in the cache, etc.)

@burrage Converting this issue into an epic as per @Rajesh1041 request as it has many sub levels to be documented.
@Rajesh1041 Please provide the sub levels here so that I can create issues accordingly
Thanks,
Divya


Set custom code when code is empty but input contains custom_code

This happens when candidates are built from plugins like librime-lua. Setting custom_code makes the candidate recorded in userdict. This is for https://github.com/hchunhui/librime-cloud/issues/1 .

Closing the PR since the workaround does not work in all code paths.


Big File breakpoint-upload

The PutObject function has uploaded big file by multiparts, why don't minio support break-point upload?
I suppose that :
1、minio record the uploading result of every part and provide a interface to query
2、public the part upload interface and complate multi part interface
So we can make big file breakpoint-upload come true.

@yuyuanshifu This library is meant to be simple, minio-go automatically handles multipart upload as the stream is read. Providing low level access is not the intention of this library.
For low level access you should stick to aws-sdk-go


Support for asyncpg 0.26.0?

Hey @bryanforbes, really appreciate this library.
Would be very useful to have a 0.26.0 release out, even if it's just 0.25.4 in disguise but without the depends on asyncpg<0.26.0.
Watching your PR on the main lib too with 😍 https://github.com/MagicStack/asyncpg/pull/577. Many thanks for your efforts

Yes, I plan to do an update for 0.26.0. Hopefully this week if I have the time.

The changes were pretty simple and I had a few spare minutes. You'll find v0.26.0 on pypi.

Just saw this on our dependabots, thank you 🙌

@bryanforbes haven't got another comms channel to you, but been using this a lot and wanted to express some more appreciation for the timely response! Thanks so much 🏆


TypedArrays Are not typed arrays at runtime

🐛 Bug Report

Latest Jest destructively interferes with TypedArrays at runtime.
To Reproduce
Run this test on Jest 26.*.  Reproduced on 26.6.3
test('foo', ()=>{
expect(new Uint8Array(4).buffer instanceof ArrayBuffer).toBe(true);
})
Impact
Not using the real types for typed arrays has trickle down affects like constructing DataViews (who reject input arguments that are not ArrayBuffers).
Expected behavior
The test should pass

Note: This test passes in jest 24.9.0 and 25.5.4

Link to repl or repo (highly encouraged)
Repro Link
envinfo

  System:
    OS: macOS Mojave 10.14.6
    CPU: (8) x64 Intel(R) Core(TM) i7-8559U CPU @ 2.70GHz
    Memory: 2.35 GB / 16.00 GB
    Shell: 5.3 - /bin/zsh
  Binaries:
    Node: 11.15.0 - ~/.nvm/versions/node/v11.15.0/bin/node
    Yarn: 1.12.1 - /usr/local/bin/yarn
    npm: 6.7.0 - ~/.nvm/versions/node/v11.15.0/bin/npm
  Managers:
    Homebrew: 2.4.8 - /usr/local/bin/brew
    pip3: 18.1 - /Library/Frameworks/Python.framework/Versions/3.7/bin/pip3
    RubyGems: <IP_ADDRESS> - /usr/bin/gem
  Utilities:
    Make: 3.81 - /usr/bin/make
    GCC: 4.2.1 - /usr/bin/gcc
    Git: 2.19.1 - /usr/local/bin/git
    Clang: 1<IP_ADDRESS> - /usr/bin/clang
    Subversion: 1.10.4 - /usr/bin/svn
  Servers:
    Apache: 2.4.34 - /usr/sbin/apachectl
  Virtualization:
    Docker: 19.03.13 - /usr/local/bin/docker
  SDKs:
    iOS SDK:
      Platforms: iOS 13.2, DriverKit 19.0, macOS 10.15, tvOS 13.2, watchOS 6.1
  IDEs:
    Emacs: 22.1.1 - /usr/bin/emacs
    Nano: 2.0.6 - /usr/bin/nano
    VSCode: 1.51.1 - /usr/local/bin/code
    Vim: 8.0 - /usr/bin/vim
    Xcode: 11.3.1/11C504 - /usr/bin/xcodebuild
  Languages:
    Bash: 3.2.57 - /bin/bash
    Java: 11.0.1 - /usr/bin/javac
    Perl: 5.18.4 - /usr/bin/perl
    PHP: 7.1.23 - /usr/bin/php
    Python: 2.7.10 - /usr/bin/python
    Python3: 3.7.2 - /Library/Frameworks/Python.framework/Versions/3.7/bin/python3
    R: 4.0.0 - /usr/local/bin/R
    Ruby: 2.3.7 - /usr/bin/ruby
  Databases:
    SQLite: 3.24.0 - /usr/bin/sqlite3
  Browsers:
    Chrome: 86.0.4240.198
    Edge: 87.0.664.41
    Firefox: 74.0
    Safari: 13.0.1

Likely duplicate of #10786
We're running into the same problem since updating to CRA4 (and hence Jest 26). In our case, it's new Uint8Array(...).buffer instanceof ArrayBuffer being false.
@richardspence: Can you try removing this line locally and see if the test will run for you?
https://github.com/facebook/jest/blame/890852b18a6c863015d54e9fb2894ec57f546e1e/packages/jest-environment-jsdom/src/index.ts#L53
That did it for me. That line seems suspicious. If it copies ArrayBuffer, it should likely also copy the global Uint8Array, but doesn't. Additionally, in spite of what that comment says, after removing the line, window.ArrayBuffer is still available.

I got the same problem when using @peculiar/webcrypto as polyfill in jest.
Removing the line locally didn't fix it for me.
The only thing working for now is using jest-environment-jsdom@25  but it doesn't feel like a good solution.

As I said in https://github.com/facebook/jest/issues/10786#issuecomment-735273296:

That’s because Jest uses a new VM context, and overrides the VM context’s ArrayBuffer with the top‑level global object’s ArrayBuffer, but doesn’t do this for typed arrays, which construct their ArrayBuffers using the overwritten ArrayBuffer constructor:
new Uint8Array().buffer.constructor !== ArrayBuffer;

Regressed by: https://github.com/facebook/jest/pull/9606


Version 1.3.0 is not compatible with NetBox 3.3.10

Plugin version
v1.3.0
NetBox version
v3.3.10
Python version
3.9
Steps to Reproduce

Have NetBox v3.3.10 and the netbox-secretstore plugin v1.3.0 installed
Issue python3.9 manage.py migrate

Expected Behavior
There should be no errors.
Observed Behavior
Traceback (most recent call last):
  File "/usr/local/share/netbox/manage.py", line 10, in <module>
    execute_from_command_line(sys.argv)
  File "/usr/local/lib/python3.9/site-packages/django/core/management/__init__.py", line 446, in execute_from_command_line
    utility.execute()
  File "/usr/local/lib/python3.9/site-packages/django/core/management/__init__.py", line 440, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/usr/local/lib/python3.9/site-packages/django/core/management/base.py", line 414, in run_from_argv
    self.execute(*args, **cmd_options)
  File "/usr/local/lib/python3.9/site-packages/django/core/management/base.py", line 460, in execute
    output = self.handle(*args, **options)
  File "/usr/local/lib/python3.9/site-packages/django/core/management/base.py", line 95, in wrapped
    saved_locale = translation.get_language()
  File "/usr/local/lib/python3.9/site-packages/django/utils/translation/__init__.py", line 210, in get_language
    return _trans.get_language()
  File "/usr/local/lib/python3.9/site-packages/django/utils/translation/__init__.py", line 65, in __getattr__
    if settings.USE_I18N:
  File "/usr/local/lib/python3.9/site-packages/django/conf/__init__.py", line 87, in __getattr__
    self._setup(name)
  File "/usr/local/lib/python3.9/site-packages/django/conf/__init__.py", line 74, in _setup
    self._wrapped = Settings(settings_module)
  File "/usr/local/lib/python3.9/site-packages/django/conf/__init__.py", line 183, in __init__
    mod = importlib.import_module(self.SETTINGS_MODULE)
  File "/usr/local/lib/python3.9/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
  File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 680, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 850, in exec_module
  File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
  File "/usr/local/share/netbox/netbox/settings.py", line 684, in <module>
    plugin_config.validate(PLUGINS_CONFIG[plugin_name], VERSION)
  File "/usr/local/share/netbox/extras/plugins/__init__.py", line 101, in validate
    raise ImproperlyConfigured(
django.core.exceptions.ImproperlyConfigured: Plugin netbox_secretstore requires NetBox maximum version 3.3.9.

NB: There is a similar issue #101, but it was reported for NetBox 3.4-beta and presumably affects all releases of NetBox 3.4 as well.

Same issue in NetBox 3.4.1, installed this morning.


Capture cmd+enter command, where?

Let's say I want to save some data when user hits cmd+enter (or ctrl+enter on PC) from inside the medium editor. Where would I hook in this logic? I tried looking into the beforeInput function, but it don't gets passed any keyboard events (or is it?). Same with onChange, it only gets passed the editorState.
(Sorry if there is actually a third function which I've missed!) 👍

Take a look at this file https://github.com/brijeshb42/medium-draft/blob/master/src/util/keybinding.js


Enhance README.md

[x] Add a logo
[ ] Add a screenshot
[ ] Move demo in the top
[ ] Simplify and make more important the install guide (Depends on #30)
[ ] Add a schema showing gateways
[ ] Add a comparison table
[ ] Add more examples with documentation
[ ] Add example for each commands

Also in the "First Run" section the recommendation is to execute "assh build -f" that unconditionally overwrites the user's .ssh/config. The README should mention this behavior or recommend backing up the existing file first.


meet error on app

after I span Github QR code, get error: Failed to obtain FCM token, my cellphone is HUAWEI SEA-AL10

@schunlee  TextBee relies on Google's Firebase Cloud Messaging (FCM) service. However, newer Huawei devices released after 2019 do not have access to Google services due to restrictions. So, Currently TextBee wont work on those recent Huawei devices that lack Google service support.


Any fix to the iOS mediaPath issue?

I had a to make a release today, and I got this error during the build.

I have read issue #84 but seems like a solution is merged, but I'm still facing the issue. Knowing that I have latest version which is 0.0.5+5
awesome_notifications: ^0.0.5+5
so any quick fix that I can do to build?
Thank you,

For anyone facing the problem, I made a quick fix that help me make my first build, which is
in the line
if(     BitmapUtails.getMediaSourceType(icon) != MediaSource.Resource )
make it like
if(     BitmapUtails.getMediaSourceType(mediaPath: icon) != MediaSource.Resource )

@ralmarri12 : sorry, maybe basic question. But do you just go ahead and edit the file in the flutter package cache or how do you do  a local patch for cocoapods code? Thanks!

Hi @bbence84 , in fact I edit the code from the package itself. Which is a bad practice, all my team mate had to do the same edit in order to run the code correctly, but what I see, that was my only solution.
yeah , sorry for late reply

The fix is already on master branch and will be available for everyone on next release.

@rafaelsetragni I am so happy to hear that! Any idea when we can expect a new version to come out? This is quite critical bug for us, as we are not able to use CI to build the APP, and have to change it manually each time we pub get dependencies.

The fix is already on master branch and will be available for everyone on next release.

master branch have null safety

New version released. Check to see if the problem is resolved.


Demo doesn't work

Hi dear collaborators!
This Theme looks amazing https://gohugo-ananke-theme-demo.netlify.com/ but The Demo doesn't work.
Could you please fix it?
Thank you in Advance

https://gohugo-ananke-theme-demo.netlify.app/
Correct site was in a previous or
Trevor Fulham
818.271.8997
Please consider the environment before printing this e-mail
On Sun, Jun 9, 2024 at 05:10 sihemom @.***> wrote:

Hi dear collaborators!
This Theme looks amazing https://gohugo-ananke-theme-demo.netlify.com/
but The Demo doesn't work.
Could you please fix it?
Thank you in Advance
—
Reply to this email directly, view it on GitHub
https://github.com/theNewDynamic/gohugo-theme-ananke/issues/692, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ABMQDFNUAFJ3WHZTFOKYOTDZGRA2RAVCNFSM6AAAAABJA2TWUKVHI2DSMVQWIX3LMV43ASLTON2WKOZSGM2DEMJZGU2DCNA
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

The github link still points o the old website.

Thank you for your reminders. I fixed it some days ago.


[DATA] Western Cape total cases on 2020-07-19 has been updated.

Which Dataset
https://github.com/dsfsi/covid19za/blob/master/data/covid19za_provincial_cumulative_timeline_confirmed.csv
Error Description
Western Cape data is incorrect for 2020-07-19.
The cumulative cases seem to decrease between the 19th and the 20th of July.
Suggested fixes
Link to updated Western Cape figures for 2020-07-19, along with the data error explanation.
https://coronavirus.westerncape.gov.za/news/update-coronavirus-premier-alan-winde-19-july

Yeah I noticed the issue last night, but wasn't sure how to correct.  I can spread the correction over the last week as an approximation because Winde indicates that:

The total number of cases in the Western Cape is lower today than it was yesterday. This is because some cases from other provinces were mistakenly allocated to the Western Cape over the past week. This has been corrected, and as such, the total number of cases stands at 83 948 today.

So the correction needs to be spread over 7 days to 20 Jun is my interpretation?  Thoughts?

Is it possible to annotate data points with unique info? Maybe spreading the correction retroactively isn't the right goal if a note can be added on the downwards data point indicating the issue.

There is space for a link at the end of the line.  Last time we noted issues there was a note in Dr. Mkhize's press release, and that link was added to the line.  So I went looking for it before capturing 20 Jul 2020, but there was no note.  I have generally assumed that we just capture the data as is effectively.  So we can correct the by deducting the numbers somehow, but it will be a guess as to what it is.  It will require an assumption.  It's clearly not just 19 Jul that's wrong though.  I can add the link from Winde and just leave the data as is?

https://coronavirus.westerncape.gov.za/covid-19-dashboard
One could maybe use the date slider to update the cases for the WC.
But his would be a pain to maintain if the these continue to differ from the national report.

Not sure if that would be correct, because the data we have to date is by date reported by Dept. of Health/NICD.  The data in the dashboard is by date of test I believe?  So you would see the most recent dates also has only a few cases.

I think I'm leaning towards option 2.  Agreed?

LGTM @lrossouw


Update Contributors.md

Since there are some conflicts in this PR. It can't be merged. Sorry for that.


Prepare RELEASE v0.3 (June 2022)

(For May release, refer to #580)
Let's discuss Jul and June release planning here.

(format was from #580
June

OneView
Toolchain
(please add more)

(format was from #580
July

OneView
Toolchain
(please add more)

Backlog Candidate
Compilation

default options for compilation

Value test

value test UI
input/output data conversion/manipulation

Profiling

show target device profile data in UI

OneExplorer

define concept more specifically

e.g., What user can do? Are we going to provide file system handling, e.g., copy/del/rename?)

list OneExplorer's full feature
view menu for toggling intermediate files
show intermediate files from backend (e.g., tv2w)

onecc support

onecc support for backend (e.g., backend memory profiling tool)

toolchain

docker toolchain
when a new version is release, how are we going to notify users?

new version of backend extension which is not published in MS extensions server
new bersion of backend toolchain

what if user want to use toolchain 1.0.0 which does not have one-infer ?

show proper error and propose to use right toolchain version
how can we know right toolchain version x for ONE-vscode version y ?

what if toolchain ver introduce new param? How do we show toolchain list where old ones do not have new param? Is it OK to download old toolchain?

other

onecc cfg verification

when user has an existing wrong cfg file, one view may need to show some error icon on the cfg file.
when user clicks erroneous cfg file, what should we show in cfg editor? how can we pinpoint erroneous field?

SE

UI test
Process to deprecate old source files that are not used any more
internal SE process preparation

more customer

support circle user (user who download ONE-vscode only to try ONE)

mentioned at https://github.com/Samsung/ONE-vscode/issues/584#issuecomment-1124477747

e.g., creating cfg for circle generation, ONE debian package support

ONERT users

prepare ONERT backend
create cfg file on OneExplorer for ONERT -> this will show cfg editor that has UI to invoke PartEditor (https://github.com/Samsung/ONE-vscode/issues/633)
Consider how to support 2-depth(?) backend

On CircleGraph, by clicking a node, user can select, e.g., CPU, GPU, NPU, etc. This means a concept like, e.g, 2-depth backend (depth 1: ONERT, depth 2: CPU, GPU, NPU, etc) needs to be supproted.

WIP

prepare ONERT backend

What is the target architecture ? x86_64 or arm32 or arm64 ?

@chunseoklee
Here ONERT backend  means vscode extension for ONERT backend.    :-)

Schedule at the end of June

@jyoungyun will make mission list issue for Jun release
Jun 24: User test inside SIG members
Jun 29: Release
after Jun 30: User test (TBD)


Issues in predicting on ellpack.

We implemented predicting on ellpack for reducing memory usage.  But after some more testing, I found the implementation is not thoroughly considered.  Here are a few more cases we need to put more thoughts on:

What if the user change tree method but use the same DMatrix?
What if the user train for another round but at the second round they put the training DMatrix as a validation DMatrix?

@RAMitchell

The proper solution should be waiting for the new DMatrix interface, so that we only use ellpack prediction when there's no SparsePage.


WIP: add A2DP support, to use boombeastic as a bluetooth speaker

This is still WIP, but it should already work.

@afitzek nice! shall we also switch Mopidy and Shairport to pulse so that we don't have it colliding with Alsa (can take care of that) ?

Not sure if these would collide. It is working fine. Just one problem I came across is that with the builtin Bluetooth of the RPI3. If the WiFi connection is up, the Bluetooth stream becomes too slow. There are some reports on the internet, that this is a known issue with RPI3 and Zero. There seems to be some interference between these two. I will try to fix this by using an USB WiFi stick or a Bluetooth USB stick, will see what I find first.

@curcuz I added a TP link wifi usb adapter to it, and now it also works with WiFi connection, but the internal wifi interface has to be disabled for bluetooth to work well.

This issue seems to be handled according to here: https://github.com/raspberrypi/linux/issues/1402
Fix is to add to the NVRAM text file located here /lib/firmware/brcm/brcmfmac<dev>-sdio.txt, where <dev> is 43430 or 43455 depending on the version of the pi used;
# Experimental Bluetooth coexistence parameters from Cypress btc_mode=1 btc_params8=0x4e20 btc_params1=0x7530


Deprecate GifImporter

Repo no longer exists #233

The GifImporter mod has moved to my gitea: https://git.astralchan.xyz/astral/GifImporter


Remove ACR redirct policy and add content-length sanity check

Fixes #33183, #33815
ACR redirect policy was only necessary to capture original (before redirect) response headers.
The goal was to validate docker-content-digest, but since we validate the content hash against the requested digest, we would catch malicious or corrupted content anyway.
This change:

removes ACR custom redirect policy
adds manifest size validation following contained motivation and to protect from malicious unbounded responses
fixes redirect policy in core

API change check
API changes are not detected in this pull request.


Include actual boundaries for paragraphs in rules_block paragraph js

I have a conundrum.
At Discourse we automatically "embed" links in posts (onebox)
To allow people to trivially "bypass" the onboxing logic they can precede the link with a space so:
This gets a onebox:
http://some.site.com

abc
http://some.site.com

This does not get a onebox:
 http://some.site.com

Trouble is in my core rule: https://github.com/discourse/discourse/blob/master/app/assets/javascripts/pretty-text/engines/markdown-it/onebox.js.es6 I have no way of telling if there is a space preceding my link_open or not cause paragraph.js trims whitespace.
I am trying to think of ways around this problem and I can think two approaches:

Full position mapping in every token, so each token would store token.pos_map = [start, finish], this feels somewhat expensive and complicated to change

Amend paragraph.js so it stops trimming, and have text_collapse take care of collapsing the blank tokens.

I am not sure what the correct way is to go about this, any thoughts?

Probably, i do not understand the problem. Could you rephrase? It's not a big deal to check tokens before/after link (link tokens should be first/last or have breaks before/after).
The only note about your code - add check that link was autogenerated. Because when user type link content explicit, you may wish to keep it intack.

problem is the inline token (and paragraph token and link token) do not have any information about where they start in state.src
{"type"=>"inline", "tag"=>"", "attrs"=>nil, "map"=>[0, 1], "nesting"=>0, "level"=>1,
I can tell that the inline is mapping lines 0 and 1, but

I can not tell what actual line my current token is on.
I can not tell the bMarks of the line in a trivial way short of rescanning.

I am thinking of 2 changes that would allow me to solve my problem:

In paragraph.js instead of running trim() on the state.getLines store 2 additional tokens (that are not rendered) for leading spaces and trailing spaces in the paragraph.

in newline.js inline rule, instead of "skipping" spaces, store the same psuedo token for "leading" spaces.

Then I can check for that token in the core rule and if I see it I know I have a leading space before the link.

or maybe just have linkify store the pos in a meta info on the token?

btw... adding a check for auto now great catch

AFAIK, linkifier is invoked in the end, after spaces are lost. Seems, the only correct solution is to replace paragraph rule with hacked one, which stores trimming info in token (should be patched before this line)

closing this per:
https://github.com/discourse/discourse/commit/0d62420cbe443b2cf1061405f83f34eef5103532
I am not sure if we need this in markdown.it quite yet, the patch seems to do the trick and tests should catch a regression if we diverge from core.
Thanks heaps


Duplicated else statment

https://github.com/ankraft/smtpproxy/blob/6a05b764743dca73e6114e904563749ab41c08da/smtpproxy.py#L458-L459
This else statment sets every account's port number to 25, maybe just a duplication of the previous two lines.

Thanks for catching this. It seems I was a bit to eager with the defaults.
Please find the fix (removed the superfluous else statement) in the new 1.5.2 release.


Custom Training for Object Detection

I really like what you have done with ImageAI, it has been very helpful getting me started doing hands on work with AI. Question...
It appears that the latest release supports custom training for Image detection, but not object detection. Is that on your roadmap for imageAI in the near future? I am unclear whether there are additional complexities to training the model for object detection.
Jim

I see that you have commented on this topic in your responses to another issue, so sorry about the duplicate post. Nevertheless, it would be great if you could provide an update/estimate for this feature.

For further discussion on this, please refer to #8


Refactor Postman collection params

Fixes: #833

+1 for the variable renames. I will fix in an other PR later. Thx @sagikazarmark 👍


Add dynamic index names

Assume the following use cases:

You got a historic trail of blog posts that you want to store in ES. Posts from 2011 should get to the posts-2011 index, those from 2010 to posts-2010.
You got product catalogs and products (1:n). You want to store products from catalog A in products-A, products from catalog B in index products-B.

I tried to implement that with something I called "dynamic index names" (in lack of a better word). So instead of specifying the index_name as a static string, one could pass a block that will be evaluated at runtime.
index_name Proc.new { "posts-#{Time.now.year}" }
index_name Proc.new { |product| "products-#{product.catalog_id}" }

I guess something like this might be a basis for index alias management.
Please consider this pull request as an idea/a proposal. There are no tests yet, and there are most probably some issues I didn't think about. Just wanted to see if this is something you'd like to consider.

@karmi: Any news on this?

No. It's highly probably I'll bump into this same issues again, with a different application. So I'l have a real problem and real pain to extract the solution from it.

Wonderf... oops, sorry ;-)

Haha :) If you need to pingpong ideas for workaround, catch me on IRC. But I'm sure we will have some support for these dynamic things soon.

I still rely on my aliases branch which works okay but it's a bit off-track of the original tire repository. I prefer to be on the maintainers master branch because everything else is just a PITA after a while.
Keep on the good work.

Just a thought experiment: We agree that searching can be done with something like @blog.posts.search '...', so we're only left with designing the persistence stuff. Then again, if all we need to do is to choose index/index name on save, isn't that (a very simple form of) sharding?
If it is, it may be an idea to have a generator/facade which simply returns the static index name in the general case but may be overridden to return something more complicated (e.g. based on the instance). That idea could take us even further without complicating the code too much or drifting away into edge cases. What do you think?


Option to show redundant/obsolete translations

An action that would show messages in existing translations that no longer appear in new translation files.

Essentially a duplicate of #4.


deps update

coverage: 100.0%. remained the same
when pulling 8ca7c0568796697d940284202e8e36f4286db306 on proto
into c1b7f9aa14d0e636268e6a228a49ac24971d21fb on main.


Improve performance when introspecting model classes

Using the utility class from #22, enable caching of model properties and similar information we're currently computing every time we serialize a given class. This should take a significant chunk out of processing time.

E.g. here: https://github.com/SphtKr/JSONAPI.NET/blob/master/JSONAPI/Json/JsonApiFormatter.cs#L554


Polish pages for core release

[ ] where does "more about 3box" redirect to?
[ ] confusion: sign in to hub in nav & sign in to hub on app page have different func
[ ] confusion: for users directs user to profile section on API pg for devs
[ ] send "Join" form to same place as before?
[ ] where does "About" page link to?

to the https://3box.io/about page, which we will implement next sprint
Let's update to "Log In" on App page
For Users meant to direct to App page
Where does "Join" go now? I imagined that was just an email submit with no redirect or anything.
About page will link to About page, which will be implemented next sprint: https://3box.io/about
Yup, it will open a new page to chat.3box.io
Yeah, would be great do you to design mollie's card and we can use that as the future design basis for the hover component. I like what you did on the first version. For content, let's also add to what you have now: description, emoji, ...
cc @oznekenzo


VGG16 Weights

Hi, I'm wondering if you have the vgg16.pt file as I cannot find it in the google drive or is it fine to use any vgg16 weights online? Thank you in advance!

Hi!
Thanks for your interest in our work! You can download the vgg16 weights from: https://nvlabs-fi-cdn.nvidia.com/stylegan2-ada-pytorch/pretrained/metrics/vgg16.pt
Please don't hesitate to let me know if you run into any issues when running the code.
Jueqi


not detecting anything

Hello, I am completely new on this topic so please excuse if I did something wrong.
I trained my network in colab, and got my best.pt file. The i use this to convert it to a onnx file:
!python /content/yolov5/export.py --weights /content/yolov5/runs/train/exp/weights/best.pt --data /content/datasets/SL-CratesBig-2/data.yaml --include onnx
I took one of the test images taht was proeprly recognized with a confidence of 0.98 and saved it in my project folder with the name test.jpg.
below is my code.
Predictions has always count 0.
any idea why?
thank you!
Imports Yolov5Net

Public Class Form1
    Private Sub Form1_Load(sender As Object, e As EventArgs) Handles MyBase.Load
        Dim image As Image
        image = Image.FromFile("Assets/test.jpg")

        Dim myscorer As New Yolov5Net.Scorer.YoloScorer(Of Yolov5Net.Scorer.Models.YoloCocoP5Model)("Assets/Weights/best.onnx")

        Dim predictions As List(Of Scorer.YoloPrediction) = myscorer.Predict(image)

        Dim g As Graphics = Graphics.FromImage(image)
        For Each prediction In predictions
            Dim score As Double = Math.Round(prediction.Score, 2)

            g.DrawRectangles(New Pen(prediction.Label.Color, 1), New RectangleF() {prediction.Rectangle})
            Dim x As Integer = prediction.Rectangle.X - 3
            Dim y As Integer = prediction.Rectangle.Y - 23

            g.DrawString("{prediction.Label.Name} ({score})", New Font("Arial", 16, GraphicsUnit.Pixel), New SolidBrush(prediction.Label.Color), New PointF(x, y))
        Next
        image.Save("Assets/result.jpg")
    End Sub
End Class

A) Did you run predict.py on the image with your ONNX model?
B) Did you change the category list in your model and if so did you change it in your scorer as well?

thank you for your answer gillonba, please bear with me, as i am only partially understanding your questions.
A) there is no predict.py in my yolo v5 folder. if you mean the detect.py then yes, i did and it works. here is a screenshot:

B) How do I do that? how can the category list be changed? isnt that done automatically when converting?

I uploaded the c#.net project to my ftp, with the onnx model, one test image and the data.yaml file.
www.igormasin.it/fileuploads/test.zip

A) yep, it is detected properly and drawn on the image.
B) thank you, I'm not able to find this file in my project. any idea of where it is located?

I managed to solve it by crating a new class, copying in the existing models found online, and editing them. thank you very much for your help gillonba!

@gillonba
Hello Can you help me with this problem ?
Error


ORC-858: Add NoLineWrap/OneStatementPerLine/NeedBraces checkstyle rules

What changes were proposed in this pull request?
This PR aims to add NoLineWrap, OneStatementPerLine, NeedBraces checkstyle rules.
Why are the changes needed?
This will improve code quality.
How was this patch tested?
Pass the GHA.

cc: @dongjoon-hyun
These are the new rules.

Merged to main.


Pilot memory leak on deleted pods

https://snapshot.raintank.io/dashboard/snapshot/io5AN542Jl8oPN2pnVFgION16ubJonMW
Created 30 replicas of https://github.com/howardjohn/pilot-load which opens 3k XDS connections to pilot
Repeatedly restarted all the pods, each time causing the jump in pilot memory usage seen in the graph
Version: master-20190607-09-15

I am unable to reproduce


Native Crash In Unity Editor (Dragging & Dropping Crash)

Required Info

Camera Model
D415, D435, D455

Firmware Version
<IP_ADDRESS>

Operating System & Version
Win 10

Kernel Version (Linux Only)
NA

Platform
Unity

SDK Version
v2.39.0

Language
Unity/C#

Segment
NA

Issue Description
Unity Crashes due to native error in the precompiled plugins in the Realsense Wrapper. This issue can be reproduced by following these steps:

Open a Unity Project
Import Unity Wrapper .unitypackage
Play the example scene(s)
Repeat step 3 four or five times
Drag an object from Library or Hierarchy in the Editor
Observer crash

Resolution Description
The issue can resolved by following these steps:

Compile the Intel.RealSense.dll & realsense2.dll from the current master branch
replace the plugins that were imported with the .unitypackage with the ones produced in step 1

Fixed Plugin Files
Attached are the re-compiled library files from commit [d8f5d42]
To replicate the fix, download the zip and replace the plugin folder located Assets/RealSenseSDK2.0/Plugins/
Fixed Plugin Folder: Plugins.zip

Hi @ababilinski   Thanks very much for your detailed report!
I would add that if other Windows users experience this issue and want to try your guide, they can obtain pre-built versions of Intel.RealSense.dll and realsense2.dll from the SDK folder instead of compiling the DLLs themselves.
https://github.com/IntelRealSense/librealsense/issues/7778#issuecomment-728163719

Hi @ababilinski   Do you require further assistance with this case, please?  Thanks!

@MartyG-RealSense no, I just wanted to post this for anyone else that's having the same bug as I am.

Great, thanks very much for adding the information to the RealSense community!   I will close this case now.   Your information will remain findable with a web search.   Thanks again   :)


"There should be no signing configurations in the Gradle configuration in the repository"

What exactly does this mean? If I remove all entries under signingConfigs in build.gradle the AppCenter build shows the error:
Execution failed for task ':app:validateSigningRelease'.
> Keystore file not set for signing config release

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: cb88b888-1e68-8a75-efa4-cef2c33d4369
Version Independent ID: 2fd3c90f-d7e5-5af3-9a50-b5571ac84995
Content: Android Code Signing Setup in App Center - Visual Studio App Center
Content Source: docs/build/android/code-signing.md
Service: vs-appcenter
GitHub Login: @siminapasat
Microsoft Alias: siminap

The underlying reason for this piece is that it is wise from a security standpoint to not check in your signing credentials into your repository.
Another point to note is that if your app is already signed through the Gradle build steps, trying to resign it in the manual signing step will most likely fail.
So I think this is where this reference comes from - it can definitely be formulated more clearly. How about:
"If you decide not to put your signing credentials into your repository, you can also upload the keystore and configure the signing credentials through App Center. In this case, App Center will first build your Android app and then perform a manual signing step after the successful build.
Since trying to sign a build twice is not supported, please make sure that if you provide the signing credentials manually, you have no conflicts with signing configurations in your Gradle configuration for the chosen build variant."

@ranterle thank you for exaplaining!
One question though: if I set the keystore inside AppCenter, which parts of the build.gradle config should I remove in order for the signing release to be set only once?

@vforvasile do you see any errors with your current configuration? Can you help me better understand what part about it you only want to be set once?

@vforvasile Did you get an answer to this? I'm having the same trouble, I just have an 'if env is set' section in my signing config (as they describe in the react native docs) but it's failing on appcenter

Seeing this same error.

Seeing this same error.

Did you got solution ?

@bobber205 @Abhi-Tech9 Sorry for the late response - to help you fix these potential problems, as this is a ticket for the App Center documentation, can you provide more details on your configuration and what exact error you are seeing? You can also share this in private with our customer service, ideally with the information about which app in App Center you're seeing problems with.

I am trying to use App Center build with KeyStore provided on App Center.
As per the latest suggestion from customer service, I have disables signing config in build.grdle by commented it out, like below
// signingConfigs {
//     release {
//         // storeFile file(MYAPP_RELEASE_STORE_FILE)
//         // storePassword MYAPP_RELEASE_STORE_PASSWORD
//         // keyAlias MYAPP_RELEASE_KEY_ALIAS
//         // keyPassword MYAPP_RELEASE_KEY_PASSWORD
//     }
// }
but now I am getting below error
A problem occurred evaluating project ':app'.

Could not get unknown property 'release' for SigningConfig container of type org.gradle.api.internal.FactoryNamedDomainObjectContainer.

so documentation does't exactly say what settings we don't need put in build.gradle to use appcenter provided signing key
Note: I am trying to build this to use .aab experimental feature enabled in app center.

@Abhi-Tech9 This means that your Gradle configuration is referencing the signing configuration release somewhere, i.e. you have a line like signingConfig signingConfigs.release in your configuration somewhere - so removing the entire signing configuration will not be sufficient.
I will follow up with you from the App Center support to further keep this issue for our documentation.

Yes, after commenting below line getting new error now but it is something related to not proper singing key
Commented out
//signingConfig signingConfigs.release
Error :
jarsigner: Certificate chain not found for: ***.  *** must reference a valid KeyStore key entry containing a private key and corresponding public key certificate chain.

I got the gradle file to reference the keystore values referenced in the branch build configuration by removing the following lines in the android/app/build.gradle file
signingConfigs {
    debug {
        storeFile file('debug.keystore')
        storePassword 'android'
        keyAlias 'androiddebugkey'
        keyPassword 'android'
    }
}
buildTypes {
    release {
        // Caution! In production, you need to generate your own keystore file.
        // see https://facebook.github.io/react-native/docs/signed-apk-android.
        //signingConfig signingConfigs.debug
        minifyEnabled enableProguardInReleaseBuilds
        proguardFiles getDefaultProguardFile("proguard-android.txt"), "proguard-rules.pro"
    }
}

Got confused with the code sample in the docs that adds releaseSigningConfig to the build.gradle file.
Turns out if you upload the keystore and fill in the keystore credentials in the build configuration, there is no need to make any changes to the build.gradle file

I know this is closed, but maybe somebody can provide some insight. I'm using option 2, but if I comment out signingConfig as above, gradle fails to build:
Initializing gradle...                                              1.0s
Resolving dependencies...                                           4.8s
Running Gradle task 'assembleRelease'...
Running Gradle task 'assembleRelease'... Done                      10.1s
Gradle build failed to produce an Android package.

This happens locally as well as in App Center. So what should my signing configuration look like in order to have App Center sign it?

@MrTarantula assuming that your build type in your App Center configuration is set to "release"
buildTypes {
    ...
    release {
        minifyEnabled enableProguardInReleaseBuilds
        proguardFiles getDefaultProguardFile("proguard-android.txt"), "proguard-rules.pro"
   }
}

Also, you need to drop in your .keystore or .jks file into your config alongside your configuration.

That's exactly how I have it configured currently. It fails every time. If I add back signingConfig signingConfigs.debug then it will complete, but will not install on a device.

Did you set your build variant to release?

Yes. I should note that I am building with Flutter, using the post-clone script from here. The script also sets the release flag.

I am not familiar with how app signing works on Flutter. My project is on React Native

It still builds and signs with standard Gradle, so it shouldn't be an issue.

On my local machine, with the same code, the same android.keystore, but with the release config explicitly set, yes, it builds and signs.

but if there is no signingConfig set it will fail.

Yes for local, you need to have a signingConfig that specifies the keystore and its credentials but (based on my experience) by allowing App Center to sign the application, you don't need to have a signingConfig for release.

If you check the box My gradle settings are set to sign automatically then you must specify in signingConfigs the keystore.

For instance:
    signingConfigs {
        debug {
            storeFile rootProject.file("app/debug.keystore")
            storePassword "********"
            keyAlias "androiddebugkey"
            keyPassword "********"
        }
        release {
            storeFile rootProject.file("app/release.keystore")
            storePassword "********"
            keyAlias "release-alias"
            keyPassword "********"
        }
    }

And below in buildTypes:
    buildTypes {
        debug {
            signingConfig signingConfigs.debug
        }
        release {
            signingConfig signingConfigs.release
        }
    }

Hope this helps.

This is what finally worked for me, from flutter/flutter#18232:
release {
            signingConfig null

            applicationVariants.all { variant ->
                variant.outputs.all { output ->
                    output.outputFileName = "app-release.apk"
                }
            }
}

I still consider this a hack/workaround, but someone may want to put it in the docs.

And for flavors:
applicationVariants.all { variant ->
    variant.outputs.all { output ->
        if (variant.buildType.name == "release") {
            output.outputFileName = "app-${variant.baseName}.apk"
        }
    }
}

Maybe someone is facing similar issue I solve it add this to
gradle.properties
MYAPP_UPLOAD_STORE_FILE=something.keystore
MYAPP_UPLOAD_KEY_ALIAS=secure-alias
MYAPP_UPLOAD_STORE_PASSWORD=secure-pass
MYAPP_UPLOAD_KEY_PASSWORD=secure-key

build.gradle
    signingConfigs {
        release {
            if (project.hasProperty('MYAPP_UPLOAD_STORE_FILE') && file(MYAPP_UPLOAD_STORE_FILE).exists()) {
                storeFile file(MYAPP_UPLOAD_STORE_FILE)
                storePassword MYAPP_UPLOAD_STORE_PASSWORD
                keyAlias MYAPP_UPLOAD_KEY_ALIAS
                keyPassword MYAPP_UPLOAD_KEY_PASSWORD
            }
        }
    }

 release {
            if (project.hasProperty('MYAPP_UPLOAD_STORE_FILE') && file(MYAPP_UPLOAD_STORE_FILE).exists()) {
                signingConfig signingConfigs.release
            }
            minifyEnabled enableProguardInReleaseBuilds
            proguardFiles getDefaultProguardFile("proguard-android.txt"), "proguard-rules.pro"
 }

@jonra1993 In this case will I have to upload my keystore file to git...??


Can't get GMavenPlus/Reflections example to work

Hi,
I've been having trouble getting the example snippet using GMavenPlus to work.  It seems that if I use the trivial example of:
new org.reflections.Reflections("com.mcleodmoores.xl4j")
    .save("${escapedOutputDirectory}/META-INF/reflections/${project.artifactId}-reflections.xml")

Note here I've dealt with double-escaping backslashes on Windows to process ${project.build.outputDirectory} into ${escapedOutputDirectory}.
I actually need to scan all the current project dependencies for annotations etc, so this trivial example wouldn't work for me anyway, but it's somewhere to start.
Anyway, I end up with an (almost) empty file.
<?xml version="1.0" encoding="UTF-8"?>

<Reflections>
  <SubTypesScanner/>
  <TypeAnnotationsScanner/>
</Reflections>

Further investigation leads me to forJavaClasspath(), but that dumps all the classes included in the dependencies block (I appeared to need to add the first is especially odd given that I'm not using servlets or war files or anything, but moving on...)
<dependency>
	<groupId>javax.servlet</groupId>
	<artifactId>servlet-api</artifactId>
	<version>2.5</version>
</dependency>
<dependency>
	<groupId>dom4j</groupId>
	<artifactId>dom4j</artifactId>
	<version>1.6.1</version>
</dependency>

and I want the classes in the actual project being processed.  After some experimenting it was suggested that for tests, a jar is built with a manifest classpath, so I tried using forManifest(), and forClasspath() in various combinations, I'm running with process both for tests and main code, although i can live without tests if necessary.
Any ideas how I get my project classpath to be scanned?
Many Thanks!

Never mind.  It seems that as documented it could never work.  I will try and put together some documentation of the solution I came up with and do a pull request.


kutt.it support

Please add support for custom kutt.it service. It uses POST requests.
https://docs.kutt.it/#tag/links/paths/~1links/post

Sounds good, I can do that.
Note that kutt.it requires an API key. I have that ability for bitly right now but have to make it a little more generic.
You'll then have to make an account with kuttly and copy and paste the API key into the copy shorturl settings.

I added this and will upload version 5.4.0 to Mozilla now!

Thanks, actually I'm running it on own domain, could you please add this option as well? Thanks.

Oh interesting. Yeah sure

Added -- I'll ship a new version shortly and you should be able to either leave the custom domain field empty or put a domain in that you registered with kutt.it

A sorry, that was a missunderstanding. I meant support for Kutt running on own server, meaning access custom domain directly instead of https://kutt.it to keep data in privacy.

Oh I did not realize. Maybe - that's getting very specific and I need features to be broadly applicable to users. There is a function already for leveraging a GET request API, maybe kutt supports that?

Unfortunately Kutt uses POST only, therefore I mentioned an idea to add POST support to custom service configuration of this addon to more generic.


[Feature Request] Add an option to make it run as a daemon.

Nothing to add here.

Why not just use systemd with "Type=simple"? Should work just fine.

This feature together with the other one I requested are the bare minimum necessary in order to support utahfs in my project as requested here[1]
[1] https://github.com/mhogomchungu/sirikali/issues/152

Couldn't you just use shell wrapper (potentially with nohup, depending how you want to run it) for that?
e.g.:
#!/bin/sh
nohup utahfs-client -cfg ./utahfs.yaml -mount ./utahfs &

It's possible to do all sort of things but why?, this project is based on fuse and ideally, it should work the same way fuse based projects are expected to work.

It's possible to do all sort of things but why?

I just wanted to provide you with a way that doesn't block you from moving on with your project. I didn't say anything against implementing such a feature. I'm just also curious why someone would have a need for an applications to daemonize itself.
From your rather short starting post "Nothing to add here." I got the impression that you just want to run it as a service in the background, that's why I suggested to use a systemd unit instead.
Sorry, that I cannot know what you were thinking, I can only respond to information one provides.

I'm leaning against this for now. You should indeed use a systemd unit or a shell script. That will let you setup forking, decide where logs go, handle crashes, and create PID files or however you intend to let the user stop the process. Those are all things I don't want pulled into this project.

I just wanted to provide you with a way that doesn't block you from moving on with your project. I didn't say anything against implementing such a feature. I'm just also curious why someone would have a need for an applications to daemonize itself.

This is how FUSE based applications work when they run daemonized.

The application starts.
Applications checks if all conditions necessary to run are satisfied.
If a conditions in step 2 fail, the application prints an error on the terminal and exit with a non zero status result.
If all conditions in step 2 pass, the application branches itself into two parts, one part continues as a daemon and the other part returns with a zero result to signify success.

The point of wanting utahfs to be able to daemonise is because all SiriKali supported backends in Linux and Macos(sshfs, securefs, gocryptfs, cryfs, encfs) have this ability and so far, i have not seen a FUSE based CLI application that does not in Linux.
Initially, i did not add a comment because i didn't think this feature needs convincing and i attributed  a lack of this feature(together with utahfs inability to accept FUSE options) to the youthfulness of this project.

I'm leaning against this for now. You should indeed use a systemd unit or a shell script. That will let you setup forking, decide where logs go, handle crashes, and create PID files or however you intend to let the user stop the process. Those are all things I don't want pulled into this project.

Your comment seems to suggest utahfs will need assistance from systemd or other external tool to run daemonized and that is not the case and it should be able to do so all by itself. All other FUSE based tools do all by themselves.
gocryptfs[1] for example can run daemonized without assistance from any other tool. The main thread seems to fork[2][3] and that is as far i can go since i cant read the language.
My distro of choice does not use systemd and it will be strange to add systemd or any other system logging dependency to SiriKali.
[1] https://github.com/rfjakob/gocryptfs
[2] https://github.com/rfjakob/gocryptfs/blob/3b61244b72f74a25651d4ba184ac7cc62c937db0/main.go#L154
[3] https://github.com/rfjakob/gocryptfs/blob/3b61244b72f74a25651d4ba184ac7cc62c937db0/daemonize.go#L29

It's not clear to me why other tools have support for this either, honestly. It's a lot of work and a sure source of compatibility issues, for an inherently bad user experience. Whether it's systemd or circus or something else, all OSes provide some kind of service manager that provides what you need.

Well, when you run "mount" command to mount a file system, it doesn't hang on success.
Not hanging seems to be the default behavior when mounting file systems and FUSE documentation[1] seems to have daemonization as a default behavior.
[1] https://www.kernel.org/doc/html/latest/filesystems/fuse.html

ntfs-3g[1] is an example of project that is based on FUSE and DOES NOT have an option to run it as a foreground process.
[1]  https://wiki.archlinux.org/index.php/NTFS-3G

@Bren2010 sorry for directly mentioning you, but I don't know if this comment gets read otherwise as the issue is already marked as closed.
I think this request could be rephrased as the following requirement: utahfs should be split into two parts. One main part that handles the long standing stuff, that could be a systemd service that runs as soon as the computer/server starts but does not have any configuration itself. And 2nd a small short lived "mount" command that gets called when the user mounts a utahfs fuse filesystem. This command would be responsible for talking to the background service, letting it create the actual mount and return if the background service completed this operation successfully.
This would render explicit forking obsolet but also allow the command that gets invoked by "mount" to be short lived. What do you think?

Lets revisit how file systems work in linux.
With traditional file systems, you:-

Mount them using "mount" command.
The "mount" command returns immediately.
The mounted file system continue to run in a background.
The mounted file system is unmounted using "umount" command.

With FUSE based file systems like utahfs, the steps should be the same and should be you:-

Mount utahfs file system using "utahfs-client".
The "utahfs-client" command returns immediately.
The utahfs file system continue to run in a background.
The utahfs file system is unmounted using "fusermount" command.

The request here was to make utahfs have a typical behavior of file systems.
Forking and letting the child handle the mounted file system and parent returning immediately is the cleanest solution because:-

It causes utahfs to be self sufficient because it wont need systemd or any other tool to start any part of it.
One instance of utahfs-client will be managing one instance of a running file system. No need for client-server architecture and the associated complexity as suggested by @agowa338
In my local tests here, a process that is running a mounted file system for cryfs, gocryptfs, securefs, sshfs, encfs, fuseiso, ntfs-3g,exfat and  archivemount is owned by a process with a PID of 1 and this suggests all of them are doing the forking dance and the dance is the standard way of doing it.


[BUG]

Describe the bug
The OP label colors indicate the color of the label when the mouse hovers over the comment in question, rather than the label's standard color. For instance, to make the foreground color match the grey of the OP commenter's username, the color has to be set to 96/96/96, the color the the username when highlighted, rather than 136/136/136, the color of the username otherwise.
To Reproduce
Steps to reproduce the behavior:

Set the foreground or background color of the OP label to a defined value.
Using a high DPI monitor or a high level of zoom in one's browser, use a color picking tool to see the color of the OP label when not highlighted by the mouse. As browser-based extensions seem to have difficulty registering the color without also highlighting the comment in the process, the most reliable means of doing so seems to be to take a screenshot and subsequently using a utility such as GIMP to register the color. In the case of 96/96/96, the displayed color is 136/136/136.

Expected behavior
The OP label's defined colors should correspond to the colors that are displayed when the comment in question is not highlighted.
Screenshots
While the default color for usernames on Kbin is 136/136/136, entering this value for the OP label foreground text makes it appear too bright:

Taking the same screenshot when the comment is highlighted, the OP label is still brighter than the highlighted username color, but matches the initial username color:

By instead entering the color of a highlighted username, the darker 96/96/96, the colors now match:

[When submitting a bug report, you can click the clipboard icon on the bottom right of the KES menu to copy system settings to the clipboard. Alternatively, you can manually enter that information below.]
KES version:

Version number: 2.2.2

Extension and version:

Extension: Tampermonkey
Version number: 4.19.0

Desktop (please complete the following information):

OS: Windows 10
Browser: Chrome
Browser version: 118.0.5993.89

Thank you for waiting. After investigating this further, I think it might be contraindicated to forcibly change the opacity of elements in the header. The reason is because the header is designed to have a 75% opacity under kbin's default theming, and only return to 100% opacity on a hover action. Insofar as the OP label is being put into the header, I believe it should respect the default styling of the header rather than overriding it, since that behavior would be unexpected. I don't think we should intentionally change styling if it affects other default elements, since the outcome would be unexpected and deviate from the basic kbin theme.
As a compromise, I think we could include a disclaimer in the add-on's description indicating that the colors will be reduced to 75% opacity when inserted into the header. Does this seem reasonable?
We could also try visualizing what the reduced opacity will look like, but it would be unorthodox to make a special case for this one add-on, since by design KES add-ons should draw from common widgets (in this case, the colorpicker) when building the settings panel.

I guess a disclaimer would at least tell people why the colors appear as they do in case anyone else runs into the same issue.


v1.3.0?

Hello!
Just noticed that the VSCode Marketplace says that the latest version is v1.3.0, but I only see v1.2.0 here. Which is correct?
Thanks,
Oliver

Oh dear! What has happened here? I shall investigate.

All fixed, thank you for the report


CLIMATE-825 - Coalesce data sources into one module

-Added a new class called DatasetLoader
-Added corresponding documentation and unit tests
Read the docstrings for more info on the API, but the gist of it is that it was designed to easily load the inputs to each data source loader from our current config files.
This is intended for the 1.2 release.

Can one of the admins verify this patch?

Coverage increased (+0.6%) to 84.256% when pulling 541dbe53fcb4d014161d9a64f7b8f890f3360069 on agoodm:CLIMATE-825 into 442a9b2d7ef0c42547f1a055a513b07face41553 on apache:master.

@agoodm can you please fix landscape.io issues? The build failed because there were multiple PEP8 violations. Please take a look at this -> Link

Coverage increased (+0.6%) to 84.256% when pulling fa8356c5492df5827020be9500d8d2375e777038 on agoodm:CLIMATE-825 into 442a9b2d7ef0c42547f1a055a513b07face41553 on apache:master.

@jarifibrahim I fixed the PEP8 violations flagged in my previous commits, but the landscape.io check has been running for over 12 hours.

@agoodm I'm not sure why the build is stuck. I tried starting a new build but it also got stuck at waiting. The issue seems to be with landscape. Please go ahead and merge this PR.

@agoodm This is wonderful. Thank you so much. I have very minor suggestions.

dataset_loader.py can be located in ocw/data_source folder.
Would it be possible to have 1) multiple references and 2) reference only without targets?

is very useful when calculating metrics using multiple variables.
for example, we should be able to load daily reanalysis data only and calculate k-means clustering.

@huikyole Not sure if I agree with your first suggestion. I thought the intent of having data_source as a separate directory was originally due to having multiple modules for loading from each data source. The modules in the base ocw directory represent each of the individual steps in the workflow, eg dataset processing, running evaluations, and plotting. The main thing that was missing previously was loading the datasets which is exactly what this module aims to do. So for now I think leaving it here is appropriate. I think @lewismc should share his thoughts on this though too.
I absolutely agree with your second suggestion though. I originally had it set up this way because to my recollection, the rest of the OCW codebase (particularly metrics and evaluations) were designed with "one reference" dataset. Given that Loikith et al. 2013 uses two reanalysis datasets, we should get rid of this rigid assumption not only for dataset_loader.py but potentially for evaluation.py as well. I think for now changing  the former obviously takes precedence but we should consider exploring the the latter as well.


Implements null safety

Hi I wanted to use this library for a new project which is using flutter 2.0 and the new null safety features. Do you need help to implement it or are you good to go?

Hey yanisoo, I need some help with reviews and field testing, can you check if this branch satisfy your requirements?
I'm already using this one but haven't migrated my app to null safety yet so I'm not sure if everything works as expected.

If I understood correctly, the code is generated from the Bungie API, however it seems some of the more recent API changes have not been implemented. Which might explain why some files are importing functions that do exist. What should I do ?

oh sorry, check now.

I've been using it in my project for the past 2 month so far so good if you ask me ! Thanks a lot!

let's go then!


Initial filters

Fixes #10
(once it works)

Codecov Report

Merging #18 (ccb0776) into main (abad9e6) will decrease coverage by 0.60%.
The diff coverage is 95.00%.

Additional details and impacted files
@@            Coverage Diff             @@
##             main      #18      +/-   ##
==========================================
- Coverage   95.65%   95.06%   -0.60%
==========================================
  Files           4        5       +1
  Lines          23       81      +58
==========================================
+ Hits           22       77      +55
- Misses          1        4       +3

Impacted Files
Coverage Δ

src/genomic_features/_core/filters.py
94.44% <94.44%> (ø)

src/genomic_features/ensembl/ensembldb.py
94.44% <100.00%> (+1.58%)
:arrow_up:

@ivirshup, I think we should also have functionality to retrieve the column names of multiple filters


Contributor Access

@dittos, haven't heard from you in a while. Figuring you're busy. If you’re out of time/too busy to maintain graphqllib, you can toss over contributor access or put it under an Org and I’d be more than happy to take care of merging PRs/managing issues/releases. Let me know!

We have started a community fork here: https://github.com/graphql-python/graphql-core/


Automator: update<EMAIL_ADDRESS>in<EMAIL_ADDRESS>

Generated by Automator - 2020-08-07T12:09:54+00:00

@istio-testing: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-telemetry-k8s-tests_istio_release-1.7
53494bfbb91df9eb0649d3890c97eb10b85f6ce0
link
/test integ-telemetry-k8s-tests_istio_release-1.7

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@istio-testing: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-telemetry-k8s-tests_istio_release-1.7
ebaf825b81445720687a3d7102867c4f360c6021
link
/test integ-telemetry-k8s-tests_istio_release-1.7

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/retest

@istio-testing: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-telemetry-k8s-tests_istio_release-1.7
ebaf825b81445720687a3d7102867c4f360c6021
link
/test integ-telemetry-k8s-tests_istio_release-1.7

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/retest

@istio-testing: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-telemetry-k8s-tests_istio_release-1.7
ebaf825b81445720687a3d7102867c4f360c6021
link
/test integ-telemetry-k8s-tests_istio_release-1.7

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@gargnupur Those failures seem to be legit/consistent. See the history https://prow.istio.io/job-history/gs/istio-prow/pr-logs/directory/integ-telemetry-k8s-tests_istio_release-1.7
I suspect this has something to do with some of the latest PR's merged in proxy: https://github.com/istio/proxy/pull/2972 or https://github.com/istio/proxy/pull/2971
Could you please verify?
cc @JimmyCYJ @SecurityInsanity

@jwendell : I was expecting this.. hence this PR: https://github.com/istio/istio/pull/26269 will fix conflicts and make sure tests pass in that PR?

Yes please.
Next time, please let us know when a PR is expected to break something else. That would prevent us from spending time investigating what's going on.

Yes please.
Next time, please let us know when a PR is expected to break something else. That would prevent us from spending time investigating what's going on.

Sorry for the trouble! Will do...

@istio-testing: The following test failed, say /retest to rerun all failed tests:

Test name
Commit
Details
Rerun command

integ-telemetry-k8s-tests_istio_release-1.7
0fc9efaf37fd9ccf40876e391758808bcde2dc55
link
/test integ-telemetry-k8s-tests_istio_release-1.7

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

closing in favor of https://github.com/istio/istio/pull/26269


Update CSharp.cs

Due to the advent of .NET 6, the code for writing has changed (Hallo, World)
https://dotnet.microsoft.com/en-us/learn/dotnet/hello-world-tutorial/create

It doesn't work because the System namespace is not imported.

@Richienb starting with .NET 6 and C # 10, this is optional.  You
exactly were they used?

Could you show me the part of the changelog that mentions this?

I can’t find this change, but I can give you documentation from Microsoft.
https://docs.microsoft.com/en-us/dotnet/core/tutorials/top-level-templates

@Richienb
I can’t find this change, but I can give you official documentation from Microsoft.
https://docs.microsoft.com/en-us/dotnet/core/tutorials/top-level-templates


Set default icon to mdi:emoticon-excited-outline

Set the icon to something else than the default eye.
I ended up with mdi:emoticon-excited-outline.
Now stands out a bit more in places like the logbook

Thanks.


[nrf noup] Bluetooth: BT_L2CAP_ECRED is no longer experimental

BT_L2CAP_ECRED is not marked as experimental upstream and we qualify it
downstream.
To be squashed with 1e8c632358761d97cf2d659eb9fdc316b4558547 in the next
upmerge.
Signed-off-by: Herman Berget<EMAIL_ADDRESS>

Why not do this upstream? This is a Host feature.

It has already been removed upstream. The select experimental is only downstream.


Update version to capture recent updates

Codecov Report

Merging #88 (f818337) into main (f5b6d3d) will decrease coverage by 0.16%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main      #88      +/-   ##
==========================================
- Coverage   66.17%   66.00%   -0.17%
==========================================
  Files          21       21
  Lines        1827     1827
==========================================
- Hits         1209     1206       -3
- Misses        456      460       +4
+ Partials      162      161       -1

Impacted Files
Coverage Δ

test/util.go
80.87% <0.00%> (-1.64%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f5b6d3d...f818337. Read the comment docs.


[suggestion] generate formatted .md files using cooklang

First off - love this idea and the effort put into it so far!
This is more of a question / suggestion than an issue, but would it be possible to generate .md files using the cookcli? Essentially converting the .cook file to an .md so I could put it on github or gitlab and have it auto-formatted?

@flynneva I'm not sure I understood what you mean. Do you suggest to create an .md recipe file in classical recipe view with ingredients first and method using Markdown syntax?

By auto-formatting do you mean file rendering into HTML?

By auto-formatting do you mean file rendering into HTML?

@dubadub no I mean what you say in the previous comment: some template .md classical recipe view with ingredients first and method after, maybe with one picture as well at the top or something.

I think this could be implemented as another output-format for the recipe read subcommand pretty easy. @dubadub What do you think?

@skoenig, yes, exactly! I have other priorities right now, but it should be easy enough to do if someone wants to give it a try. I created a page about how to setup development environment and can help with any questions.

This was added in a Rust version. One can run cook recipe --format md ./Borsch.cook to get Markdown version.
---
servings:
- 6
---

#

## Ingredients
- *3 medium* beetroots
- *3 medium* potatoes
- *3 items* carrots
- *2 tbsp* olive oil
- *8 cups* chicken broth
- *2 cups* water
- *2 tbsp* olive oil
- *1 medium* onion
- *2 items* celery
- *1 small* bell pepper
- *3 tbsp* tomato paste
- *1 can* cannellini beans
- *2 items* bay leaves
- *2 tbsp* white vinegar
- *1 tsp* salt
- *4 tsp* black pepper
- *1 glove* garlic
- *3 tbsp* dill

## Cookware
- large soup pot

## Steps
1. Peel, grate and/or slice beetroots, potatoes and carrots. Keep sliced
potatoes in cold water to prevent browning until ready to use then drain.

2. Heat a large soup pot of 5L or larger over medium/high heat and add olive
oil. Add grated beets and sauté 10 minutes, stirring occasionally until beets
are softened.

3. Add chicken broth and water. Add sliced potatoes and sliced carrots then cook
for 10-15 minutes or until easily pierced with a fork.

4. While potatoes are cooking, place a large skillet over medium/high heat and
add olive oil. Add finally chopped onion, celery and bell pepper. Saute stirring
occasionally until softened and lightly golden for 7-8 minutes. Add tomato paste
and stir fry 30 seconds then transfer to the soup pot to continue cooking with
the potatoes.

5. When potatoes and carrots reach desired softness, add cannellini beans with
their juice, bay leaves, white vinegar, salt, black pepper, pressed garlic, and
chopped dill. Simmer for an additional 2-3 minutes and add more salt and vinegar
to taste.


Update pip versions in requirements #155

requirements.txt, lock.requirements.txt:

Versions need to be updated to current versions in
gamechanger-data

Reference:

https://github.com/dod-advana/gamechanger-data/issues/285
https://github.com/dod-advana/gamechanger-ml/issues/155

Description
Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.
Ticket(s) or Issue(s):
Type of change

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration

[ ] Local
[ ] Server 119
[ ] Server 115
[ ] K8

Screenshot of automated jenkin tests (if applicable):
Checklist:

[ ] My code follows the style guidelines of this project

[ ] I have performed a self-review of my own code

[ ] I have commented my code, particularly in hard-to-understand areas

[ ] I have made corresponding changes to the documentation

[ ] My changes generate no new warnings

[ ] I have added tests that prove my fix is effective or that my feature works

[ ] New and existing unit tests pass locally with my changes

[ ] Any dependent changes have been merged and published in downstream modules

[ ] I have used an autoformatter like lint or blackc

[ ] This requires a code review

CC: @drospond @mishoe @amaruca141
requirements.txt
gamechanger-data_parser_tuan.txt

CC: @drospond @mishoe @amaruca141
requirements.txt
gamechanger-data_parser_tuan.txt

Hey @neofob ,
can you try to install PyMuPDF==1.17.2 instead of the current version you are using and run again (if that fails, next try any available version within 1.17.X
Reply back after you figure out if this resolved the issue.

CC: @drospond @mishoe @amaruca141
requirements.txt
gamechanger-data_parser_tuan.txt

Hey @neofob ,
can you try to install PyMuPDF==1.17.2 instead of the current version you are using and run again (if that fails, next try any available version within 1.17.X
Reply back after you figure out if this resolved the issue.

@mishoe : Thanks for the tip. I uninstall pymypdf and reinstall with version 1.17.2.
common.parserDocument now can can go a bit further but it show this error? trying to connect to postgresql server?
python -m common.document_parser pdf-to-json -s /mnt/extra/gamechanger-download/ -d /tmp/test-dataST 2   tp-dev
2023-11-16 15:02:20,940 - [INFO] - Document Parser has started
Memory Hard Limit: -1 Soft Limit: -1 Maximum of percentage of memory use: 0.8
____________________ 56084844____________________
/home/tuan/miniconda3/envs/gc-data-dev/lib/python3.8/site-packages/torch/cuda/__init__.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at  /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
  return torch._C._cuda_getDeviceCount() > 0
2023-11-16 15:02:21.610950: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-11-16 15:02:21.610977: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
/home/tuan/miniconda3/envs/gc-data-dev/lib/python3.8/site-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (1.26.18) or chardet (5.2.0)/charset_normalizer (2.0.12) doesn't match a supported version!
  warnings.warn("urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported "
[IMPORT ERROR]: No Topic Models, skipping extract_topics
2023-11-16 15:02:27,595 - [INFO] - Parsing Multiple Documents: 68005
Current Time = 15:02:27
2023-11-16 15:02:27,596 - [INFO] - Processing: <_MainProcess name='MainProcess' parent=None started> - Filename: MARADMIN 512-16 ENLISTED MARINE ACCESSION PROCESS INTO THE.pdf
running policy_analyics.parse on /mnt/extra/gamechanger-download/MARADMIN 512-16 ENLISTED MARINE ACCESSION PROCESS INTO THE.pdf
ERROR in policy_analytics.parse: (psycopg2.OperationalError) connection to server at "localhost" (<IP_ADDRESS>), port 5432 failed: Connection refused
	Is the server running on that host and accepting TCP/IP connections?

(Background on this error at: https://sqlalche.me/e/14/e3q8)
2023-11-16 15:02:27,884 - [INFO] - Finished Processing: <_MainProcess name='MainProcess' parent=None started> - Filename: MARADMIN 512-16 ENLISTED MARINE ACCESSION PROCESS INTO THE.pdf
2023-11-16 15:02:27,884 - [INFO] - Processing: <_MainProcess name='MainProcess' parent=None started> - Filename: COMNAVRESFORCOMINST 5041.9.pdf
running policy_analyics.parse on /mnt/extra/gamechanger-download/COMNAVRESFORCOMINST 5041.9.pdf
ERROR in policy_analytics.parse: (psycopg2.OperationalError) connection to server at "localhost" (<IP_ADDRESS>), port 5432 failed: Connection refused
	Is the server running on that host and accepting TCP/IP connections?
...

It still does not output anything to the output directory.

CC: @drospond @mishoe @amaruca141
requirements.txt
gamechanger-data_parser_tuan.txt

Hey @neofob ,
can you try to install PyMuPDF==1.17.2 instead of the current version you are using and run again (if that fails, next try any available version within 1.17.X
Reply back after you figure out if this resolved the issue.

@mishoe : Thanks for the tip. I uninstall pymypdf and reinstall with version 1.17.2. common.parserDocument now can can go a bit further but it show this error? trying to connect to postgresql server?
python -m common.document_parser pdf-to-json -s /mnt/extra/gamechanger-download/ -d /tmp/test-dataST 2   tp-dev
2023-11-16 15:02:20,940 - [INFO] - Document Parser has started
Memory Hard Limit: -1 Soft Limit: -1 Maximum of percentage of memory use: 0.8
____________________ 56084844____________________
/home/tuan/miniconda3/envs/gc-data-dev/lib/python3.8/site-packages/torch/cuda/__init__.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at  /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
  return torch._C._cuda_getDeviceCount() > 0
2023-11-16 15:02:21.610950: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-11-16 15:02:21.610977: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
/home/tuan/miniconda3/envs/gc-data-dev/lib/python3.8/site-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (1.26.18) or chardet (5.2.0)/charset_normalizer (2.0.12) doesn't match a supported version!
  warnings.warn("urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported "
[IMPORT ERROR]: No Topic Models, skipping extract_topics
2023-11-16 15:02:27,595 - [INFO] - Parsing Multiple Documents: 68005
Current Time = 15:02:27
2023-11-16 15:02:27,596 - [INFO] - Processing: <_MainProcess name='MainProcess' parent=None started> - Filename: MARADMIN 512-16 ENLISTED MARINE ACCESSION PROCESS INTO THE.pdf
running policy_analyics.parse on /mnt/extra/gamechanger-download/MARADMIN 512-16 ENLISTED MARINE ACCESSION PROCESS INTO THE.pdf
ERROR in policy_analytics.parse: (psycopg2.OperationalError) connection to server at "localhost" (<IP_ADDRESS>), port 5432 failed: Connection refused
	Is the server running on that host and accepting TCP/IP connections?

(Background on this error at: https://sqlalche.me/e/14/e3q8)
2023-11-16 15:02:27,884 - [INFO] - Finished Processing: <_MainProcess name='MainProcess' parent=None started> - Filename: MARADMIN 512-16 ENLISTED MARINE ACCESSION PROCESS INTO THE.pdf
2023-11-16 15:02:27,884 - [INFO] - Processing: <_MainProcess name='MainProcess' parent=None started> - Filename: COMNAVRESFORCOMINST 5041.9.pdf
running policy_analyics.parse on /mnt/extra/gamechanger-download/COMNAVRESFORCOMINST 5041.9.pdf
ERROR in policy_analytics.parse: (psycopg2.OperationalError) connection to server at "localhost" (<IP_ADDRESS>), port 5432 failed: Connection refused
	Is the server running on that host and accepting TCP/IP connections?
...

It still does not output anything to the output directory.

Good, looks like we got past the last issue @neofob
Amanda is on PTO until 11/21, and will be the best to answer this directly, but let me give you a quick recommendation. This error is in relation to the script expecting being able to call an RDS instance, which I do not believe is a requirement to parse files locally (although you're getting an exception because you can't connect)
Can you try an alternate approach for me - once you get everything installed on the GC data side you should be able to try to run the parse pipelines by the approach described in this README (scroll down on this page to see the readme):https://github.com/dod-advana/gamechanger-data/tree/dev/common/document_parser
Specifically these instructions.
import Document

Document.process_dir(dir_path = 'FMR', out_dir= './FMR_out/', clean=True)
# processes an entire directory of pdf documents.

Let me know if this works!
cc: @amaruca141 @drospond

....
Can you try an alternate approach for me - once you get everything installed on the GC data side you should be able to try to run the parse pipelines by the approach described in this README (scroll down on this page to see the readme):https://github.com/dod-advana/gamechanger-data/tree/dev/common/document_parser
Specifically these instructions.
import Document

Document.process_dir(dir_path = 'FMR', out_dir= './FMR_out/', clean=True)
# processes an entire directory of pdf documents.

Let me know if this works! cc: @amaruca141 @drospond

The document is out of sync of how to reach there, import Document, it is more like this from my Python interactive

>>> from common.document_parser.lib.document import Document

The function, class...process_dir does not exist in that class Document.
2.1 Is the code of process_dir not pushed to the public git repo?
Or,
2.2 The document is needed to updated to the current workflow, isn't it?

Output from processing one pdf file
time python -m common.document_parser pdf-to-json -s /tmp/test-data/AFI-11-405.pdf -d /tmp/test-data-out
2023-11-20 16:47:01,818 - [INFO] - Document Parser has started
Memory Hard Limit: -1 Soft Limit: -1 Maximum of percentage of memory use: 0.8
____________________ 59686844____________________
/home/tuan/miniconda3/envs/gc-data-dev/lib/python3.8/site-packages/torch/cuda/__init__.py:52: UserWarning: CUDA initialization: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx (Triggered internally at  /pytorch/c10/cuda/CUDAFunctions.cpp:100.)
  return torch._C._cuda_getDeviceCount() > 0
2023-11-20 16:47:02.507377: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-11-20 16:47:02.507401: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
/home/tuan/miniconda3/envs/gc-data-dev/lib/python3.8/site-packages/requests/__init__.py:102: RequestsDependencyWarning: urllib3 (1.26.18) or chardet (5.2.0)/charset_normalizer (2.0.12) doesn't match a supported version!
  warnings.warn("urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported "
[IMPORT ERROR]: No Topic Models, skipping extract_topics
2023-11-20 16:47:04,600 - [INFO] - Parsing Single Document
2023-11-20 16:47:04,600 - [INFO] - Processing: <_MainProcess name='MainProcess' parent=None started> - Filename: AFI-11-405.pdf
running policy_analyics.parse on /tmp/test-data/AFI-11-405.pdf
ERROR in policy_analytics.parse: (psycopg2.OperationalError) connection to server at "localhost" (<IP_ADDRESS>), port 5432 failed: Connection refused
	Is the server running on that host and accepting TCP/IP connections?

(Background on this error at: https://sqlalche.me/e/14/e3q8)
2023-11-20 16:47:05,260 - [INFO] - Finished Processing: <_MainProcess name='MainProcess' parent=None started> - Filename: AFI-11-405.pdf

real	0m4.290s
user	0m4.577s
sys	0m1.314s

@mishoe @drospond @amaruca141 : The code that tries to connect to the DB is from common/document_parser/parsers/policy_analytics/parse.py:80.
The code doc_dict = process_ingest_date(doc_dict) in `` was put in by this commit 40a36e2.
For now, I comment out that line and the command line python -m common.document_parser pdf-to-json -s /tmp/test-data/AFI-11-405.pdf -d /tmp/test-data-out produces the json output.

@mishoe @drospond @amaruca141 : Now that I can parse the downloaded PDF files to generate the json files. The document in gamechanger-data refers to the function create_csv_data in Issuance class but neither Issuance nor create_csv_data is in the code repository gamechanger-data.
Is it still a part of the work flow to generate the .csv file to be used in the next step, inserting the json files and csv file to Elasticsearch index?

@neofob here is an older version of a topic model for your usage topic_model_20210208.zip

@mishoe : It still fails to load. Do I need some .py codes as well? I unzip the files to the directory gamechangerml/models as follow:
tree gamechangerml/models
gamechangerml/models
├── __init__.py
├── __pycache__
│   └── __init__.cpython-38.pyc
└── topic_models
    ├── bigrams.phr
    ├── tfidf_dictionary.dic
    └── tfidf.model

2 directories, 5 files

The code in common/document_parser/lib/topics.py is as follow:
from gamechangerml.models.topic_models.tfidf import bigrams, tfidf_model

The file gamechangerml/models/topic_models/tfidf.py was removed in commit a310817e7 in gamechanger-ml repo.
Was it intentional?
CC: @mishoe @drospond @amaruca141

Hi @neofob , do you get any errors in the browser or backend consoles?


How to send Image to GPU -- RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu!

Description
Hi! I'm trying to run inference on images using my model. I'm using the PyTorch engine.
The issue seems to be that the Image that I'm running prediction on is not loaded into the GPU. When I set the model to run on CPU, everything works great, but when I remove the line to set the model to use the CPU, I get the following error:
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu!
How can I load the Image onto the GPU? Is this done via the pipeline, or a transform?
Expected Behavior
There must be a way to explicitly load the image into the GPU?
Error Message
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu!
How to Reproduce?
                this.pipeline = new Pipeline();
		this.pipeline.add(new Resize(OBJECT_DETECTION_FRAME_DIMENSION));
		this.pipeline.add(new ToTensor());

		this.translator = YoloV5Translator.builder().setPipeline(this.pipeline).optSynset(labels).build();

		System.out.println("Device GPU:" + Device.gpu());
		System.out.println("Device CPU:" + Device.cpu());
		this.criteria = Criteria.builder().setTypes(Image.class, DetectedObjects.class)
				.optModelPath(Paths.get(model_directory)).optProgress(new ProgressBar())
				.optDevice(Device.gpu()) // explicitly set to use GPU
				.optTranslator(this.translator).build();

// Running the prediction:
Image converted_image = ImageFactory.getInstance().fromImage(image);
long object_detection_start_time = System.currentTimeMillis();
DetectedObjects detected_objects = this.predictor.predict(converted_image);

What have you tried to solve it?

I've tried to explicitly run the criteria model on the CPU. This fixes it, which confirms that the mismatch is from the model being on the GPU but the image not being on the GPU.

Thank you so much!

The issue was something completely different. I used the YoloV5 export script but exported it on CPU. So when I tried to deploy it, it wasn't working on GPU.


Improved message signing

make permit 1/2 appear as approval messages
if permit messages are malformed (wrong account, or wrong chain), show error

"Signature expires in" and "Spender can spend for" fields seem like they are the same thing, but in your screenshot they have very different values.  I feel like if I can't figure out what the difference is then users definitely won't be able to and we should try to improve the wording.
What does each mean?

"Signature expires in" and "Spender can spend for" fields seem like they are the same thing, but in your screenshot they have very different values. I feel like if I can't figure out what the difference is then users definitely won't be able to and we should try to improve the wording.
What does each mean?

Signature expiration refers to time when you need to sign the message, if you sign it too late, it won't be valid. I feel this is done in signer level only, so that a signer refuses to sign a message that is too old. When the message is signed "Spender can spend for" tells how long the spender can spend the funds until the signature is invalid

Any idea why there is a time limit on how long you have to sign the message?  The signer can ignore this, and a malicious actor can put whatever they want there so it is unclear to me what problem is being solved.  Maybe interceptor should just ignore that field entirely so it isn't as confusing to users?


what is unit USER_DATA_QUOTA ?

what is unit USER_DATA_QUOTA ?
what is mean this code?
    USER_DATA_QUOTA ={
     "tg1":100
   }

bytes

User data limit in bytes unit
tg1 means the user with name of tg1 has 100 bytes of data cunsumption limit

Where i can find this in code? i have lot of channels(more than 500) and it takes a long time to load. Maybe it a good choise to increase 100 to 1000?


Windows improvements; custom message for recursion error when parsing.

Coverage increased (+0.05%) to 97.668% when pulling f9da2a22fed21eded302a1e19291ca6ca07266f5 on dev into b7fd7780bc794e2cddcdc5ebe290b39c8ac9b69b on master.

Coverage increased (+0.05%) to 97.668% when pulling f9da2a22fed21eded302a1e19291ca6ca07266f5 on dev into b7fd7780bc794e2cddcdc5ebe290b39c8ac9b69b on master.

Coverage increased (+0.05%) to 97.668% when pulling f9da2a22fed21eded302a1e19291ca6ca07266f5 on dev into b7fd7780bc794e2cddcdc5ebe290b39c8ac9b69b on master.

Coverage increased (+0.05%) to 97.668% when pulling f9da2a22fed21eded302a1e19291ca6ca07266f5 on dev into b7fd7780bc794e2cddcdc5ebe290b39c8ac9b69b on master.

Coverage increased (+0.05%) to 97.668% when pulling 82e54f55ca9675a62ff688bc2b0d0785e191d79b on dev into b7fd7780bc794e2cddcdc5ebe290b39c8ac9b69b on master.