Object Designer stucks in "Discovering Objects"

Object Designer stucks in "Discovering Objects". The system gets slowy. After a couple of minutes visual studio code crashes.
Symbol can be downloaded without problems from server.
.alcache will be created and include some json files.
Base Application v 15.1.37881.38071

Errorlogs from VS Code
console.ts:137 [Extension Host] SyntaxError: /Users/el/develop/BusinessCentral/.alcache/cache_516e96d2fb90da7cb530fb0293a94a78d1fecf8356a10a37238e8d89c6e94d9f.json: Unexpected end of JSON input	at JSON.parse (<anonymous>)	at /Users/el/.vscode/extensions/martonsagi.al-object-designer-0.1.4/node_modules/jsonfile/index.js:33:18	at /Users/el/.vscode/extensions/martonsagi.al-object-designer-0.1.4/node_modules/graceful-fs/graceful-fs.js:90:16	at FSReqCallback.readFileAfterClose [as oncomplete] (internal/fs/read_file_context.js:61:3)
t.log @ console.ts:137
extensionHost.ts:203 Extension Host
extensionHost.ts:204 Debugger attached.
37console.ts:137 [Extension Host] SyntaxError: /Users/el/develop/BusinessCentral/.alcache/cache_516e96d2fb90da7cb530fb0293a94a78d1fecf8356a10a37238e8d89c6e94d9f.json: Unexpected end of JSON input	at JSON.parse (<anonymous>)	at /Users/el/.vscode/extensions/martonsagi.al-object-designer-0.1.4/node_modules/jsonfile/index.js:33:18	at /Users/el/.vscode/extensions/martonsagi.al-object-designer-0.1.4/node_modules/graceful-fs/graceful-fs.js:90:16	at FSReqCallback.readFileAfterClose [as oncomplete] (internal/fs/read_file_context.js:61:3)
t.log @ console.ts:137
log.ts:190  WARN UNRESPONSIVE extension host, 'martonsagi.al-object-designer' took 52% of 5237.192ms, saved PROFILE here: '/var/folders/lh/bqmn029179n5t52whhm4xpfw0000gn/T/exthost-6d9bf9.cpuprofile' Array(7)
38console.ts:137 [Extension Host] SyntaxError: /Users/el/develop/BusinessCentral/.alcache/cache_516e96d2fb90da7cb530fb0293a94a78d1fecf8356a10a37238e8d89c6e94d9f.json: Unexpected end of JSON input	at JSON.parse (<anonymous>)	at /Users/el/.vscode/extensions/martonsagi.al-object-designer-0.1.4/node_modules/jsonfile/index.js:33:18	at /Users/el/.vscode/extensions/martonsagi.al-object-designer-0.1.4/node_modules/graceful-fs/graceful-fs.js:90:16	at FSReqCallback.readFileAfterClose [as oncomplete] (internal/fs/read_file_context.js:61:3)
t.log @ console.ts:137
extensionHost.ts:203 Extension Host
extensionHost.ts:204 FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory 1: 0x10b956015 node::Abort() [/Applications/Visual Studio Code.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework] 2: 0x10b956594 node::Abort() [/Applications/Visual Studio Code.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework] 3: 0x106b216e7 v8::internal::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*) [/Applications/Visual Studio Code.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework] 4: 0x106b21687 v8::internal::FatalProcessOutOfMemory(v8::internal::Isolate*, char const*) [/Applications/Visual Studio Code.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework] 5: 0x106b64d25 v8::internal::Heap::StartIdleIncrementalMarking(v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [/Applications/Visual Studio Code.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework] 6: 0x106b66479 v8::internal::Heap::StartIdleIncrementalMarking(v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [/Applications/Visual Studio Code.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework] 7: 0x106b62e0d v8::internal::Heap::CreateFillerObjectAt(unsigned long, int, v8::internal::ClearRecordedSlots, v8::internal::ClearFreedMemoryMode) [/Applications/Visual Studio Code.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework] 8: 0x106b608db v8::internal::Heap::CollectGarbage(v8::internal::AllocationSpace, v8::internal::GarbageCollectionReason, v8::GCCallbackFlags) [/Applications/Visual Studio Code.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework] 9: 0x106b6c694 v8::internal::Heap::PromotedExternalMemorySize() [/Applications/Visual Studio Code.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]10: 0x106b6cc3f v8::internal::Heap::PromotedExternalMemorySize() [/Applications/Visual Studio Code.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]11: 0x106d6a9e6 v8::internal::Factory::NewFillerObject(int, bool, v8::internal::AllocationType) [/Applications/Visual Studio Code.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]12: 0x106fccdcb v8::internal::RegExpParser::ParseRegExp(v8::internal::Isolate*, v8::internal::Zone*, v8::internal::FlatStringReader*, v8::base::Flags<v8::internal::JSRegExp::Flag, int>, v8::internal::RegExpCompileData*) [/Applications/Visual Studio Code.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]13: 0x1075d0d99 v8::internal::compiler::ZoneStats::ReturnZone(v8::internal::Zone*) [/Applications/Visual Studio Code.app/Contents/Frameworks/Electron Framework.framework/Versions/A/Electron Framework]14: 0x9587586793c <--- Last few GCs --->[6064:0x10d113000]   662354 ms: Mark-sweep 1978.3 (2069.6) -> 1970.2 (2073.9) MB, 862.1 / 0.1 ms  (average mu = 0.124, current mu = 0.031) allocation failure scavenge might not succeed[6064:0x10d113000]   663475 ms: Mark-sweep 1988.1 (2080.0) -> 1976.3 (2078.0) MB, 1072.1 / 0.1 ms  (average mu = 0.084, current mu = 0.044) allocation failure scavenge might not succeed<--- JS stacktrace --->==== JS stack trace =========================================    0: ExitFrame [pc: 0x1075d0d99]Security context: 0x15ac8bda0d99 <JSObject>    1: getVsConfig [0x15ac41bc5dc9] [/Users/el/.vscode/extensions/martonsagi.al-object-designer-0.1.4/out/utils.js:~202] [pc=0x9587586793c](this=0x15ac41bc2521 <Object map = 0x15acb0817b59>)    2: /* anonymous */ [0x15ac3ec15b29] [/Users/el/.vscode/extensions/martonsagi.al-object-designer-0.1.4/out/ALObjectParser.js:~100] [pc=0x95875ac9378](this=0x15ac3ec15659...
bootstrap-window.js:213 [uncaught exception]: Error: write EPIPE
onUnexpectedError @ bootstrap-window.js:213
bootstrap-window.js:216 Error: write EPIPE
    at WriteWrap.onWriteComplete [as oncomplete] (internal/stream_base_commons.js:83)
onUnexpectedError @ bootstrap-window.js:216
events.js:177 Uncaught Error: write EPIPE
    at WriteWrap.onWriteComplete [as oncomplete] (internal/stream_base_commons.js:83)
abstractExtensionService.ts:155 Extension host terminated unexpectedly. Code:  null  Signal:  SIGABRT
_onExtensionHostCrashed @ abstractExtensionService.ts:155
notificationsAlerts.ts:40 Der Erweiterungshost wurde unerwartet beendet.

Hi, thanks for the details!
I'll check it with above Base App version.

Did you try deleting .alcache folder?
Do you have - possibly big - symbols other than Base/System apps?
Do you have "showStandardEvents" turned on? (If so, try turning it off)

I have only the 3 default symbols

Microsoft_Base Application_15.1.37881.38071
Microsoft_System Application_15.1.37881.38071
Microsoft_System_15.0.37898.0

I can delete .alcache. Directory will be created after starting Object Designer.
showStandardEvents is turned off.

I was able to reproduce it. In workspace settings "show standard events" was enabled. I overlooked this. After disable "show standard events" it works again.

Thanks for the feedback.
I'll remove that option to avoid further confusion. This setting is not required anymore as the new Event List serves its purpose better.

Note to self: remove showStandardEvents setting.

VS Code did crash too on my system.
I think the problem might be caused by several *.app files of the same extension from different tested systems (e.g. 15.3, 16.0, etc.).
After I cleared my .alpackages folder, it still took some time (two seconds), but VS Code didn't crash.
Maybe there should be an error thrown if the extension recognizes several .app files of the same extension?

Crash is likely due to the too big dataset in this case (duplicated objects from multiple app files).
At the moment I filter out the same filenames across multiple projects but version number is not compared within filenames.
v0.1.5 is around the corner but I'll think of some warning to include before the final release.

Note: the average dataset size that is sent to the WebView has been shrinked by ~24%. This should also speed up the loading a bit.


Donate one of the Astronomer provider operators to OSS

https://github.com/apache/airflow/pull/28763 got merged


Name 'unicode' is not defined

Traceback (most recent call last):
File "example.py", line 10, in
dl.download_course_by_url('')
File "/home/boogyman/skillshare-downloader/code/downloader.py", line 38, in download_course_by_url
self.download_course_by_class_id(m.group(1))
File "/home/boogyman/skillshare-downloader/code/downloader.py", line 64, in download_course_by_class_id
slugify(teacher_name),
File "/home/boogyman/.local/lib/python3.8/site-packages/slugify.py", line 24, in slugify
unicode(
NameError: name 'unicode' is not defined

@daliborb20 I got the same error as you. I see that you are using python3 and unicode is not longer supported (or was renamed str, idk). I tried to solve this by changing the slugify.py but without much success. Instead, I ran it on a venv with python2.7. However, I still got a similar error but I was able to fix it by modifying a line in the slugify.py.
def slugify(string):

    """
    Slugify a unicode string.

    Example:

        >>> slugify(u"Héllø Wörld")
        u"hello-world"

    """

    return re.sub(r'[-\s]+', '-',
            unicode(
                re.sub(r'[^\w\s-]', '',
                    unicodedata.normalize('NFKD', unicode(string,  'utf-8'))
                    .encode('ascii', 'ignore'))
                .strip()
                .lower()))

hope this helps :)

just download python-slugify-4.0.0 and install it.  Newer ones will not work, uninstall any latest version you have already installed

just download python-slugify-4.0.0 and install it.  Newer ones will not work, uninstall any latest version you have already installed

install python-slugify not slugify


Consolidate tooling imports.

Both build/tools.go and tools/tools.go were importing build packages.
Consolidate on tools/tools.go.
Signed-off-by: James Peach<EMAIL_ADDRESS>

/ok-to-test

/lgtm
/approve


CIS v2: Add ability to configure alerts

Add ability to configure Alerts when the clusterscan failed/completed

On 2.5-head, using charts: rancher-cis-benchmark:1.0.300

P1 use case works:
Enable monitoring/Alerting on the cluster.
Create a scan CR.
Enable schedule scan on the scan cr. Give in the cron value and retention count. Enable Alerting .
Scans get created. And Alerts are received.
Issues related to this epic have been logged separately.
Closing this one.


Incompatibility with Quilt on 1.19.

Quilt Test Environment
Reproducible?
✅ Yes.
Minecraft Version
1.19
Mod Loader Version
Quilt Loader 0.17.1-beta.1
Mod Versions

Mod Name
Mod Version

QSL + QFAPI
2.0.0-alpha.2+0.55.3-1.19

owo-lib
0.7.3+1.19

Cloth Config
7.0.72

Numismatic Overhaul
0.2.2+1.19

Log Files
latest.log
crash-2022-06-12_16.36.02-client.txt
Fabric Test Environment
Reproducible?
❌ No.
Minecraft Version
1.19
Mod Loader Version
Fabric Loader 0.14.7
Mod Versions

Mod Name
Mod Version

Fabric API
0.55.3-1.19

owo-lib
0.7.3+1.19

Cloth Config
7.0.72

Numismatic Overhaul
0.2.2+1.19

Log File
latest.log

Could you test this again with the newest alpha version of QFAPI? It should fix this issue.

It is fixed by the new QFAPI version. Thank you very much for reporting it to them!


Enclose all variables in the linux userdata in quotes

This encloses all variables in the linux userdata script with quotes to prevent word splitting or globbing. Currently if a string with a space is submitted to one of the unquoted variables, the script breaks.
See shellcheck error SC2046 for details on this type of error and ways to fix it.

Thanks for opening these pull requests @twunderlich-grapl and @christophermaier, I’m sorry you ran into this issue an appreciate your submitting the fix :bow:
I’ll merge this now which will make it available in the template built from the master branch and it will be packaged up in to a tagged release at the end of the month. :bow:

Thank you @keithduncan for the super-fast response 🥇


Improve plugin installation

Hi @wolfv, this is an attempt to address https://github.com/mamba-org/quetz/pull/470#discussion_r739861834
There's a lot of repetitive noise in this PR, but to summarize:

Replace pip install with quetz plugin install in READMEs
Remove quetz from install_requires since it's the wrong package on PyPI
Rename requirements.txt → conda-requirements.txt
Refactor quetz plugin install code:

exe search order ['micromamba', 'mamba', 'conda', 'pip'] → ['mamba', 'conda', 'micromamba']
Add --channel conda-forge to conda install command
Attempt to conda install pip when not found
Improve variable names

Codecov Report

Merging #471 (863438e) into master (88128ae) will decrease coverage by 1.64%.
The diff coverage is 0.00%.

@@            Coverage Diff             @@
##           master     #471      +/-   ##
==========================================
- Coverage   83.17%   81.52%   -1.65%
==========================================
  Files          78       78
  Lines        5824     5831       +7
==========================================
- Hits         4844     4754      -90
- Misses        980     1077      +97

Impacted Files
Coverage Δ

quetz/cli.py
73.03% <0.00%> (-1.79%)
:arrow_down:

...s/versions/53f81aba78ce_use_biginteger_for_size.py
56.25% <0.00%> (-18.75%)
:arrow_down:

quetz/database.py
70.83% <0.00%> (-16.67%)
:arrow_down:

...ns/versions/30241b33d849_add_task_pending_state.py
80.00% <0.00%> (-13.34%)
:arrow_down:

quetz/pkgstores.py
42.63% <0.00%> (-11.65%)
:arrow_down:

...ons/a3ffa287d074_case_insensitive_channel_names.py
68.75% <0.00%> (-6.25%)
:arrow_down:

...s/versions/8d1e9a9e0b1f_adding_download_metrics.py
72.22% <0.00%> (-5.56%)
:arrow_down:

...ions/versions/8dfb7c4bfbd7_new_package_versions.py
80.95% <0.00%> (-4.77%)
:arrow_down:

quetz/database_extensions.py
56.36% <0.00%> (-3.64%)
:arrow_down:

quetz/dao.py
87.87% <0.00%> (-2.19%)
:arrow_down:

... and 3 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 88128ae...863438e. Read the comment docs.

Thanks, this is a good change!


Removed coupling with UI. Used event driven model to trigger UI changes.

Coverage decreased (-0.1%) to 74.826% when pulling cac7f0adee8f128780cc75a655b0df9a5bca1a63 on V0.5rc-List-Alias into 85050dab958fd1f252eae515a8966ea046b4fb5d on V0.5rc.


Add DualMonitorTaskbar 1.22.021813

https://sourceforge.net/projects/dualmonitortb/
A taskbar for the second monitor.
Features

Taskbar on the every monitor
Pinned programs
Aero support
Window manager
Mirror mode
Auto-Hide
Notification area
Start Button (BETA)

@Ash258, ready for review


adding new version for SignalR: includes MSI support

Can one of the admins review this PR? thanks

Can one of the admins review this PR? thanks

@juniwang  Please link to the swagger PR so we can verify the change and the breaking change approval.

@juniwang  Please link to the swagger PR so we can verify the change and the breaking change approval.

Hi Mark, here is the PR for swagger: https://github.com/Azure/azure-rest-api-specs/pull/12101.  HostNamePrefix was removed starting from 2020-07-01-preview and changed to readOnly in previous stable version 2020-05-01.  If the deletion is unacceptable(we strongly want to delete it, this property has no good but confusing our customers),  we can add it back(and I guess another new api-version is needed) and put some warnings on it

Hi Mark, here is the PR for swagger: https://github.com/Azure/azure-rest-api-specs/pull/12101.  HostNamePrefix was removed starting from 2020-07-01-preview and changed to readOnly in previous stable version 2020-05-01.  If the deletion is unacceptable(we strongly want to delete it, this property has no good but confusing our customers),  we can add it back(and I guess another new api-version is needed) and put some warnings on it

Thanks a lot

Thanks a lot


Fix authorization rule in the case of lists or non-null graphs

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

5 of 5 (100.0%)  changed or added relevant lines in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.1%) to 95.816%

Totals

Change from base Build<PHONE_NUMBER>:
-0.1%

Covered Lines:
1607

Relevant Lines:
1641

💛  - Coveralls


Android/Snapshots: Fixed so that we don't render children twice

when making image snapshot.
Before rendering a view we're now setting any visible children to invisible to avoid view.draw(canvas) to render children - and then have to render children after rendering texture/surface views. This ruins opacity - now fixed.
Closes #1633

Feel approach feel a bit risky because it adds a side-effect to the native view but there is probably no way around it.


fix: memory leak in resource tracking

The task in map resourceAwareTasks is not be cleaned when there is a exception, I think. So I clean the resource used by tracking at task unregister function.
And I think the condition task.supportsResourceTracking() in if is redundant since the value can't change.
Signed-off-by: fudongying<EMAIL_ADDRESS>

I think this is the misunderstand, Since the innerOnFailure is using to catch the exception of innerOnResponse(I miss it with the OnFailure function to deal exception of execute). But if that is, I think using callback is more readable


feat: tokenize each request individually and increase warmup image size

This PR resolves some small issues with qwen2-vl.

doubles the size of WARMUP_IMAGE_BASE64 from 20x20px to 40x40px (meets qwens minimal requirement without hacky fix)
removes hacky fix to double the warmup image
prefer tokenizing each request instead of the whole batch at once. this change allows r.truncate to be passed for each request - as previouslly it was not respected when one of the request was smaller than others in the batch.
sets max_s to the max of max_s or the input size. This is required so the rotary and create self._cos_cached of the correct size in relation to the position ids.

these changes resolve a startup issue reproducible with:
text-generation-launcher \
--model-id Qwen/Qwen2-VL-2B-Instruct \
--max-input-tokens 40 \
--max-batch-prefill-tokens 50 \
--max-total-tokens 51

*(note the underlying issue triggers when max-input-tokens is less than max-batch-prefill-tokens)

from 20x20px to 40x40px (meets qwens minimal requirement without hacky fix)

I do not understand, why should we impose anything on the user for the images. If 20px x 20x is not supported we should:

Rescale the image seemlessly and correctly infer on it.
Reject the image with a proper error message.
User's shouldn't have to know anything about the model's internals, 20x20px should be ok imho.


relationship between max SEW and ELEN

In 3.3.1, it says
In the base vector extension, only SEW up to max(XLEN,FLEN) are required to be supported.

But why does it not
In the base vector extension, only SEW up to ELEN are required to be supported.

It seems like we can have a hardware with ELEN 64 but only support max SEW 32. (I know it is weird.)
But in the second case, we cannot have this weird configuration.

Related to #404.  In that issue, the question is "is SEW permitted to be greater than max(XLEN, FLEN)"?  The answer is, of course, yes.  This issue is asking, "is SEW permitted to be less than max(XLEN, FLEN)?"  IMO, the answer should be yes.
Elsewhere, the spec already says Platform profiles may set further constraints on these parameters, for example, requiring that ELEN ≥ max(XLEN,FLEN).  This seems inconsistent with the sentence @HanKuanChen quoted, so perhaps it's an editing error, and we should remove the ISA constraint and make it a platform constraint.


Modal Wrapper throws unknown prop error on handleSubmit prop

The handleSubmit function that I provide is called, but the following error is also thrown.

handleSubmit is listed as a supported prop in the storybook for Modal Wrapper

Bluemix toolchain: Delivery Pipeline deployed carbon-components-react to Bluemix Design System, including commit a1a2dae17f31a3cd848bb0b18a2c5150f930eb3d


Error: Request failed with status code 500

It was working until earlier to, when I started getting the following error message for everyone I try to connect to::
Error: Request failed with status code 500
I tried doing it on the example site as well and still get that message.
https://tiktok-chat-reader.zerody.one/
Any chance of finding a work around for this? I've been running it locally so if theres a way to do only on localhost, that would be amazing as well.
Thanks for your hard work on this project. It really has been a dream come true to be able to see who sent gifts and who tapped. I wish tiktok had a way to do this instead of resorting to third party plugin, but since they dont, I've been relying on your project to track the gifters and tappers.

Same issue here.

same issue here

same issue here

same here

Same issue here.

Same here

Just tested again, and it worked ... Any thoughts on what was the issue?

Issue fixed, internal microservice (responsible for the functioning of the sign server) restarted.
Someone asked why the code for the sign server is not public:
The reason we don't just give people the ability to run the sign server is that it generates tokens to TikTok's website to make requests (like making the request to get you the websocket URL). The nature of being able to do this means people can choose to spam TikTok with a massive number of requests and not get any sort of captchas. If they knew our method, they could scrape any part of TikTok, not just the LIVE side. TikTok used to block this library because we gave out tokens like that. In the interest of this library running forever, we don't give out tokens anymore, only the websocket URL. This means we need the sign API to do all the token stuff behind the scenes so that there are no issues with us getting blocked. Obviously, we can't give out the code to do this, or TikTok will be forced to block it.
Since adopting this method, TikTok have not attempted to block our library for over 6 months now.
At one point they used to block it twice a week. It was absurd.
I understand the inconvenience of it not working in cases like this when I am asleep and not there to fix things that go wrong, but it is much more preferable than no service at all.
Others should have access to restart it when I am asleep, but we recently switched the host running the microservice, and I did not share the details with other library developers.

isaackogan

how often does it happen?

To date, once before

Failed to connect Error: TikTok does not offer a websocket upgrade. Please provide a valid sessionId to use request polling instead.

Issue fixed, an internal microservice (responsible for the functioning of the sign server) had to be restarted. One of the processes behind the sign server crashed and did not restart properly.

Thank you for fixing this, and getting it working again!
This really is an awesome project, and I'm so glad you and the team have started and continue to maintain it. I was scared in the beginning thinking I would not be able to find a work around to this issue.

This issue is coming up again...

Fix in-bound, different reason... Being Ddosed.

Error: TikTok does not offer a websocket upgrade. Please provide a valid sessionId to use request polling instead.
at WebcastPushConnection.connect (C:\Users\Shalev\Desktop\tiktok\node_modules\tiktok-live-connector\dist\index.js:295:17)
at processTicksAndRejections (node:internal/process/task_queues:95:5)
at async C:\Users\Shalev\Desktop\tiktok\src\index.ts:36:21

I'm getting this error the past few days now

hitting the issue again :( any ideas?


Incorrect behavior of custom_filter.  {"highway ": ["bus_stop"]} returns wrong geometry types.

Hi,
Thaks for the nice library you made.
I started to use pyrosm not a long time ago.
For my purposes, it is necessary to filter about 60 types of various tags. When I executed the test with a couple of desired tags in the filter everything worked perfectly.  But when I tried to use the whole set of tags, the result became incorrect. So the vast majority of "Polygon" type instances were transformed "MultiLineString".
For example on pic, the restaurant polygon was converted to lines.

After several tests, I defined that the issue is the usage {"highway ": ["bus_stop"]}  in the filter. When I removed it, the result was as expected (all geometries stayed in native type(polygons)).
Then I ran {"highway ": ["bus_stop"]} filter separately. As a result, I got a set of bus stops. Stops with "Point"  geometry type are ok, but bus stops with geometry type "Polygon" were converted to "MultiLineString".  They are tagged as "public_transport"="platform", but with additional tag "highway"="bus_stop".
At the picture, the "public_trasport"="platform" were converted from polygons to multilines.

Code I used for tests.
pbf_data = "Mittelfranken"

fp = get_data(pbf_data)
osm = OSM(fp)

my_custom_filter = {'amenity': ['fuel', 'post_office', 'taxi', 'atm', 'bank', 'dentist', 'doctors', 'pharmacy', 'post_box', 'marketplace', 'bar', 'biergarten', 'cafe', 'pub', 'fast_food', 'ice_cream', 'restaurant', 'theatre', 'cinema', 'library', 'nightclub', 'recycling', 'car_sharing', 'bicycle_rental', 'charging_station', 'bus_station', 'bench'],
                    'shop': ['clothes', 'convenience', 'general', 'fashion', 'fuel', 'bakery', 'butcher', 'florist', 'greengrocer', 'kiosk', 'mall', 'shoes', 'sports', 'supermarket', 'hairdresser', 'health_food', 'chemist', 'ice_cream'],
                    'tourism': ['hotel', 'museum', 'hostel', 'guest_house', 'viewpoint', 'gallery'],
                    'railway': ['tram_stop', 'subway_entrance'],
                    'leisure': ['playground', 'fitness_station', 'water_park', 'park', 'pitch', 'sports_centre', 'fitness_centre', 'sports_hall', 'fitness_station'],
                    'sport': ['yoga', 'fitness'],
                    'water': ['lake', 'river'],
                    'landuse': ['forest', 'recreation_ground'],
                    'natural': ['heath', 'scrub'],
                    'building': ['kiosk', 'supermarket', 'hotel', 'sports_hall']}
                    #'highway': ["bus_stop"]}

#my_custom_filter = {'highway': ['bus_stop']}

df = osm.get_data_by_custom_criteria(custom_filter=my_custom_filter)

I also noticed that when I used to filter by geometry types, as "keep_ways=False, keep_relations=True, keep_nodes=custom_filter.True", it also converted most of the polygons to LinearRing.


Route table association question

Hello,
Thanks for such a wonderful workshop. Learned a lot from it. Sorry if my question is too trivial, but networking is not my forte.
Folder /net defines two groups of three private subnets, marked with p1, p2, and p3, and i1, i2, and i3 suffixes. There are four routing tables declared, named rtb-0102c621469c344cd, rtb-0329e787bbafcb2c4, rtb-041267f0474c24068, and rtb-0939e7f3ae6e7b829.
Then there is a bunch of aws_route_table_association__rtbassoci- files linking them. What I see (in master branch) is three declarations associating rtb-0329e787bbafcb2c4 with i1, i2, and i3 on one end and always p3 on the other. On the other hand, rtb-0102c621469c344cd and rtb-041267f0474c24068are associated with p2 and p1 respectively, but no i anything at all. Quite likely I am grossly misunderstanding the design, but my expectation was that one iN is to be associated with one pN. Could you please clarify?
And rtb-0939e7f3ae6e7b829 has no associations whatsoever. Does this mean that this routing table is not being used?
Thank you very much,
-Anatoli

Hi,
I've tidied that all up now so it should make more sense.
Thanks for spotting it !
As is happens all these route tables end up with the same entries - so we could collapse / simplify it further


Data augmentation functions

We will later on have a class that will be responsible for feeding data into the model during the training.
We could just feed the raw images, but we won't stop here.
The idea is to have some functions that will modify the images and annotations to increase the accuracy of the model.
Here are some function ideas (higher is highest priority):

[x] image / annotation flip : flipping images and steering (and maybe some other values that can be mirrored)
[x] random noise : add some noise to the image.
[x] random brightness : change the brightness of the image.
[x] random shadows : change the brightness of a region on the image.
[x] color shift : maybe vary a bit the colors on the image.
[ ] simulate a car in front : add a randomly placed image of back of cars on the image (maybe also offset the steering to be able to overtake). The size of the car will also vary.

This aged well, we now have a unity project "AutoCopylot" to generate synthetic data


Ensure twitch emote names are escaped

Pull request checklist:

[x] CHANGELOG.md was updated, if applicable

Description
Fixes an issue pointed out in https://github.com/Chatterino/Chatterino2/issues/995#issuecomment-802786567
Also closes #995 (?)

Tested, and works as expected :+1:

Very nice fix 👍🏻 Thank you @zneix!


I get a compilation error in version 0.0.2.

If you use the following function to use the RTC (real-time clock) function, a compile error will occur.
M5.Rtc.GetData ()
M5.Rtc.SetData ()
After reverting the version to 0.0.1, the error no longer occurs.

SetData => SetDate
GetData => GetDate

SetData => SetDate
GetData => GetDate

Thanks.


Categorize papers by recency

Filters through all recent papers from the past month and creates the following categories/headings in the UI:

Today's papers
Papers from the past 3 days
Papers from the past week
Rest of the papers from this month

Cross-reference #27


[Bug]: SMTP: The user keeps getting mail after configuring and sending the mail once.

Is there an existing issue for this?

[X] I have searched the existing issues

Description
As a user, after having created a query with a subject line and a body, I am constantly being sent the same email from the last many days multiple times a day.
Steps To Reproduce

Creata a SMTP datasource
Create a query to send mails

Observation - The same mail keeps coming without fail too many a times randomly without getting stopped.
Public Sample App
No response
Environment
Production
Issue video log
No response
Version
1.9.12

@AnandShahs123 please share the app where this is happening

@Nikhil-Nandagopal - https://release.app.appsmith.com/app/mydynamo/page1-63fdcfa7e925565a06932031
Please refer to the SMTP datasource in this app

I set up an app with smtp while testing workflows, and couldn't reproduce this anymore


feat: add HardwareDetails Boots and Tests tabs

add HardwareDetails Tests tab
move TestsTable to its own folder and make it reusable
add HardwareDetails Boots tab
move selected page tab to root route to be easily reused
move tests cards to src/components/cards
move BootsTable to /src/components
make BootsTable route independent
make hardwareDetails enpoint return boots/tests archSummary

Close #495 #476
How to test:

run the front-end and back-end servers
go to http://localhost:5173/hardware/ such as http://localhost:5173/hardware/libretech,all-h3-cc-h5

Note: some i18n messages still use the old keys like treeDetails.builds instead of global.builds, that will be addressed in another PR as it is a lower priority

This route throws this error unsupported operand type(s) for +: 'NoneType' and 'NoneType'

https://github.com/kernelci/dashboard/issues/517
Assigned this issue to you


Added ability to use regex in attribute order.

I wanted to be able to specify a rule like "id" then "class" then everything else. This can be achieved by allowing regex in the attribute order array. This lends a lot of flexibility and could be useful for lots of things like "class" then "data-.*" or something along those lines.
Implementation was pretty straightforward. I first modified the existing logic to iterate over the attributes in a nested loop and check each one. Then I added regex processing of each pattern supplied instead of just names. Finally, I added a list of attributes which have already been matched by an earlier pattern in case a later regex is more general (as in "id" then "class" then everything else).
The original properties of allowing extra attributes in the tag, and allowing attributes to be missing are retained.

Coverage remained the same at 100.0% when pulling d3f668d1e735b17d34b4312175f27ac3c4f86c27 on HoustonFortney:master into c2f722a1ca5ec236c1742c5f66d69d790376e8a0 on htmllint:master.

Running multiple regexes on every attribute name in a file is not something we want to do--it's just too slow. This patch also makes a string input match any attribute name containing it, which is confusing.
I will probably rewrite this to keep using indexing for all the strings in the list, and check everything with a regex if the input starts and ends with / or is a RegExp object.

Good catches. Let me know if you would like me to do anything else.

That was harder than expected. (It's merged but Github doesn't think so.)


Bug while receiving Submit button action from Adaptive Card in Teams

Version
4.18.1
Describe the bug
Before (last week), when you clicked a 'submit' action button of adaptive card in order to submit some input fields, the invoke activity type was received in Microsoft.Bot.Builder.ActivityHandler class.
As for now, the message activity type is sent for some reason, that causes Microsoft.Bot.Builder.Teams.TeamsActivityHandler.OnInvokeActivityAsync() method to not be invoked.
Microsoft.Bot.Builder.ActivityHandler.OnMessageActivityAsync() is called at the moment. It's not implemented by the TeamsActivityHandler class so its overriding is not foreseen for Teams bot functionality.
To Reproduce

Click on any action button that has the submit type

Catch the message activity type

Expected behavior
turnContext.activity.type must be invoke
Screenshots

Additional context
This is a Teams bot of messaging extension type.
Here is the configuration:
{
  "$schema": "https://developer.microsoft.com/en-us/json-schemas/teams/v1.14/MicrosoftTeams.schema.json",
  "manifestVersion": "1.14",
  "version": "1.0",
  "id": "<<YOUR-MICROSOFT-APP-ID>>",
  "packageName": "com.package.name",
  "developer": {
    "name": "Microsoft",
    "websiteUrl": "https://dev.botframework.com",
    "privacyUrl": "https://privacy.microsoft.com",
    "termsOfUseUrl": "https://www.microsoft.com/en-us/legal/intellectualproperty/copyright/default.aspx"
  },
  "name": {
    "short": "Bot for Scheduling Interviews",
    "full": "Microsoft Teams Bot for Scheduling Interviews"
  },
  "description": {
    "short": "Bot for Scheduling Interviews",
    "full": "Bot for Scheduling Interviews built with the Bot Builder SDK"
  },
  "icons": {
    "outline": "icon-outline.png",
    "color": "icon-color.png"
  },
  "accentColor": "#FFFFFF",
  "bots": [
    {
      "botId": "<<YOUR-MICROSOFT-APP-ID>>",
      "scopes": [
        "team"
      ]
    }
  ],
  "composeExtensions": [
    {
      "botId": "<<YOUR-MICROSOFT-APP-ID>>",
      "canUpdateConfiguration": true,
      "commands": [
        {
          "id": "scheduleInterview",
          "type": "action",
          "context": [
            "compose"
          ],
          "description": "Command to run action to schedule an interview",
          "title": "Schedule an interview",
          "parameters": [
            {
              "name": "title",
              "title": "Interview title",
              "inputType": "textarea"
            },
            {
              "name": "description",
              "title": "Interview description",
              "inputType": "textarea"
            },
            {
              "name": "time",
              "title": "Interview suggested time",
              "inputType": "textarea"
            }
          ]
        }
      ]
    }
  ],
  "validDomains": [
    "<<Base_Url>>"
  ]
}

Hi @vova-lantsov-dev,

Did you make any code changes, and if so, does reverting them fix the issue?
SDK 4.18.1 is fairly new. Does this issue occur on older versions of the SDK?
Did you upgrade any Teams packages?

@anishprasad01

No, I didn't make any changes. It just stopped working when I tried to call this API on Monday after holidays.
I tried on version 4.16, the same behaviour
What packages I exactly have:

I've requested someone from Teams to look into this, since you made no code changes and there were no releases on the Bot Framework side between when it worked and when it failed.

@vova-lantsov-dev,
Teams is unable reproduce the issue. It's possible it was a transient issue. Is this issue still occurring for you?


Eliminate json.Marshal in volumes/volume.go

Should be replaced with json.NewEncoder(...).Encode.

#dibs

Hey @hqhq, I've already pushed a change for this

OK, go ahead please, you should claim it before you do next time :)

Really sorry about that. I will use #dibs next time.


Access Audit Data non-interactively

The page does not talk about accessing audit data in an automated non-interactive way.
Is is possible to access the audit log data (i.e. execute Get-PowerBIActivityEvent) using an Azure Service Principal?
If so, is it possible to grant granular permissions to the service principal - or can/must the Service Principal be set up as a Power BI Service Admin (which isn't very desirable)?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: a0e8bce0-95c1-07f7-d3a3-a1c22bd21f29
Version Independent ID: dddd1e30-4a88-1293-1264-3214cc4b6dc8
Content: Track user activities in Power BI - Power BI
Content Source: powerbi-docs/service-admin-auditing.md
Service: powerbi
Sub-service: powerbi-admin
GitHub Login: @kfollis
Microsoft Alias: kfollis

Thanks for your comment, @cbailiss. We’ve forwarded your feedback to the writer, who should respond to this thread shortly. Thanks!

Thanks for the patience, @cbailiss. You could automate access to audit data by using the REST API or PowerShell. I've added a link to more detail on the Power BI REST API to the article. PowerShell is another option. Also see this article https://docs.microsoft.com/en-us/microsoft-365/compliance/search-the-audit-log-in-security-and-compliance?view=o365-worldwide#requirements-to-search-the-audit-log about the required permissions.  This article also describes how to programmatically download data from the audit log. I will add more details in the next article update, and have added this doc enhancement to an internal backlog.

Hi @kfollis
For reference (and for anyone else seeing this in the future) the approaches recommended here often won't work in practice.  In my organisation and others, Power BI Service Administrators do not have permissions to call the Office 365 APIs/PowerShell CmdLets.
What is needed is a way, as a Power BI Service Administrator, to non-interactively (i.e. as a Service Principal) call the Power BI API or Power BI Audit Log CmdLet (i.e. Get-PowerBIActivityEvent).  I have recently worked through a support call on this and it turns out sadly that currently the Get-PowerBIActivityEvent CmdLet and underlying Rest API method doesn't work with Service Principals.  This seems a strange oversight to me, given a lot of audit log data is captured by automated processes.
This limitation should be made clearer in the documentation - it would have saved me and MS support a lot of time if it was documented.


Gracefully handle super-long linker command lines

This seems to the the same issue as rust-lang/rust#41190, just for this crate instead of rustc.
The linker fails if the command line is too long (32767 characters on windows).
Splitting a library into multiple libraries is currently a workaround.

Seems plausible to me!

I'm going to close this for now since I don't think it's really come up in practice all that much and splitting into multiple libraries should work for the rare cases it does come up.


[BUG] fvm use  --global mode doesn't work.

Describe the bug
It seems that global mode doesn't work. I use fvm in windows git bash.
To Reproduce
Steps to reproduce the behavior:

Run fvm.bat use 1.24.0-10.2.pre
Run fvm.bat use 1.17.1 --global
Run fvm.bat flutter run
The project still runs in 1.17.1, not my global SDK version

As the two pictures show: first, I fvm.bat use 1.24.0-10.2.pre then fvm.bat use 1.17.1 --global, but when I run the app, it prints dart version is 2.12, which means it still on the 1.17(use dart 2.8)
Desktop (please complete the following information):

OS: Windows
FVM Version 1.3.6
If Windows: Which Powershell are you using? git bash

Did you set the global env car path also?

Did you set the global env vat path also?

Yes, I add C:\Users\username\fvm\default\bin to PATH

@bytes-stack One more question for clarification. FVM will prioritize the version configured within the project over the global version. Could you just make sure that .fvm folder is removed from the project when you ran the test?

@bytes-stack One more question for clarification. FVM will prioritize the version configured within the project over the global version. Could you just make sure that .fvm folder is removed from the project when you

@bytes-stack One more question for clarification. FVM will prioritize the version configured within the project over the global version. Could you just make sure that .fvm folder is removed from the project when you ran the test?

@bytes-stack why are you using fvm.bat instead of fvm?

@bytes-stack sorry for the delay on this. I am in the middle of a global refactor 2.0 and will close this since I did not have more info.


New hook: useWindowFocus?

I want to know whether or not a tab is focused by the client.
I am currently using this alternative:
import useWindowFocus from "use-window-focus"

https://www.npmjs.com/package/use-window-focus
https://github.com/jpalumickas/use-window-focus

I think https://github.com/streamich/react-use/blob/master/docs/useIdle.md may help


Follow links

I've started working on this feature "following links" in my local fork a couple of weeks back to get myself a bit familiar with the code base.
I simply added a bit of event handling on every layer to be able to change the current document.
Overall, while my solution does work, it feels (and is) hacky.
Have you thought about this already?

Hello, we tried to solve the issue.
This is what we did:
Add proper link handling to allow navigation between documents when clicking links. This involves changes to the Document, BlitzApplication, and DioxusNativeApplication structs to manage multiple documents and handle navigation events.
You can review changes in this commit: https://github.com/kkpo4553/DioxusLabs-blitz-170/commit/e9092b2a4ef695225fecfa2df08a42fdc1d06813.

[!CAUTION]
Disclaimer: The concept of solution was created by AI and you should never copy paste this code before you check the correctness of generated code. Solution might not be complete, you should use this code as an inspiration only.

If you no longer want Latta AI to attempt solving issues on your repository, you can block this account.

@nerdachse I have. My plan is/was:

Documents default action for links is to generate a new Winit UserEvent BlitzEvent::Navigate(url) or similar.
Shell then receives event and triggers an http request for the new URL
When that returns it does something similar to the reload code in the readme app (creates a new document and then replaces the document in the window with that new document).

To be worked out:

How to handle the transitional/loading state:

Perhaps the new document should be created immediately (blank) and the populated when http request returns?
Perhaps there should be an intermediary "loading" document displaying some static HTML?
Do network requests for the old document need to be cleaned up? (probably get away with not in the short-term)
What happens on failure? (perhaps an "error" document displaying some static HTML?)

Long-term I would like to use "nested documents" (feature not implemented yet) to implement a browser UI using a DioxusDocument with the pages being nested HtmlDocuments. At that point the outer document could handle both the request lifecycle and loading/error UI.
I would be interested to see what you have come up with and if it is similar to the above.

I should add that the other thing we will want for "complete" link following is the ability to click on inline spans. Currently only block elements (including inline-block) are clickable. Some links are block/inline-block, but many are inline and those ones won't currently work. This work needs to happen in Parley.

The other thing we will want for "complete" link following is the ability to click on inline spans. Currently only block elements (including inline-block) are clickable. Some links are block/inline-block, but many are inline and those ones won't currently work. This work needs to happen in Parley.

This has now been implemented. So it's just the actual document loading that needs to be implemented now.

Hey, wow, thanks for taking your time to answer in such a nice and fleshed out fashion!
Well, my idea was rougher, but similar, because it seems natural. It was just a hack, I replaces the whole document "brute force style", because I just wanted to get something useful (for me) going while exploring the codebase.

Adding the Event is easy enough.
Firing it inside document's handle_event method not so much.
Either we make handle_event return an Optional Event (yet another enum?!) or we pass in a way to send the event over the proxy.


Uncaught TypeError: Cannot read property 'activateByEvent' of null

Issue Id: 619968c2-ea7b-3baf-3336-a087bbee098fVersions - 1.22.1-  762a3f68106d03a6d033dfd7a28ae8dee5977842Stack TypeError: Cannot read property 'activateByEvent' of null/vs/workbench/services/extensions/electron-browser/extensionService.ts#423:43 (_activateByEvent)/vs/workbench/services/extensions/electron-browser/extensionService.ts#411:15 (activateByEvent)/vs/workbench/parts/debug/electron-browser/debugConfigurationManager.ts#608:31 (openConfigFile)/vs/workbench/parts/debug/browser/debugActions.ts#114:59 (run)/vs/base/common/actions.ts#226:31 (runAction)/vs/base/common/actions.ts#218:14 (run)/vs/base/browser/ui/actionbar/actionbar.ts#163:21 (onClick)/vs/base/browser/ui/actionbar/actionbar.ts#142:28    at runCallback (timers.js:672:20)    at tryOnImmediate (timers.js:645:5)    at processImmediate [as _immediateCallback] (timers.js:617:5)

Duplicate of #48065


Katana not using system default DNS as resolver

katana version:
v0.0.2
Current Behavior:
When trying to crawl domains not visible on public DNS I noticed none of them is resolving since katana is using <IP_ADDRESS> and <IP_ADDRESS> as DNS instead of the system default DNS configured in '/etc/resolv.conf'
Expected Behavior:
Katana should use the system default DNS or make it configurable.
Steps To Reproduce:

run 'katana -v -u https://internal.only.domain'

Get Error:
"[WRN] Could not request seed URL: GET https://internal.only.domain giving up after 2 attempts: Get "https://internal.only.domain": no address found for host"

Anything else:
2x Tcpdump to confirm wrong DNS is used (while crawling www.google.com) :
While crawling with Katana:
17:24:45.596995 enp3s0 Out IP <IP_ADDRESS>.36548 > <IP_ADDRESS>.53: 10423+ [1au] A? [www.google.com]
17:24:45.623854 enp3s0 In  IP <IP_ADDRESS>.53 > <IP_ADDRESS>.36548: 10423 1/0/1 A <IP_ADDRESS>
17:24:45.623965 enp3s0 Out IP <IP_ADDRESS>.52401 > <IP_ADDRESS>.53: 10423+ [1au] AAAA? [www.google.com]
17:24:45.651882 enp3s0 In  IP <IP_ADDRESS>.53 > <IP_ADDRESS>.52401: 10423 1/0/1 AAAA 2a00:1450:4001:810::2004
17:24:46.597719 enp3s0 Out IP <IP_ADDRESS>.34316 > <IP_ADDRESS>.53: 41084+ [1au] A? [store.google.com]
17:24:46.633427 enp3s0 In  IP <IP_ADDRESS>.53 > <IP_ADDRESS>.34316: 41084 1/0/1 A <IP_ADDRESS>
Querying via ‘host www.google.com’ command  using configured system default DNS (<IP_ADDRESS>):
17:25:33.934629 enp3s0 Out IP <IP_ADDRESS>.50370 > <IP_ADDRESS>.53: 42069+ A? [www.google.com]
17:25:33.950980 enp3s0 In  IP <IP_ADDRESS>.53 > <IP_ADDRESS>.50370: 42069 1/0/0 A <IP_ADDRESS> (48)

Depends on https://github.com/projectdiscovery/retryabledns/issues/86 - This will be automatically fixed upon new retryabledns => fastdialer release

Depends on projectdiscovery/retryabledns#86 - This will be automatically fixed upon new retryabledns => fastdialer release

when katana can fix this bug?
I see katana:v0.0.2 go.mod import the "bug version" retryabledns.
github.com/projectdiscovery/retryabledns v1.0.15

Will u upgrade retryabledns version in the go.mod to fix bug?

@ehsandeep @Mzack9999
Do u confirm it has been fixed?
I test using katana:v0.0.3 docker image, i think it has not been fixed in the container image.


Move MX record to its own subdomain

changelog entry is missing.

Please provide a reason for this change. i can guess but it's not clear to me, sorry. Also, would the letsencrypt certs not need to be adapted for "mx.maildomain"?

One reason is that we can then add proxy VPSs for IMAP+SMTP usage only, but not as MX.


Add OIDC AuthN Handler

Extend the bin crate to add a configurable token check via a tower-layer for OIDC setups.
All endpoints should be protected apart from the initial token exchange (
https://github.com/hansetag/iceberg-rest-server/blob/98abb4c795e497f626c442afb5232ae6d6ad29eb/crates/iceberg-rest-service/src/service/v1/oauth.rs#L21
)
Once https://github.com/hansetag/iceberg-rest-server/issues/23 is implemented, we want to "sync" groups from user tokens to internal groups on GET /config calls. When implementing AuthN, please try and already request users groups or roles. from the /userinfo Endpoint. We should probably add optional Group Filters? Or Audiences? Airflow might serve as a reference.

Fixed by https://github.com/hansetag/iceberg-catalog/pull/89


example quality issue

text_id: [required] 023fc876-6e55-4754-920e-b6b05b6df8e4
source_name: [required] az_books
issue: [required] text has non-azerbaijani text
do you have any solutions regarding to issue: [required] no

salam, sizin dataseti import ederken bele bir problemle qarshilashiram:
AttributeError                            Traceback (most recent call last)
 in <cell line: 10>()
8 # set api for login and save token
9 api=HfApi()
---> 10 api.set_access_token(token)
11 folder = HfFolder()
12 folder.save_token(token)
AttributeError: 'HfApi' object has no attribute 'set_access_token'


FreeCAD.FreeCAD version 1.0.0

Checklist for Pull Requests

[x] Have you signed the Contributor License Agreement?
[x] Is there a linked Issue?

Manifests

[x] Have you checked that there aren't other open pull requests for the same manifest update/change?
[x] This PR only modifies one (1) manifest
[x] Have you validated your manifest locally with winget validate --manifest <path>?

[x] Does your manifest conform to the 1.6 schema?

Note: <path> is the directory's name containing the manifest you're submitting.

Resolves: #192392
Microsoft Reviewers: Open in CodeFlow

Close with reason: Duplicate of #192483;

Hi, just fyi the other one was a duplicate of this repo. This repo has a lower PR number.


Add weight visualization for file_editor

I implemented weight visualization for the saved file format using HTML and CSS. By default, all weights are displayed along the last axis, as I intended to represent the features. However, when the feature size is large, processing can take considerable time. To address this, I added a threshold for the display size of each grid.
here is my gist

Codecov Report
Attention: Patch coverage is 1.47059% with 67 lines in your changes missing coverage. Please review.

Project coverage is 57.50%. Comparing base (577ef63) to head (726c29e).

Files with missing lines
Patch %
Lines

keras/src/saving/file_editor.py
1.47%
67 Missing :warning:

:exclamation:  There is a different number of reports uploaded between BASE (577ef63) and HEAD (726c29e). Click for more details.
HEAD has 6 uploads less than BASE

Flag
BASE (577ef63)
HEAD (726c29e)

keras
4
1

keras-torch
1
0

keras-tensorflow
1
0

keras-jax
1
0

Additional details and impacted files
@@             Coverage Diff             @@
##           master   #20289       +/-   ##
===========================================
- Coverage   78.88%   57.50%   -21.38%
===========================================
  Files         511      511
  Lines       48735    48800       +65
  Branches     8982     8993       +11
===========================================
- Hits        38443    28064    -10379
- Misses       8437    18926    +10489
+ Partials     1855     1810       -45

Flag
Coverage Δ

keras
57.50% <1.47%> (-21.24%)
:arrow_down:

keras-jax
?

keras-numpy
57.50% <1.47%> (-0.08%)
:arrow_down:

keras-tensorflow
?

keras-torch
?

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

I updated code & gist


Set the auth_type for authentications

Set the authentication.auth_type for newly created authentication
records.

Hey @martinpovolny can you confirm if this will set the auth_type correctly in the UI?


Remove version: Hesan.He3 version 2.0.18

[Automated] It returns code over 400 in all urls
Microsoft Reviewers: Open in CodeFlow

This appears to be an infrastructure issue, and we should wait to see if the publisher resolves it before merging this.

162573

URL: https://he3-1309519128.cos.accelerate.myqcloud.com/2.0.18/He3_windows_installer_ia32_2.0.18.exe
Response status code does not indicate success: 400 (Bad Request).
(Automated message - build 886)

Close with reason: PR submitted to change host;


feat(go): add UnsafeCast function

The UnsafeCast function can be used to forcefully convert from one
type of jsii proxy value (including interface{}) to another jsii
interface (i.e: a class or interface instance).
If performs a "clean" cast when possible, and creates a new, aliased
proxy otherwise. It is the user's responsibility to ensure they are
passing the correct arguments into the function.
Fixes https://github.com/aws/jsii/issues/2819

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

In addition it feels like we should add a test case to the compliance suite. wdyt?

Good call. It resulted in discovery of an existing runtime bug (would have been impossible to receive "Object@" references in go, as there was no proxy initializer registered for that), and missing kernel features for this to actually work...


Levana Geoblocked Request is not cached locally [200 USDC Reward!]

🐛 Bug Bounty: Tree Shaking Optimization Needed! 🛠
Reward: 🏆 200 USDC 🏆
We are thrilled to announce a special bug bounty for proficient third-party developers! This is an opportunity to showcase your expertise, make a significant impact, and earn a substantial reward.
Issue Description 📄
Cache Levana Geoblocking Request
Current Behavior ❌
Try refreshing the frontend a few times with the cache enabled. You will see that the levana geoblocked request is not cached, and is remade on every request. This should ideally hit a local cache for the same input country code if you are coming from the same IP.
Expected Behavior 💡
On page refresh from the same IP address, the levana geoblocking request should not be rerun but instead be fetched from the cache
Requirements for the Bounty 🏁
Submit a pull request with a verified solution to optimize tree shaking.
Demonstrate a measurable decrease in the bundle size as a result of your optimization.
Ensure the fix does not introduce any new bugs or vulnerabilities.
Adhere to our project's coding style and contribution guidelines.
Your solution will undergo a thorough review by our team, and the bounty will be awarded upon approval.
How to Claim Your Bounty 💰
Fork our repository.
Create a new branch dedicated to your optimization fix.
Submit a pull request to our main branch with comprehensive details of your optimization strategy and evidence of the reduced bundle size.
Upon review and approval, the 200 USDC will be transferred to your wallet.
Please Note: All bounty claimants must undergo a KYC (Know Your Customer) process with our finance team to receive the reward. This is a mandatory step to ensure compliance with financial regulations.
We eagerly await your innovative solutions and thank you for contributing to the efficiency and performance of our project!

what might be the reason

I'm not sure if this can be really implemented. How would the browser know the current IP? To go by location, you'd need to ask for location permissions, but that is based on the user's consent only.

@UkuLoskit you could use something like https://api.ipify.org?format=json to get it, but this essentially would mean you have to make that call on every page load instead of the call to Levana. It would only be worth it if the call to https://api.ipify.org?format=json was substantially faster than the call to Levana.
@UkuLoskit how about this, could you run some benchmarking between https://api.ipify.org?format=json and the levana geoblock call? If you can demonstrate that it would not result in a speed increase to make the change, I'll still pay the bounty

Very simple benchmark:
for i in $(seq 1 10); do curl -o /dev/null -s -w 'Total: %{time_total}s\n' "https://geoblocked.levana.finance/"; done
Total: 0.222422s
Total: 0.284780s
Total: 0.274545s
Total: 0.239662s
Total: 0.229956s
Total: 0.288214s
Total: 0.277087s
Total: 0.274759s
Total: 0.242830s
Total: 0.287495s


Specs Guidelines and adding new specs repositories

In each of the lines to set the compiler in the guidelines for writing specs, there is an opening single quote, but no closing single quote, even though the closing quote is necessary.
compilers:
  - &cpp 'g++ --std=c++11 $@ -o<EMAIL_ADDRESS>
files:
  - file: options.cpp
    commands: *cpp

Additionally, how does one get new specs repositories made (for new courses), or get access to update specs for the courses we are teaching (as we might change assignments)?

Thanks for catching that.
The spec repositories can be created by Hawken or myself, and we can give write access to anyone who needs it. What courses do you need?

We need a new repository for CS2, which is cs221.  I would need write access to that, HD (241), and OS (273) for next semester.

@ejensenVT I've invited you to this organization. I will now create those repos for you…


⚠ Bofrost.be has degraded performance

In 954c9c6, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 1881 ms

Resolved: Bofrost.be performance has improved in 4e87756 after 16 minutes.


remove unused _destroy/postblitRecurse for static arrays

Unfortunately we cannot do this, because _postblitRecurse is actually used in the std.conv.emplace implementation...

I didn't knew one could emplace into a static array.


[ERROR] no 'services' definition in configuration file

Is this a request for help?: YES

Is this a BUG REPORT or a FEATURE REQUEST? (choose one): BUG REPORT
Version of Anchore Engine and Anchore CLI if applicable:
Anchore Engine 0.3.2
Helm chart 0.11.0
What happened:
I get the following error in all pods:
[MainThread] [anchore_engine.configuration.localconfig/validate_config()] [ERROR] no 'services' definition in configuration file
[MainThread] [anchore_manager.cli.service/start()] [ERROR] Error: cannot load local configuration: invalid configuration: details - no 'services' definition in configuration file

What did you expect to happen:
I expect the pod to run correctly
Any relevant log output from /var/log/anchore:
No such log in the pod.
However...
Anchore engine is deployed through Helm with minimal values.yaml to define the admin pass and email, and the postgresql endpoint because I'm using an RDS. Here is the values.yaml used for Helm deployment (secret values replaced by XXXXXXXXXXXXXXX):
# FROM https://github.com/helm/charts/blob/master/stable/anchore-engine/values.yaml

anchoreGlobal:

  # Sets the password & email address for the default anchore-engine admin user.
  defaultAdminPassword: XXXXXXXXXXXXXXX
  defaultAdminEmail: XXXXXXXXXXXXXXX

#  ingress:
#    enabled: true
#    annotations:
#      nginx.ingress.kubernetes.io/force-ssl-redirect: "true"
#      nginx.ingress.kubernetes.io/rewrite-target: /
#      kubernetes.io/ingress.allow-http: "false"
#      kubernetes.io/ingress.class: nginx
#      # kubernetes.io/tls-acme: true
#    tls:
#    # Secrets must be manually created in the namespace.
#    #  - secretName: chart-example-tls
#       - hosts:
#          - anchore.k8s-prd.cloud.620nm.net

postgresql:
  # To use an external DB, uncomment & set 'enabled: false'
  # externalEndpoint, postgresUser, postgresPassword & postgresDatabase are required values for external postgres
  enabled: false
  postgresUser: anchoreengine
  postgresPassword: XXXXXXXXXXXXXXX
  postgresDatabase: anchore
  # Specify an external (already existing) postgres deployment for use.
  # Set to the host and port. eg. mypostgres.myserver.io:5432
  externalEndpoint: XXXXXXXXXXXXXXX:5432

The generated configmap is this one:
11:50 $ kubectl describe cm anchore-anchore-engine
Name:         anchore-anchore-engine
Namespace:    anchore
Labels:       app=anchore-anchore-engine
              chart=anchore-engine-0.11.0
              heritage=Tiller
              release=anchore
Annotations:  <none>

Data
====
ANCHORE_DB_HOST:
----
XXXXXXXXXXXXXXX:5432
ANCHORE_DB_NAME:
----
anchore
ANCHORE_DB_USER:
----
anchoreengine
config.yaml:
----
# Anchore Service Configuration File from ConfigMap

service_dir: /anchore_service_config
tmp_dir: /scratch
log_level: INFO
cleanup_images:

allow_awsecr_iam_auto: false
host_id: "${ANCHORE_POD_NAME}"
internal_ssl_verify: false
auto_restart_services: false

metrics:
  enabled: false

# Uncomment if you have a local endpoint that can accept
# notifications from the anchore-engine, as configured below
#

# Configure what feeds to sync. The 'admin' anchoreIO credentials are used if present, but not required.
# The 'anonymous' user is used for the sync otherwise.
# The sync will hit http://ancho.re/feeds, if any outbound firewall config needs to be set in your environment.
feeds:
  sync_enabled: true
  selective_sync:
    # If enabled only sync specific feeds instead of all that are found.
    enabled: true
    feeds:
      # Vulnerabilities feed is the feed for distro cve sources (redhat, debian, ubuntu, oracle, alpine....)
      vulnerabilities: true
      # NVD Data is used for non-distro CVEs (jars, npm, etc) that are not packaged and released by distros as rpms, debs, etc
      nvd: true
      # Warning: enabling the package sync causes the service to require much
      #   more memory to do process the significant data volume. We recommend at least 4GB available for the container
      packages: false
      # Enabling snyk syncs snyk vulnerability data from an on-premise anchore enterprise feeds service. Please contact
      # anchore support for finding out more about this service
      snyk: false
  client_url: "https://ancho.re/v1/account/users"
  token_url: "https://ancho.re/oauth/token"
  anonymous_user_username<EMAIL_ADDRESS>  anonymous_user_password: XXXXXXXXXXXXXXX
  connection_timeout_seconds: 3
  read_timeout_seconds: 60

default_admin_password: ${ANCHORE_ADMIN_PASSWORD}
default_admin_email: XXXXXXXXXXXXXXX

credentials:
  database:
    db_connect: "postgresql+pg8000://${ANCHORE_DB_USER}:${ANCHORE_DB_PASSWORD}@${ANCHORE_DB_HOST}/${ANCHORE_DB_NAME}"
    db_connect_args:
      timeout: 120
      ssl: false
    db_pool_size: 30
    db_pool_max_overflow: 30

services:
  apiext:
    enabled: true
    require_auth: true
    endpoint_hostname: anchore-anchore-engine-api
    listen: <IP_ADDRESS>
    port: 8228
    ssl_enable: false
    ssl_cert: "/certs/tls.crt"
    ssl_key: "/certs/tls.key"
  analyzer:
    enabled: true
    require_auth: true
    endpoint_hostname: anchore-anchore-engine-analyzer
    listen: <IP_ADDRESS>
    port: 8084
    cycle_timer_seconds: 1
    cycle_timers:
      image_analyzer: 5

    max_threads: 1
    analyzer_driver: 'nodocker'
    ssl_cert: "/certs/tls.crt"
    ssl_key: "/certs/tls.key"
    ssl_enable: false
  catalog:
    enabled: true
    require_auth: true
    endpoint_hostname: anchore-anchore-engine-catalog
    listen: <IP_ADDRESS>
    port: 8082
    cycle_timer_seconds: 1
    cycle_timers:
      analyzer_queue: 1
      image_watcher: 3600
      notifications: 30
      policy_eval: 3600
      repo_watcher: 60
      service_watcher: 15
      vulnerability_scan: 14400

    ssl_enable: false
    ssl_cert: "/certs/tls.crt"
    ssl_key: "/certs/tls.key"
    event_log:
      notification:
        enabled: true
        level:
        - error

    archive:
      compression:
        enabled: true
        min_size_kbytes: 100
      storage_driver:
        config: {}
        name: db

  simplequeue:
    enabled: true
    require_auth: true
    endpoint_hostname: anchore-anchore-engine-simplequeue
    listen: <IP_ADDRESS>
    port: 8083
    ssl_enable: false
    ssl_cert: "/certs/tls.crt"
    ssl_key: "/certs/tls.key"
  policy_engine:
    enabled: true
    require_auth: true
    endpoint_hostname: anchore-anchore-engine-policy
    listen: <IP_ADDRESS>
    port: 8087
    cycle_timer_seconds: 1
    cycle_timers:
      feed_sync: 14400
      feed_sync_checker: 3600

    ssl_cert: "/certs/tls.crt"
    ssl_key: "/certs/tls.key"
    ssl_enable: false
Events:  <none>

Looks like to me that services exist in the configuration file.
I connected to the pods, and checked that /config/config.yaml file content is the same as the config map, and the file exists, and the content is the same.
So I don't know why this error happens, message looks like to be incoherent with configuration.

hi @Karreg - I believe that we had moved past this issue but wanted to double check status here - let us know!
The code that raises this exception is pretty specific to a check for the 'services' section of the loaded configuration, so it is indeed an odd condition as described.  Please let us know if this is still an issue you're encountering, and we'll work with you to investigate/resolve.

Closing due to no activity. It was resolved via slack I believe.

Yes, after a very, very long analysis on our side, the issue was a failing k8s cluster.
The error message was a bit misleading at first, but it made sense.
The service data were effectively present on the cluster, but the mount point was not made on the node, and thus in the pod, for it to be able to read the configuration.
That explains both why the configuration was correct on the cluster, but the pod could not read it...


Digital Globe stereo images not containing XML per image

I have been trying to process Digital Globe stereo images using this tool but we encountered some problems. We have a TIF and RPB file for each image tile (R1C1, R1C2, etc) but no XML file, only one XML file for the entire image.
This resulted in problems when trying to do stereo -t dg (-t rpc does seem to work), I get the following error (which I think is caused by no XML files for the tile being present):
terminate called after throwing an instance of 'xercesc_3_1::SAXParseException'
Also when trying to combine the tiles using dg_mosaic according to the example in the documentation:
> dg_mosaic 12FEB12053305*TIF --output-prefix 12FEB12053305 --reduce-percent 50 (page 20) does not work because of missing XML files.
Error:
Traceback (most recent call last):
  File "/home/ubuntu/StereoPipeline-2.6.1-2018-09-06-x86_64-Linux/libexec/dg_mosaic", line 1081, in <module>
    sys.exit(main())
  File "/home/ubuntu/StereoPipeline-2.6.1-2018-09-06-x86_64-Linux/libexec/dg_mosaic", line 741, in main
    = read_xml( xml_name(args[0]), options, xml_keys)
  File "/home/ubuntu/StereoPipeline-2.6.1-2018-09-06-x86_64-Linux/libexec/dg_mosaic", line 524, in xml_name
    + xml_file_l + ' ' + xml_file_u)
Exception: ('InputError', 'Cannot find any of: ....xml, ...xml, etc')

The XML for the entire image does contain some information for each tile it seems, is there a way in which we could use this information instead?
It contains the following XML tags for each tile:
		<TILE>
	<FILENAME><ULCOLOFFSET><ULROWOFFSET><URCOLOFFSET><URROWOFFSET><LRCOLOFFSET><LRROWOFFSET><LLCOLOFFSET><LLROWOFFSET><ULLON><ULLAT><URLON><URLAT><LRLON<LRLAT><LLLON><LLLAT><ULX><ULY><URX><URY><LRX><LRY><LLX><LLY>
		</TILE>

Those tools do need the original linescan model in the xml file which you are lacking. So all you can do is use -t rpc and not use dg_mosaic.
I would also check if what you have is raw images rather than orthorectified and georeferenced images, as then the tools won't work either, because orthorectification loses information.

Thank you very much for the quick response, very helpful.
We did check and the images are not orthorectified and we do get results using --t rpc (but they are just not as accurate).
We will request the XML linescan model files from DigitalGlobe.

DigitalGlobe is not aware of any XML line scan model that they can send us and we are also not very clear what information this file includes. Could you give us some more information on what a line scan model is or maybe some pointers on where we can find more about this? Does every stereo image pair usually include these files?

Interesting. As I know, Digital Globe has multiple levels of products, from the most raw to derived. The most raw could be called level 0, maybe. That is the one we need. It should have in the XML file lines like:
TLCTIME, EPHEMLIST, ATTLISTList.
In human language, we need their XML files that record the attitude and ephemeris for each image line in their images. And we need the images before they are orthorectified. Later all they lump all that into a single black box model but that is not usable by us.

Thanks again, this is very helpful for our understanding.
The image was taken with the WorldView 3 satellite, is possible that this satellite doesn't collect this line scan information on attitude and ephemeris?

Update: we got some more information from DigitalGlobe. Apparently, this information should be in ephemeris files which are only delivered with processing level 1B (we ordered OR2A) and this processing level is only available when you order the whole image (and not a specific AOI as we did).
According to DigitalGlobe "There is no loss of quality or accuracy using the RFM model (using RPC provided with OR2A level) to generate a DSM compared to a rigorous modeling using the ephemeris. It’s rather a point about software interoperability."

Yeah, that makes sense. I guess you can use the RPC model. You can study the IntersectionError file if you call point2dem with the --errorimage flag to see if there are any systematic errors due to cameras. Our bundle_adjust tool can be used to improve the consistency of cameras and then pc_align can align your resulting DEMs to the ground truth. Or you can order the whole image. That won't be cheap, if you have to purchase them.

Yeah, you always want to order L1B stereo if DEM generation is your objective.  The OR2A products don't really add much, and you can always generate something equivalent using a simple mapproject command with --datum-offset flag.
Not sure if this is still the case, but in the past ASP had trouble with the OR2A products.  This was related to the fact that "Ortho Ready Standard Imagery is projected to a constant base elevation, which is calculated on the average terrain elevation per order polygon or can be supplied by the customer".  So they've already warped the two images to the same surface, which is comparable to the transformation in stereo_pprc or the mapproject approach.
But maybe ASP can properly parse and use RPCs from OR2A products at this point. In theory, if we know this average terrain elevation (should be somewhere in metadata), ASP could take this into account and skip initial transform.  Alternatively, we could undo their projection, although that would degrade image quality.
In the past, I've advised people in this situation to request that DG deliver the lower-level L1B products instead of the higher-level OR2A products.

Ah, so it is projected images. Likely we can't handle it properly even now. Maybe in the future if we know what the value of the "constant base elevation" is, we could do it. So one indeed may have to get the original data.

Hi all,
I know this is an old thread, but I too am having a similar issue. Only the L2A product was delivered on the WV order for a small clipped study area, and these are producing subpar results since I'm unable to use the mapproject tool to project the images onto a preliminary DEM. It's unfortunate that the L1B data are only available for full scenes, since these can be prohibitively expensive compared to clips for a given study area. I note that the product *.XML does contain the map projection information:
<MAP_PROJECTED_PRODUCT>
	<EARLIESTACQTIME>2017-01-24T17:46:04.245314Z</EARLIESTACQTIME>
	<LATESTACQTIME>2017-01-24T17:46:04.245314Z</LATESTACQTIME>
	<DATUMNAME>WE</DATUMNAME>
	<SEMIMAJORAXIS>6.378137000000000e+06</SEMIMAJORAXIS>
	<INVERSEFLATTENING>2.982572235630000e+02</INVERSEFLATTENING>
	<DATUMOFFSETList>
		<DATUMOFFSET>0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00</DATUMOFFSET>
	</DATUMOFFSETList>
	<MAPPROJNAME>UTM</MAPPROJNAME>
	<MAPPROJCODE>1</MAPPROJCODE>
	<MAPZONE>19</MAPZONE>
	<MAPHEMI>S</MAPHEMI>
	<MAPPROJPARAMList>
		<MAPPROJPARAM>0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00</MAPPROJPARAM>
	</MAPPROJPARAMList>
	<PRODUCTUNITS>M</PRODUCTUNITS>
	<ORIGINX>7.691727500957000e+05</ORIGINX>
	<ORIGINY>7.218743750003340e+06</ORIGINY>
	<ORIENTATIONANGLE>0.000000000000000e+00</ORIENTATIONANGLE>
	<COLSPACING>5.000000000000000e-01</COLSPACING>
	<ROWSPACING>5.000000000000000e-01</ROWSPACING>
	<PRODUCTGSD>5.000000000000000e-01</PRODUCTGSD>
	<ULX>7.691727500957000e+05</ULX>
	<ULY>7.218743750003340e+06</ULY>
	<ULH>3.761570000000000e+03</ULH>
	<URX>7.761182501143800e+05</URX>
	<URY>7.218743750003630e+06</URY>
	<URH>3.761570000000000e+03</URH>
	<LRX>7.761182501155300e+05</LRX>
	<LRY>7.208948250003610e+06</LRY>
	<LRH>3.761570000000000e+03</LRH>
	<LLX>7.691727500966700e+05</LLX>
	<LLY>7.208948250003320e+06</LLY>
	<LLH>3.761570000000000e+03</LLH>
	<DEMCORRECTION>Base Elevation</DEMCORRECTION>
	<TERRAINHAE>3.761570000000000e+03</TERRAINHAE>
	<NUMGCP>0</NUMGCP>
</MAP_PROJECTED_PRODUCT>

Including the TERRAINHAE factor, which you suggest may be used to skip the initial transform. I wonder if a hacky solution exists...
Best,
Ben

If all you have, it will be impossible to do stereo from this. At the
minimum, original camera models would be needed. Then one could run stereo
with your two mapprojected, clips, the cameras, and provide ASP with a DEM
so it does not complain. The results would then be inaccurate but
plausible.
As it is, really, what you have is two ground textures, and we don't know
where the spacecraft which made them was. It is not possible to create
stereo from this, unfortunately.
I guess the DG folks aren't fools, charging a lot more for stuff which
actually can be used.
On Fri, Nov 5, 2021 at 1:37 AM Ben Purinton @.***>
wrote:

Hi all,
I know this is an old thread, but I too am having a similar issue. Only
the L2A product was delivered on the WV order for a small clipped study
area, and these are producing subpar results since I'm unable to use the
mapproject tool to project the images onto a preliminary DEM. It's
unfortunate that the L1B data are only available for full scenes, since
these can be prohibitively expensive compared to clips for a given study
area. I note that the product *.XML does contain the map projection
information:
<MAP_PROJECTED_PRODUCT>
2017-01-24T17:46:04.245314Z
2017-01-24T17:46:04.245314Z
WE
6.378137000000000e+06
2.982572235630000e+02

0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00

UTM
1
19
S

0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00 0.000000000000000e+00

M
7.691727500957000e+05
7.218743750003340e+06
0.000000000000000e+00
5.000000000000000e-01
5.000000000000000e-01
5.000000000000000e-01
7.691727500957000e+05
7.218743750003340e+06
3.761570000000000e+03
7.761182501143800e+05
7.218743750003630e+06
3.761570000000000e+03
7.761182501155300e+05
7.208948250003610e+06
3.761570000000000e+03
7.691727500966700e+05
7.208948250003320e+06
3.761570000000000e+03
Base Elevation
3.761570000000000e+03
0
</MAP_PROJECTED_PRODUCT>
Including the TERRAINHAE factor, which you suggest may be used to skip
the initial transform. I wonder if a hacky solution exists...
Best,
Ben
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/NeoGeographyToolkit/StereoPipeline/issues/259#issuecomment-961714069,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAKDU3HBX6IIMLA7YWT7TATUKOJUNANCNFSM4HLQETYQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

Yeah, I figured things won't get much better than this:

Cool that Ames still works on the processed images in any case, but not resulting in the quality we were expecting / hoping for. C'est la vie. My SPOT6 tri-stereo for the area is producing beautiful (albeit lower-res) results. Now just need to write some grants to get full L1B WV strips...

Hi all, I'm in this situation too. I started out with them in Agisoft Metashape, then tried ASP and got bad results in both. DG claim the .STE file gives you the satellite locations for the stereo pair. Perhaps there is a way of including this? I have come across this paper which produced DEMs from WV3 OR2A imagery ([https://www.researchgate.net/profile/Fran-Domazetovic/publication/341485924_Assessing_the_Vertical_Accuracy_of_Worldview-3_Stereo-extracted_Digital_Surface_Model_over_Olive_Groves/links/5ed0abc445851529451b759b/Assessing-the-Vertical-Accuracy-of-Worldview-3-Stereo-extracted-Digital-Surface-Model-over-Olive-Groves.pdf])
Pg 52 in this document explains the .STE file format [(https://dg-cms-uploads-production.s3.amazonaws.com/uploads/document/file/106/ISD_External.pdf)] I've dropped a picture from that doc here:

Here's an example .STE file for one stereo pair
numPair = 1; BEGIN_GROUP = STEREO_PAIR_1 	firstId = "21JUL22060840-P2AS-014162243010_01_P001.TIF"; 	secondId = "21JUL22060932-P2AS-014162243010_01_P001.TIF"; 	overlap =  0.981; 	ULLat = 39.282452; 	ULLon = 70.763458; 	LRLat = 39.153003; 	LRLon = 70.917919; 	B_Conv =  34.80; 	E_Conv =  35.03; 	B_Asym =   8.00; 	E_Asym =   7.94; 	B_BIE =  79.98; 	E_BIE =  80.22; END_GROUP = STEREO_PAIR_1 END;


Implement Menu and Select

[x] menu

[x] groups
[x] mode radio
[x] mode check
[x] mode radio-check
[ ] keyboard search
[ ] tests

[x] select

[x] groups
[x] mode radio
[x] mode check
[x] mode radio-check
[x] close on <Esc>
[ ] keyboard search
[ ] tests


Allow writing old version (<v0.7) of anndata?

Would you consider adding an option in AnnData.write() that allows saving as an old version (<v0.7) of h5ad file? There are still plenty of code relying on old version of scanpy/anndata around that cannot read v07.x h5ad. Happy to learn other workaround if you could kindly suggest. Many thanks!

What do you mean “relying on old versions”? AFAIK we didn’t have much backwards compat breaking. Most code should work with the newest versions just fine. What exactly keeps you from updating?

For example, code relying on uns['neighbors'].
The frequent scenario is that a large chunk of the data is already analysed on a relatively old stack of programmes and then there comes some extra data in new anndata format that needs reprocessing and integration. Naturally one would hope there exists some convenient way of converting the new format to the old so that the extra data can be processed using the old software stack to maintain consistency.

I mean, we’re trying to keep the API and analysis results backwards compatible. So I’d recommend to dockerize your old stack to be fully reproducible, then upgrade and continue analysis with the newest everything. Am I missing some reason why that’s not possible?

We have code that extended anndata's slot system, e.g. having multiple KNN graphs saved under uns by the name of, say, 'neighbors_A', 'neighbors_B', 'neighbors_C' with one of them being the set as active ('neighbors') at any point, and we have complex pipelines that relying on this feature for parameter exploration. Of course, obsp now provides a framework for doing that, but we don't want to migrate just yet. I almost started to implement a simple write_legacy_h5ad() function but just wanted to see if there is interest in having this feature in the anndata API. If not, than I am happy to use an ad hoc function. No worries.

If it fits well into our API, it would be great to have:

Adding a as_version keyword argument to write_h5ad is the smallest problem.
EncodingVersions currently tracks the current version. We’d need to extend this system to know about the past versions (including the unencoded version before obsp, that therefore has to be inferred)
we shouldn’t clutter up the h5ad module too much, so it probably has to be split up. @ivirshup has a plan for that module and should know!

I'm not sure we can write pre 0.7 versions of anndata objects easily. This is something we can consider moving forward, but I think writing old versions could be more complicated than just reading old versions.
That said, if you're storing the "neighbors" dicts under keys other than "neighbors", I don't think any modification should happen on writing. Could you expand a bit more on where you're running into issues?

 Example: no modifications
import scanpy as sc
pbmc = sc.datasets.pbmc68k_reduced()

pbmc.uns["neighbors_a"] = pbmc.uns["neighbors"].copy()
pbmc.uns["neighbors_a"]["connectivities"] = pbmc.obsp["connectivities"]
pbmc.uns["neighbors_a"]["distances"] = pbmc.obsp["distances"]

pbmc.write("tmp.h5ad")

from_disk = sc.read_h5ad("tmp.h5ad")
from_disk.uns["neighbors_a"]
# {'connectivities': <700x700 sparse matrix of type '<class 'numpy.float64'>'
#  	with 9992 stored elements in Compressed Sparse Row format>,
#  'distances': <700x700 sparse matrix of type '<class 'numpy.float64'>'
#  	with 6300 stored elements in Compressed Sparse Row format>,
#  'params': {'method': 'umap', 'n_neighbors': array([10])}}

Thanks for your reply. You are right, it looks like different neighbors keys under uns can be correctly handled by scanpy 1.5.x. We are now migrating to scanpy 1.5.x anndata 0.7.x (which requires quite a bit of modification to our existing code), but still there are reasons we want to keep running older version of scanpy/anndata in parallel, at least for a while. Anyway, what we care is to extract the "essential" slots from v0.7.x anndata, X, obs, var, and optionally obsm, into older version of scanpy/anndata for data integration and visualisation. I guess we can implement that outside the current version of anndata. Thank you for looking into this.

which requires quite a bit of modification to our existing code

I'd be interested to know more about this, since we'd like upgrading to be painless. It'd be good to know where our blind spots are.

Thank you for looking into this.

No problem!

I've run into the issue that Seurat 3 will load the older version of h5ad files saved with anndata < 0.7, but it will not read new h5ad files saved with anndata >=0.7
It would be so great to be able to save in the old format to maintain easier interoperability between scanpy and Seurat.  SeuratDisk tries to solve this issue, but it only works with certain very new versions of Seurat, etc.  It would be easier for me if I could save an h5ad in the older anndata < 0.7 format!

Or... if a change was made to allow anndata 0.7+ to write an h5ad file that Seurat 3.0.2 can load automatically.  (I care about Seurat 3.0.2 because, after that version, Seurat no longer works in a Jupyter notebook...)

4 years later I am somewhat confident that people aren't interested in writing anndata < 0.7 anymore. If so, please comment again and we can reopen the issue.


I can help translate into Czech

Please help translate: czech
locale code: cz
locale code table
files Required translation:

def/cz/about.cson
def/cz/context.cson
def/cz/menu_darwin.cson
def/cz/menu_linux.cson
def/cz/menu_win32.cson
def/cz/settings.cson
def/cz/welcome.cson

for more info please checkout CONTRIBUTING.md

@Heroyt thanks for your feedback to make atom-i18n better 💯

Hello,
I (Galastea company) will finish the translation into Czech language. :-)

@Kattnienika Thank you! Really looking forward to it!


[Feature Request] Items fading instead of blinking in and out?

Hey there!
This mod is awesome! I really find this useful, especially as someone with obsessive-compulsive disorder!
I just had a quick feature request about the visual appearance of items when they're despawning. Could players be given the option to enable a smoother animation - one which shows the items fading in and out, which gets faster and faster as the item's despawn timer approaches its limit?
I'm not sure whether this would even be possible, but I thought I'd suggest it just in case!
Thanks so much for all your hard work :) <3

I was thinking the same thing, it's kinda weird to have them blink out of existence every few seconds

That would be great, although this mod seems to just skip rendering the item for a few frames in order for it to blink. A complete other approach would be needed for fading in and out to work.


Do not raise error if audio file has no extension

This PR enables support for audio no-script datasets on the Hub: audio files downloaded from the Hub have no extension, e.g. the audio column embedded in the Parquet file contains:
{'bytes': b'RIFF\x86Y\x0c\x00WAVEfmt \x10...',
 'path': '1b607f504e9c4489e199198847691e2b6b60d99ef50614becb059ac71c22d737'}

Currently we are raising RowsPostProcessingError:
Traceback (most recent call last):
 File \"/src/services/worker/src/worker/job_runners/split/first_rows_from_parquet.py, line 137, in compute_first_rows_response
   transformed_rows = transform_rows(
 File \"/src/services/worker/src/worker/job_runners/split/first_rows_from_parquet.py, line 42, in transform_rows
   return [
 File \"/src/services/worker/src/worker/job_runners/split/first_rows_from_parquet.py, line 43, in <listcomp>
   {
 File \"/src/services/worker/src/worker/job_runners/split/first_rows_from_parquet.py, line 44, in <dictcomp>
   featureName: get_cell_value(
 File \"/src/libs/libcommon/src/libcommon/viewer_utils/features.py, line 203, in get_cell_value
   return audio(
 File \"/src/libs/libcommon/src/libcommon/viewer_utils/features.py, line 126, in audio
   raise ValueError(
ValueError: An audio sample should have a 'path' with a valid extension but got ''.

Fix #2096.

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (956c4f0) 90.32% compared to head (ecb0c46) 88.41%.
Report is 4 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2180      +/-   ##
==========================================
- Coverage   90.32%   88.41%   -1.91%
==========================================
  Files         265       98     -167
  Lines       16231     3195   -13036
==========================================
- Hits        14661     2825   -11836
+ Misses       1570      370    -1200

Flag
Coverage Δ

jobs_cache_maintenance
95.33% <ø> (ø)

jobs_mongodb_migration
86.69% <ø> (ø)

libs_libapi
?

libs_libcommon
?

services_admin
86.56% <ø> (ø)

services_api
?

services_rows
81.61% <ø> (ø)

services_search
?

services_sse-api
94.21% <ø> (ø)

services_worker
?

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

Thanks for your review, @lhoestq.
I understand your concern raised, but note that:

audio files with extension are not impacted
audio files without extension are currently not supported (we are raising an error); this PR enables supporting them.

I agree the performance optimization for audio files without extension could be addressed in a subsequent PR.

Follow-up issue:

#2181


 The alarms are to be reported using a multi-callback.
Add alarm generation in the simulator.
Add a test that checks the alarms coming from a simulator.
Add a standalone app that works as a standalone alarm monitor, dumping the received alarms to the console.

Added in f0569d9a951d26be47c726a5c55caa48ba72348a


Run lighthouse on pull request against Fleek deployment

Issue #1041

add Fleek deploy to main.yml
wait for Fleek deploy before running lighthouse on the site
update lighthouserc.yml to use remote Fleek site instead of staticDistDir

Reason for adding Fleek deployment to GitHub workflow action:
in order to run the Lighthouse tests on external (=not from local dir) site, we need to wait until this site is live.
With the current Fleek setup as configured in the repo, I didn't find a way to get the status and URL of the site deployment in the GitHub workflow.
Watch out for
If we're migrating how we deploy, make sure the new way is configured correctly and the output of the deployment scripts are the same.

This implements #1438
I believe the Fleek deployment is manually configured, so some care will be needed to ensure that they don't conflict and/or the manual configuration is removed.

@ohmygirth @0xJem hi 🙋🏽♂
Can you help unblock this? (Sorry if not relevant to you, not sure yet who to ping :)

Checking

deploy issues still ongoing, discussion here: https://discord.com/channels/838651642190495804/943185441979506708


Can the modal be without dimmer effect?

When show modal frequently, e.g. do a batch job with a lot of confirmations, the dimmer effect is better to be off, so that there will be not so much changing on the screen, and the eyes will not be less tired.
Is there any way now?
Thanks in advance.

Yeah, you can specify dimmer opacity: 0 in css, or use dimmerSettings: { opacity: 0; } in modal init


fix: show completion modal for labs

Checklist:

[x] I have read and followed the contribution guidelines.
[x] I have read and followed the how to open a pull request guide.
[x] My pull request targets the main branch of freeCodeCamp.
[x] I have tested these changes either locally on my machine, or GitPod.

This is a quick fix so that the completion modal shows when a learner completes a lab via the hotkeys.
It has a side-effect that it changes the revert to saved code button into reset this code, but it doesn't change the functionality. I'll put together a followup PR to sort that out.

It has a side-effect that it changes the revert to saved code button into reset this code, but it doesn't change the functionality

Is it the other way around? @ojeytonwilliams Because I see Revert to Saved Code. Also it does what it says. Not sure if I understood.

@Dario-DC this stuff is confusing, so I probably haven't got it straight in my head yet. My understanding is that the labs should reset rather than revert https://github.com/freeCodeCamp/freeCodeCamp/issues/57436
i.e. they should go back to the seed contents, rather than the saved contents.


Retrieve Credentials for Automatic Sign In & Smart Lock

Is there any method in AuthUI that will allow me to request saved credentials for automatic Sign In or do I have to build it myself.
My flow is:
Splash Screen: If user is logged in already, opens the Main Activity, else will Sign In 'Anonymous' and then open the Main Activity, in the Main Activity the user may choose to sign in or not. The AuthUI Sign In happens in Main Activity, so if the user chooses to Sign Out, next time another Anonymous user will be created, I have already worked out the account upgrade and anonymous user deletion.
So what I'd like to do is in the Splash Activity, check if is Signed In already if not, check if it has saved credentials and Sign In or request to choose an account if there is no credentials just sign in Anonymously.
What would be my best approach in this matter or is there a way to do it with AuthUI already, that I have missed?
Best Regards
Ne0R@Cu

Are you looking for something like this? It sounds very close to what you're trying to do.

@SUPERCILEX Yep, I have been following that thread, I'm eager for the release and to know how is it going to work. I started writing code to retrieve the credentials last week, but I was getting too many warnings "This method call is internal and not meant to be call by the app..." and then read that 12.0.0 had some bugs and to wait for 12.0.1.
Since my sign in flow starts as anonymous in the splash screen I just wonder if there will be methods to make it easier on my own(something to check for saved credentials and signin with them), or I'll have to write it myself.
You've already made it prettry easy.

Have you seen the docs? They describe exactly what you're looking for. If you want, I can also provide a dependency with that PR already merged...

I was following exactly that when I was writing my code, but the amount of warnings turn me down, now with 12.0.1 I'll try again.
I opened this hopping that you might include something like AuthUI.getInstance().getSavedCredentials(). You already done the whole job, I know, since I'm using a Splash Screen to login anonymously and AuthUI in the Main Activity the sign in flow is a bit differen from most apps.
I think I'll wait for 3.4.0 to see how to work it out.
@SUPERCILEX
Best Regards


Introduce new metadata provider initialize method

Why make this change?
GraphQL engine supports multi-tenancy (handles call for different tenants/artifacts in the same process). In Graphql workload, we are using dab as a nuget and every time we get a query request from a tenant, we use the config file of that tenant to set up the dab classes to respond to that particular request.
In each request we call metadataprovider.initializeAsync() which is an expensive call and adds overhead in graphql workload for query execution.
What is this change?
This code adds a new initialize method which takes in the necessary objects which are required for query execution. GraphQL workload will now call this new method in its query flow.
We also have added different converters to serialize and deserialize the different objects that get set, as Graphql workload will be storing these values in serialized format on its end.
Use of System.Text.Json serializer and deserializer
I am using System.Text.Json serializer- deserializer as compared to NewtonSoft, as System.Text.Json focuses primarily on performance, security and standards compliance. Migrate from Newtonsoft.Json to System.Text.Json
System.Text.Json doesnot support TypeNameHandling.All, that helps in handling abstract classes and its objects serialization and deserialization. Adding TypeName property on DatabaseObject level to differentiate different types of DatabaseObject as Dictionary EntityToDatabaseObject consists of different DatabaseObject objects : DatabaseTable, DatabaseView etc and eventually we need to deserialize into DatabaseObject.
System.Test.Json does not support direct serialization and deserialization of System.Type, one needs to add a customer converter to support this. Currently DatabaseObject contains SourceDefinition which contains ColumnDefinition, ColumnDefinition has property of type System.Type hence need added TypeConveter to explicitly handle serialization and deserialization.

https://github.com/dotnet/runtime/blob/main/src/libraries/System.Text.Json/docs/ThreatModel.md#mitigation-3
Similarly for object type - ColumnDefinition property Default Value I had to explicitly create an converter. Lets say there is a default value of type string is set of an column: firstname. The default value set is John. If I do not add an explicit deserialization then instead of "('John')" in original EntityDatabaseObject the deserialized value was looking as ValueKind = String : "('John')" which threw exeception.
How did I solve my initial infinite loop issue?
I was passing wrong element in line "DatabaseObject)JsonSerializer.Deserialize(document, concreteType, options)!;" of converter. I was passing root. Hence on correcting the object being passed it solved the infinite loop. My earlier issues discussed in first run, were not due to lack of converter, but were related to not correct object being passed, some properties on the Database have private set, hence during deserialization they were not getting set.( solution add : JsonInclude tag on property, https://learn.microsoft.com/en-us/dotnet/api/system.text.json.serialization.jsonincludeattribute?view=net-8.0)
How was this tested?

Unit Tests
manually running local instance of DAB :

include in your pr description what you identified to help you use system.text.json over newtonsoft.


More than two peers in a document do not properly sync

This is a known issue surrounding our set-reconciliation mechanisms & implementation. Team is actively working on this one

Related PRs:

#1426
#1428
#1430

With these 3 PRs merged, I think we can consider this issue to be fixed. We still need more tests to validate all edge cases, but let's close this because there's no known issues with multi-author sync anymore.