Joint VPP sessions seems to fail synchronize pipeline

My setup:
(Decode1->VPP1)->(VPP2)->SyncOperation
Session 1: Decode1 + VPP1
Session 2: VPP2
Session 1 and 2 are joined. VPP1 does some resizing and frc. VPP2 does composition.
With this setup VPP2 sometimes unexpectedly processes the previously stored frame on the input surface, making the video "stutter". As if VPP1 hasn't finished writing its new output to that surface.
If I add a SyncOperation between VPP1 and VPP2 it works as expected.
Let me explain with an example:
// We have the following surfaces:
InSurf1 InSurf2 InSurf3
S1 S2
OutSurf1 OutSurf2 OutSurf3

// And do the following operations:
VPPAsync(VPP1, InSurf1, &S1, ...)
VPPAsync(VPP2, S1, &OutSurf1, &syncp1)

VPPAsync(VPP1, InSurf2, &S2, ...)
VPPAsync(VPP2, S2, &OutSurf2, &syncp2)

VPPAsync(VPP1, InSurf3, &S1, ...)
VPPAsync(VPP2, S1, &OutSurf3, &syncp3)

// SyncOperation is done in another thread to not block calling thread:
SyncOperation(syncp1)
SyncOperation(syncp2)
SyncOperation(syncp3)

// It's expected that the output OutSurf1, OutSurf2 and OutSurf3 contains processed frames
// of InSurf1, InSurf2 and InSurf3, respectively.
// However I sometimes get that OutSurf3 contains the same frame as OutSurf1,
// which are both using S1 as input surface.

And of course I'm making sure that surfaces are not locked before calling VPPAsync.
I'm using Media SDK 20.1.0 on an Apollo Lake. Video memory is used through vaapi.
There are some other reports of this issue:
https://software.intel.com/en-us/forums/media/topic/734639
https://software.intel.com/en-us/forums/media/topic/562583
https://github.com/Intel-Media-SDK/MediaSDK/issues/53

Hi,
Any updates on this issue?
BR
Herman

@HermanMolinder, I saw you submitted this issue several years ago https://software.intel.com/en-us/forums/media/topic/734639 and https://software.intel.com/en-us/forums/media/topic/562583 . Now, I am investigating this issue. I am trying to understand if this is a MSDK issue or driver issue. As I know, we once fixed some issues on APL in media driver. Is it possible for you to check the latest iHD driver?

Are you seeing this issue on KBL? APL is small core, we did some special for APL in media driver.
Could you please share the similar test app for reproducing this issue? I checked the current MSDK sample app, NO app to call syncoperation in another thread.
Need to check if needing to call a sync surface function.

@FurongZhang,
We're currently using Intel Media Driver release 20.1.1. Do you want me to try with latest Media Driver release?

We don't have a KBL. We have an embedded system with APL, so it's not possible to change.
Unfortunatly I can't share an app. Our application runs only in our embedded system.

@HermanMolinder , then, could you please put the above into an sample app and try that if it is reproduced on APL or not? If there is no app, I don't have a good way to reproduce your issues.
Or you can capture some driver logs so that I can have some clues for this issue?

@FurongZhang, Maybe we can start with capturing driver logs. What do I need to do to enable the logging?

https://github.com/intel/media-driver/wiki/Video-Processing-Debug-Tool
To dump VP HLT log: will dump driver log. Please contact my email if more questions, thanks a lot in advance!

@FurongZhang,
Here're two different times where I observed the error and saved the debug log from media driver. Right after I observed the "glitch" I stopped the logging, so it should appear somewhere at the end of each log file.
igd_1030.log
igd_1404.log

Hi， I am looking into this issue. You mentioned that no app could be provided, but could you pls some key code which calls the MSDK or the input so that the problem can be reproduced? My email is<EMAIL_ADDRESS>Anything confusing just contact me.

Hi @MicroYY,
I can't share any code. It's protected.
When and if I get some time over I will try to make a reproducible application from which I can share the source code.

Hi,
Just wanted to inform you that this issue is still present in latest Media SDK release 20.3.0.
BR
Herman

Hi @FurongZhang @MicroYY can you take a look on this issue, looks like it is still actual


Add validation for values specified in viya_deployment_settings.ini file.

In case an invalid value is encountered, exit with a helpful message regarding the invalid.  The ini file comments should also clearly indicate the format of the values that can be specified.

Addressed by release 1.5.0


fix: datepicker overwriting value

Closes #1473
📑 Description

This PR removes a line in Datepicker.svelte that was overwriting the date to the first day of the month.
Status

[ ] Not Completed
[x] Completed

✅ Checks

[x] My pull request adheres to the code style of this project
[ ] My code requires changes to the documentation
[ ] I have updated the documentation as required
[ ] I have checked the page with https://validator.unl.edu/
[ ] All the tests have passed
[x] My pull request is based on the latest commit (not the npm version).

ℹ Additional Information

Summary by CodeRabbit

New Features

Improved date range selection logic for more intuitive user experience.
Enhanced error handling for invalid date inputs during selection.

Bug Fixes

Adjusted initialization of the current month display for better accuracy.

My apologies, everyone; I forgot to remove the legacy code from my version of Datepicker when I made the original PR.
@diegoquiroz is correct, currentMonth.setDate(1); // Set to first day of the month should be removed so default dates aren't forced to use the first day of the month.


Scope gentropy POS loading strategy (JSON vs Parquet)

Currently, all data generated by gentropy is parquet-only. This is different from platform-etl, which produces both Parquet and JSON.
As of today, we use JSON to load to OpenSearch. If we keep doing this and there is no alternative to load parquet, we need to define a strategy, whether in the gentropy level or as a tool to convert formats that can be plugged to the orchestration.

I think this summarizes it pretty well. Removing any data conversions from ETL is good separation of concerns, as:

PIS grabs a bunch of data from many sources and puts them in a specific place
ETL generates our dataset from the source at that specific place, and puts it in another specific place, in a standard format (parquet)
POS distributes that dataset to the many  targets that need it, converting it if needed

We can see this as a core (ETL), with two outer layers, one input (PIS), and one output (POS).


Expression has changed after it was checked

ERROR Error: ExpressionChangedAfterItHasBeenCheckedError: Expression has changed after it was checked. Previous value: 'undefined'. Current value: 'Industrial Park'.

Remove ngAfterViewInit and move the contents to the bottom of ngOnInit


Restore Windows terminal colors

If I use tcell in a Windows terminal, and quit the application, the terminal always becomes black and white, regardless of what the colors were before starting the program.

Yeah, we should restore it.  Unfortunately, I'm not sure there is a "standard" way to do this.  XTerm certainly has escape sequences for it, and the vast majority of terminal emulators use the same sequences that XTerm has, but again we're stymied because of limitations in ncurses and terminfo...

So just to be clear, this only happens on Windows terminals?

Yes that's right.


Improve Core Web Vitals scores

Trello card
Trello-2912
Context
Our Core Web Vitals scores are indicating a number of pages that could be improved. The majority are related to Cumulative Layout Shift and appear to be pretty much globally across pages. A smaller subset is a long Largest Contentful Paint; this appears to be related to a particular event that is no longer active, but I expect the image was particularly large and resulted in a longer LCP (although it was only 0.1s over the 2.5s threshold!). As this event is in the past I think its safe to ignore this one and focus on the CLS issues.
Changes proposed in this pull request

Add explicit width to get boosted image

An image without a width/height causes cumulative layout shift.

Remove aspect-ratio sizing of images

Sizing images with an aspect ratio results in Cumulative Layout Shift; we need to be  explicit with the dimensions to avoid that.

Prevent search in header causing CLS

The search link in the header, along with the search autocomplete input, cause
an amount of Cumulative Layout Shift.
To prevent this we ensure there is enough space for the autocomplete input to render into. The JS disabled search link is causing the majority of the CLS, though I have absolutely no idea why and no combination of moving it around/messing with the CSS appears to resolve it. Instead, we're ripping it out of the header and putting a link in the footer so that those users can still access search (there have only been 35 page views of it in the last 6
months).
Load js_enabled.js pack synchronously so that we don't get flashes of JS enabled/disabled content that is later hidden (also a cause of CLS).

Reduce content shift from image in hero section

Defaulting the fit-content declarations to 0 reduces the amount of content shift when laying out the image in the grid.
Guidance to review

Thanks for this @ethax-ross

Get boosted logo - looks good to me

Javascript/search - have tested this and it works fine. Given the very small number of searches by people with Javascript disabled, I think that is a reasonable approach; search is still available to them

Image aspect ratio/hero images - could you just run me through this on the site to show the impact? I can see that some (but not all) of the hero images have changed to have a different crop (reduced height) but just want to understand the implications better

@ethax-ross Once these changes are in production, we need to ask Google Search Console to validate the CLS fix on both mobile and desktop - are you happy to do this?

Yep I can do that @gemmadallmandfe


.NET Core Interpreter in .msi Installer package

I would like to run scripts from within Visual Studio with the .Net Core interpreter. The 2.7.9 .msi only deploys the .Net Framework version of ipy.exe. I could get this to work by building IronPython locally and manually creating a new VS Python Environment that points to the netcoreapp ipy.dll (via ipy.bat from IronPythonConsoleAny), but it would be much nicer if this could be included in the standard .msi. Or possibly a second .msi for .Net Core?

Thanks for the suggestion. For the moment the .NET Core interpreter is available in the zip version of the release (https://github.com/IronLanguages/ironpython2/releases/download/ipy-2.7.9/IronPython.2.7.9.zip).
I would have no issue with having an MSI, but where this gets complicated is that it would require the appropriate .NET Core Runtime to be installed as well, or maybe a self-contained deployment (I haven't tested to see if the interpreter would work as an SCD)?

Thanks, I missed that this is in the zip release already. That only leaves the manual creation of the Python Environment, but that is the easy part.
If this gets added to an MSI, I think framework-dependent deployment is the better option here. The target audience for this package are developers anyway and would probably have the .NET Core Runtime already and might even want to use a specific version.


Timesheet - 26/04/2021 - James Pang

Task 1
Worked on progress page, hooked up with github milestones api.
Proof of Work

https://github.com/thenewboston-developers/Website/pull/1762/commits/1c8183362e0805b8665928d39517d3ee970ba3ce

Time Spent
2 hours

Total Time Spent
2 hours
Account Number
c54c04774efaae20746fd3f29cdd619fea512e119bc1082b863572b2e8844104

Approved


For Rhev SSA, connect through ems.

For SmartState scans of VMs in the Rhev environment, connect to the
provider through the VM's ems, instead of using oVirt directly.
https://bugzilla.redhat.com/show_bug.cgi?id=1278161

@Fryguy please review.

:+1:


Update schema for cacheVariables

This change addresses item #1934
The schema was too strict for CMAKE_BUILD_TYPE and rejected environment references. It was also missing support for null which is a valid way to clear the value of a variable for a given preset.
The object support was removed as I don't believe it is valid for the cache variables we added explicit support for.

@gugavaro This PR affects the schema and we will want to bring the changes back to VS too.


Laravel 5.7 POST request, response blocked even if 200 ok status

cors version: ^0.11.2
laravel : 5.7
I am having trouble with my angular app whenever i use post method, the request is successful but i am not getting response from the server. Thus my http call will fallback to the error block which is not expected.

After many times of debugging, turns out that the laravel's dump() function is causing the issue, I thought that I am safe using dump() because of laravel's new dump-server but then again I have to remove it somewhere in my controller which is handling a post request

After many times of debugging, turns out that the laravel's dump() function is causing the issue, I thought that I am safe using dump() because of laravel's new dump-server but then again I have to remove it somewhere in my controller which is handling a post request

Could you explain this part well? I do not understand the issue of the dump function, I have the same problem

After many times of debugging, turns out that the laravel's dump() function is causing the issue, I thought that I am safe using dump() because of laravel's new dump-server but then again I have to remove it somewhere in my controller which is handling a post request

Could you explain this part well? I do not understand the issue of the dump function, I have the same problem

I do not know what makes the cors throw  an error until i found out in my controller@store I had a single line of dump($dataHere). I removed it and tested out,now the error was resolved, put it back again and the error reproduces so I concluded this was the bug I was looking for.


autopep8 and mypy are in conflict

  - repo: https://github.com/hhatto/autopep8
    rev: v2.1.0
    hooks:
      - id: autopep8

autopep8 will auto-change files when i submit the commit, and the workflow will fail in the mypy stage.

Still after this commit 90a59fe (#983)?

We are no longer using autopep8


New cache file linking guide and related updates to existing docs

Partially addresses #265

@shcheklein the guide isn't here yet but you may want to double check the file changes in this PR so far (reflecting https://github.com/iterative/dvc/pull/1841), which are needed for consistency with recent updates I made (#344) and with the new user guides I'll push up here soon. Thanks ✌

OK guys I addressed the feedback but also had to push up all the other changes I have which add the new /doc/user-guide/cache-file-linking guide (See it live in review app). Hopefully it's not too many changes to review now!

Ready, @shcheklein

Ready, @shcheklein. Just a couple discussions still open above for a final decision on your part please. Thanks

Great stuff, @jorgeorpinel ! 🎉


Moving Piped to new host

DB is being moved on new server.

Resolved: Piped (Frontend) is back up in c27b22f.


Scrolling broken in ed (OS X 10.11.6)

Steps to reproduce:

ed [FILE]
,n
Scroll either up or down with the trackpad

Result: See photo attached
Expected: The terminal scrolls up and down correctly

Related bug: scrolling in general
Steps to reproduce:

cat [LONGFILE]
Scroll up with trackpad

alacritty doesn't have mousewheel support as far as I know. this should happen everywhere

Is that a feature or a bug ;)

Input is pretty much completely broken in any but the most basic use cases. Non-us keyboard layouts don't work, key-codes are misinterpreted (Shift+Up for example is interpreted as "A"), etc., etc.
Some of this is because of glutin, some of it because the developer probably developed with too narrow parameters. We should see everything working sooner or later. I'd call it a bug, tho ;)

Haha, wasn't sure if it was like a retro thing.  Do 80 cols and stop using the mouse, just pipe everything to less or more.  And use ed too.

We've fixed some issues with scrolling; mind trying this out with a recent version of Alacritty?

This issue has been resolved for a while now. Scrolling should work in ed and other terminal applications.


fix: import Markup from markupsafe instead of flask

fix Markup imports for error below
format code with Ruff

File "/Users/yuxiaoy/Developer/python/source-code/flask-dropzone/examples/venv/lib/python3.12/site-packages/flask_dropzone/__init__.py", line 11, in <module>
    from flask import Blueprint, current_app, url_for, Markup, render_template_string
ImportError: cannot import name 'Markup' from 'flask'

Is there a timeline for creating a new release with this fix? Currently without specifying a 2.X flask version, flask-dropzone fails to run.

@dcb-imvaria 2.0.0 version released.


Add CIGAR alignments to cudamapper using cudaaligner

Add optional cigar attribute to Overlap objects.
Add -a flag to cudamapper for the option of computing alignments
Once overlapping is complete, alignments can be completed in batches using cudaaligner.
If alignments are computed, they should be added to the PAF file (the relevant modification needs to be performed in the print_paf function).

Added necessary column to PAF in https://github.com/clara-genomics/ClaraGenomicsAnalysis/pull/189

Assigning to @ahehn-nv for #189


feat(modules): add kızlarsoruyor, onedio and evrimagaci modules

Incorporated new modules into the project, inspired by the eksisozluk module. As these modules closely resemble existing functionality, comprehensive testing was deemed unnecessary.

import new modules in
yoklama/__init__

Done :D

merged!
we'll need a slugify feature in Module.get_value for modules like kizlarsoruyor.com as they seem to be autogenerating username from given unicode string.


Don't let users request call if blocked from Concierge

If a user is blocked from chatting with Concierge they also shouldn't be able to request a call from a guide. We handle it at the API level here, but let's also block them from requesting the call on the front-end.

Not deployed yet.


chore: fix styling for light mode and dark mode hover states

Current dependencies on/for this PR:

main

PR #174   👈

This comment was auto-generated by Graphite.


Add files via upload

zomato landing page

Kya matlab tum khaali HTML and CSS file upload kr doge.

ab kya kare


(Client=55) How to create an edge with the other vertex in a variable

I have executed a query so that I get the variable $post which is the vertex I want to connect with and would like to use it like this in my ETL:
    {
      "edge": {
        "class": "NotificationIsForPost",
        "joinFieldName": "${post.objectId}",
        "lookup": "Post.objectId",
        "unresolvedLinkAction": "HALT",
        "direction": "out",
        "if": "like is not null and like.objectId is not null and $post is not null and out_NotificationIsForPost is null"
      }
    }

but that transformer is giving me:
[0:edge] DEBUG Transformer input: v(Notification)[#18:2056]
[0:edge] DEBUG Evaluating conditional expression if=Parsed: ((like IS '_NOT_NULL_') AND ((like.field(objectId) IS '_NOT_NULL_') AND (($post IS '_NOT_NULL_') AND (out_NotificationIsForPost IS null))))...
[0:edge] DEBUG joinValue=null, lookupResult=null
Pipeline execution halted
ETL process halted: com.orientechnologies.orient.etl.OETLProcessHaltedException: Cannot resolve join for value 'null'

@lvca this is also necessary for our Notification class ETL.

Ok, in EDGE transformer is missing a  new joinValue field where the value is specified elsewhere.

Done. Now you can specify joinValue with the $post context variable.

I'm afraid this needs a test.
Here's the ETL:
    { "log": { "prefix": "post: ${post} - input: " } },
    {
      "edge": {
        "class": "NotificationIsForPost",
        "joinValue": "$post",
        "lookup": "Post.objectId",
        "unresolvedLinkAction": "HALT",
        "direction": "out",
        "if": "like is not null and like.objectId is not null and $post is not null and out_NotificationIsForPost is null"
      }
    },

Here's the output:
[0:log] DEBUG Transformer input: v(Notification)[#18:270]
post: Post#19:2648358{actionId:1,commentCount:0,createdAt:Sun Jul 14 15:02:36 UTC 2013,likeCount:1,objectId:qUDpLiIfaL,updatedAt:Sat Jun 28 08:20:23 UTC 2014,popular:false,new:false,_allowRead:[1],_allowUpdate:[1],_allowDelete:[1],_etl:true,in_UserWrotePost:[size=1],in_UserLikesPost:[1]} v5 - input: v(Notification)[#18:270]
[0:log] DEBUG Transformer output: v(Notification)[#18:270]
[0:edge] DEBUG Transformer input: v(Notification)[#18:270]
[0:edge] DEBUG Evaluating conditional expression if=Parsed: ((like IS '_NOT_NULL_') AND ((like.field(objectId) IS '_NOT_NULL_') AND (($post IS '_NOT_NULL_') AND (out_NotificationIsForPost IS null))))...
[0:edge] DEBUG joinCurrentValue=$post, lookupResult=null
Pipeline execution halted
ETL process halted: com.orientechnologies.orient.etl.OETLProcessHaltedException: Cannot resolve join for value '$post'

I've tried with $post, $post.objectId, ${post.objectId}, ${post}.objectId. All the same result. Seems like joinValue isn't parsing variables.


Update README.md

add multilingual PLBERT

Just out of curiosity, are you affiliated with Papercup AI or is this independent?

I’m not affiliated but it does have a lot of languages so I think people might be interested


Optimize remove action apply with early iteration exit #424

Description
Right now, we use Iterator::retain to remove files from active file list when applying remove actions from the transaction log. This can be optimized by performing an early exit of the iteration when we reach the file that needs to be removed.

Find the position of the file.
Remove the file from the vector.

Related Issue(s)

closes #424

Thanks @akshay26031996 for your contribution.


Don't show loading state in workspace setup button

Details
We were getting double spinners when setting up workspaces. We only want the sidebar loading icon, not the button.

Fixed Issues
$ https://github.com/Expensify/App/issues/4384
Tests

Open a workspace
Set up a bank account
Between steps make sure the button does not have a loading state

QA Steps
n/a
Tested On

[x] Web
[ ] Mobile Web
[ ] Desktop
[ ] iOS
[ ] Android

Screenshots

:hand: This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

🚀 Deployed to staging         in version: 1.0.82-8🚀

platform
result

🤖 android 🤖
success ✅

🖥 desktop 🖥
success ✅

🍎 iOS 🍎
success ✅

🕸 web 🕸
success ✅

@stitesExpensify Hello! Our testing domains already have a Expensify card set and we're not able to access this flow. Can you provide a testing account for this or test this internally?

This is no QA and can be checked off. I mentioned it in the PR body but forgot to put it in the title, my bad

🚀 Deployed to production by @francoisl in version: 1.0.83-1 🚀

platform
result

🤖 android 🤖
success ✅

🖥 desktop 🖥
failure ❌

🍎 iOS 🍎
success ✅

🕸 web 🕸
success ✅


RocksDB store

A store backed by RocksDB

Closing as it is now in the gaffer-experimental repository: https://github.com/gchq/gaffer-experimental/issues/5


Serving model from gs:// fails with "'gs://', 's3://', and 'file://' are the current available storage type."

/kind bug
Train a model with pyTorch operator , deploy the dat file on gs://
(venv) velascoluis@python3venvsandbox:~/pytorch$ gsutil ls gs://kf10rc4
gs://kf10rc4/model_cpu.dat
Luanch the KFServing with the following yaml
apiVersion: "serving.kubeflow.org/v1alpha2"
kind: "InferenceService"
metadata:
name: "pytorch-mnist-serving-01"
spec:
default:
predictor:
pytorch:
storageUri: "gs://kf10rc4/"
modelClassName: "Net"
(venv) velascoluis@python3venvsandbox:~/pytorch$ kubectl create -f inference.yaml
inferenceservice.serving.kubeflow.org/pytorch-mnist-serving-01 created

What did you expect to happen:
Deploy the model serving
Anything else you would like to add:
[Miscellaneous information that will assist in solving the issue.]
Environment:

Istio Version:
Knative Version:
KFServing Version:
Kubeflow version: v1.0
Minikube version:
Kubernetes version: (use kubectl version):
OS (e.g. from /etc/os-release):

@velascoluis which namespace the service gets deployed to ? I think you may have deployed the service in a namespace with control-plane label, The storage-initializer init container does not get injected for deployments in those namespaces since they do not go through the pod mutating webhook, the error is a bit misleading.

please check https://github.com/kubeflow/kfserving#kfserving-in-kubeflow-installation, the storage initializer init container is not injected because the service is deployed to namespace with control-plane label, model is not mounted to /mnt/models hence the above error.
/close


Save User details, payment details and hotel confirmation details in the backend

@dy-estate Confirm the data being stored.


nimble/host : Feature GATT Caching

Added GATT Caching feature support.

Hi @sjanc ,
Can you please review this PR? It attempts on adding GATT Caching feature support.

Hi,
for starter please fix CI issues, eg it looks like "bool aware_state;" is declared outside of conn object and code doesn't even compile...   was this tested at all? or it is just "rebase issue" ?

Hi,
Yes the code is locally tested and it works.
I missed adding some files that's why the CI is failing. The variable aware_state in inside conn object locally, maybe rebase issue.
I will check all changes again.


docs: add platform information

closes #1130

Issue
Information concerning Docker platform and multi-architecture support is missing from the user documentation.

All current Cypress Docker images support Linux/amd64 and Linux/arm64 platforms
cypress/browsers and cypress/included Cypress Docker images for the Linux/arm64 platform contain no browsers

Change
Add information about Linux Debian platform support and Multi-architecture support to the READMEs:

README
browsers/README
included/README

@jennifer-shehane

Looks great!

Thank you!


2.3.2 release?

Avoid duplicates

[X] Question is not already answered in the FAQ
[X] Question is specific for iOS only, for general issues / questions that apply to iOS and Android please raise them in the documentation repository
[X] Question has not already been asked in another issue

Your Question
The App Store offers version 2.3.2 for download. It can be installed by all users manually.
Will you follow up with a version 2.3.2 Release shown on https://github.com/corona-warn-app/cwa-app-ios/releases?
The latest shown there is currently https://github.com/corona-warn-app/cwa-app-ios/releases/tag/v2.3.0-RC11.

Version 2.3.2 has been released to GitHub now: https://github.com/corona-warn-app/cwa-app-ios/releases/tag/v2.3.2


High loss of accuracy after coverting ".pb" to ".lite" on Android

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow):
I only modified the ImageClassifier.java to make it compatible with float and quant.
OS Platform and Distribution (e.g., Linux Ubuntu 16.04):
Ubuntu 14.04.3 LTS
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device:
LG G4
TensorFlow installed from (source or binary):binary
TensorFlow version (use command below):1.7.1
Python version:2.7.6
Bazel version (if compiling from source): NA
GCC/Compiler version (if compiling from source): NA
CUDA/cuDNN version: NA
GPU model and memory: NA
Exact command to reproduce:

Describe the problem
Hi,
I retrained a module refer to tensorflow-for-poets, and its retrain.py was replaced by this one.
I did two experiments:
1. Choose the module: mobilenet_1.0_224_quant
I retrained the module with the command below:

python -m scripts.retrain
--architecture=mobilenet_1.0_224_quant
--bottleneck_dir=tf_files/bottlenecks
--how_many_training_steps=500
--model_dir=tf_files/models/
--summaries_dir=tf_files/training_summaries/mobilenet_1.0_224_quant
--output_graph=tf_files/retrained_graph.pb
--output_labels=tf_files/retrained_labels.txt
--image_dir=tf_files/flower_photos

Then I converted ".pb" to ".lite" with this command:

toco
--input_file=tf_files/retrained_graph.pb
--output_file=tf_files/optimized_graph_quant.lite
--input_format=TENSORFLOW_GRAPHDEF --output_format=TFLITE
--inference_type=QUANTIZED_UINT8
--input_shape="1,224,224,3"
--input_array=input
--output_array=final_result
--std_value=128 --mean_value=128

I tested optimized_graph_quant.lite with the TfLiteCameraDemo which provided by tensorflow-for-poets.
And only once inference, I found that the accuracy is very good:

01-01 01:12:37.942 12117 12217 D TfLiteCameraDemo: Timecost to run model inference: 354
01-01 01:12:37.946 12117 12217 D TfLiteCameraDemo: textToShow = 354ms
01-01 01:12:37.946 12117 12217 D TfLiteCameraDemo: roses: 1.00
01-01 01:12:37.946 12117 12217 D TfLiteCameraDemo: sunflowers: 0.00
01-01 01:12:37.946 12117 12217 D TfLiteCameraDemo: tulips: 0.00

2. Choose the module: mobilenet_1.0_224
I retrained the module with the command below:

python -m scripts.retrain
--architecture=mobilenet_1.0_224
--bottleneck_dir=tf_files/bottlenecks
--how_many_training_steps=500
--model_dir=tf_files/models/
--summaries_dir=tf_files/training_summaries/mobilenet_1.0_224
--output_graph=tf_files/retrained_graph.pb
--output_labels=tf_files/retrained_labels.txt
--image_dir=tf_files/flower_photos

Then I converted ".pb" to ".lite" with this command:

toco
--input_file=tf_files/retrained_graph.pb
--output_file=tf_files/optimized_graph.lite
--input_format=TENSORFLOW_GRAPHDEF
--output_format=TFLITE
--input_shape="1,224,224,3"
--input_array=input
--output_array=final_result
--inference_type=FLOAT
--input_data_type=FLOAT

I also tested optimized_graph.lite with the TfLiteCameraDemo which provided by tensorflow-for-poets.
And after multiple inferences, the accuracy increased to an acceptable value :

01-01 01:29:23.221 13207 13224 D TfLiteCameraDemo: Timecost to run model inference: 510
01-01 01:29:23.226 13207 13224 D TfLiteCameraDemo: roses: 0.06
01-01 01:29:23.483 13207 13224 D TfLiteCameraDemo: Timecost to run model inference: 238
01-01 01:29:23.488 13207 13224 D TfLiteCameraDemo: roses: 0.18
01-01 01:29:23.741 13207 13224 D TfLiteCameraDemo: Timecost to run model inference: 221
01-01 01:29:23.746 13207 13224 D TfLiteCameraDemo: roses: 0.31
01-01 01:29:24.162 13207 13224 D TfLiteCameraDemo: Timecost to run model inference: 398
01-01 01:29:24.167 13207 13224 D TfLiteCameraDemo: roses: 0.45
01-01 01:29:24.527 13207 13224 D TfLiteCameraDemo: Timecost to run model inference: 336
01-01 01:29:24.533 13207 13224 D TfLiteCameraDemo: roses: 0.58
01-01 01:29:24.898 13207 13224 D TfLiteCameraDemo: Timecost to run model inference: 339
01-01 01:29:24.907 13207 13224 D TfLiteCameraDemo: roses: 0.68
01-01 01:29:25.274 13207 13224 D TfLiteCameraDemo: Timecost to run model inference: 326
01-01 01:29:25.280 13207 13224 D TfLiteCameraDemo: roses: 0.76
01-01 01:29:25.646 13207 13224 D TfLiteCameraDemo: Timecost to run model inference: 340
01-01 01:29:25.652 13207 13224 D TfLiteCameraDemo: roses: 0.83
01-01 01:29:26.032 13207 13224 D TfLiteCameraDemo: Timecost to run model inference: 354
01-01 01:29:26.041 13207 13224 D TfLiteCameraDemo: roses: 0.87
01-01 01:29:26.433 13207 13224 D TfLiteCameraDemo: Timecost to run model inference: 365
01-01 01:29:26.438 13207 13224 D TfLiteCameraDemo: roses: 0.91
01-01 01:29:26.831 13207 13224 D TfLiteCameraDemo: Timecost to run model inference: 365
01-01 01:29:26.838 13207 13224 D TfLiteCameraDemo: roses: 0.93
01-01 01:29:27.288 13207 13224 D TfLiteCameraDemo: Timecost to run model inference: 391
01-01 01:29:27.296 13207 13224 D TfLiteCameraDemo: roses: 0.95
01-01 01:29:27.658 13207 13224 D TfLiteCameraDemo: Timecost to run model inference: 333
01-01 01:29:27.663 13207 13224 D TfLiteCameraDemo: roses: 0.97
01-01 01:29:28.005 13207 13224 D TfLiteCameraDemo: Timecost to run model inference: 313
01-01 01:29:28.010 13207 13224 D TfLiteCameraDemo: roses: 0.97
01-01 01:29:28.381 13207 13224 D TfLiteCameraDemo: Timecost to run model inference: 341
01-01 01:29:28.385 13207 13224 D TfLiteCameraDemo: roses: 0.98

Please help to analyze that why it needs multiple inferences to get an good accuracy here? Thanks!

The demo app applies a low-pass filter to the outputs.
https://github.com/tensorflow/tensorflow/blob/master/tensorflow/contrib/lite/java/demo/app/src/main/java/com/example/android/tflitecamerademo/ImageClassifier.java#L134
When outputs of TFLite interpreter are changed, the displayed values are changed gradually. This prevents the case that one bad frame makes the UI jumpy (e.g. 98% -> 0% -> 99%).
The logic isn't in TFLite interpreter. You're free to change the code to disable the logic. If you get the values from TFLite interpreter directly is should be fine.
Closing since this is working as intended.


Magikarp's Revenge doesn't work under primal weather.

Magikarp's Revenge is a for-fun move designed to test out the various aspects of the move system and doesn't really need to be changed. In fact, when I was implementing the primal weathers, I let Magikarp's Revenge override them on purpose. It's special that way.
Final judgment goes to Zarel, of course, but I've had my say on why it doesn't need changing.

Really this should be happen at a higher level. For instance, inside setWeather, or in raindance's onStart or primal weather's onWeather or something. What happened to DRY?


Callback on highlighter deserialize

I'm using rangy highlighter on a view with a lot of content, and I also have a view with a list of  selections made by the user. With my app, I can tap or click on a selection within the list, and It will take me to the text view and scroll down to the selection I choosed. The thing is I can't scroll down to my selection if rangy is still deserializing after the view loads. It will be nice implementing a callback to highlighter.deserialize() (and other heavy funcs) so when the all the highlights are in the text, the page can scroll down to the chosen highlight.

pull request with the callback https://github.com/timdown/rangy/pull/380


PHP-Problem

TaskBoard have the known "Bumps back to login"-problem. The solution is to use Mod-PHP.
With Fast-CGI, CGI or SuPHP you have the "Bumps back to login" after login problem.

Is this just posted for future searchers? I'm not seeing an actual issue, just a statement.

is it maybe because your fsstcgi, cgi or suphp is running under a different user then the taskboard.db file was created with?

Using MySQL
---Sent from Boxer | http://getboxer.com
On 26. April 2015 16:50:59 MESZ, Martin Holzhauer<EMAIL_ADDRESS>wrote:is it maybe because your fsstcgi, cgi or suphp is running under a different user then the taskboard.db file was created with?  —Reply to this email directly or view it on GitHub.


Interchange Stops Logic

#61  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @ksharma-xyz and the rest of your teammates on  Graphite


Welcome to ai-companion v0.9.5 and Provide Feedback to help Release Version 1.0

Hello.
I have added a few new features and made some improvements. I would love to hear your feedback, identify any bugs, or receive suggestions to release version 1.0.
What's new in version 0.9.5 (in comparison to previous versions):

Improved long term memory
Added ability to export and import messages
Added example dialogue
Improved web user interface
Changed entire 'Assistant' (default character) personality
Patched bugs, errors and warnings
Did more proper error handling
Other small fixes

Please help me with:
Reporting Bugs:
Report any issues you encounter, along with the steps to reproduce them.
Suggestions and Feedback:
If you have ideas for additional features or improvements, I'm eager to hear them!
Testing:
You can just test my software and type what do you think about it, is documentation clear to understand? is WebUI not annoying? are the installation instructions too complicated?
Instructions:
For bug reports, please use the "Issues" section on GitHub and provide the steps to reproduce the issue. For fixing issues I recommend using "Pull requests".
Feel free to leave suggestions and feedback in the comments of this issue.
Thank you for your support and assistance in enhancing my program!

This has so much potential! I've run it on windows, but it was so slow... is there support for running the model in GPU?

This has so much potential! I've run it on windows, but it was so slow... is there support for running the model in GPU?

At the moment, unfortunately, no. In the future, when I want to release version 1.0, perhaps there will be GPU support. Given that I have a GPU from AMD, not NVIDIA, the only thing I would be able to test is ROCm, not CUDA.

https://github.com/Hukasx0/ai-companion/issues/75


Windows CI not succeeding

Description
Latest main does not pass CI on Windows.

This is follow up from https://github.com/ros-tooling/rosbag2_storage_mcap/pull/54#issuecomment-1279327023

See example build:
https://ci.ros2.org/job/ci_windows/18046/console
Proposed solution:
Rename rosbag2_storage_mcap_test_fixture_interfaces package to some shorter name to pass Windows CI.

Oh I see that #67 was created to track latest pass on this - will close again in favor of that which has more info


Update dependencies and migrate config

@ansidev Thank you for your contribution but Why I can't run dev in this config?

You mean that you want to see the change from the browser via dev server?

No. I want to try run dev in local but port 8080 not have anything run on it.

@ansidev Thank you for your contribution but Why I can't run dev in this config?

You mean that you want to see the change from the browser via dev server?

No. I want to try run dev in local but port 8080 not have anything run on it.

Fixed.


update

Hello
Please update the fragment
New xray core
New Powershell
and new configurations
can support
Thankful

Hello Please update the fragment New xray core New Powershell and new configurations can support Thankful

Hi, link to the latest Xray core and also YouTube instructions were added. Also for the config, it's suggested that you should use a Cloudflare CDN config of your own, or free ones available. Thanks for your considerations and good luck.


how to deploy in DENO DEPLOY ?

how to deploy this code to deno deploy
import { Application } from "https://deno.land/x/abc/mod.ts";

const app = new Application();

console.log("http://localhost:8080/");

app
  .get("/hello", (c) => {
    return "Hello, Abc!";
  })
  .post("/add",async(c)=>{
    let {name} = await c.body
    console.log(c.body)
    return "namanya = " + name
  })
  .start({ port: 8080 });

Sorry, it's not supported yet, but I've been trying to find a path that fits better with Deno Deploy.
I don't think it's a good idea for Abc (or any other framework of its type) to work with Deno Deploy (or any other deployment platform). So I will split a section of Abc into a separate file to support Deno Deploy. I believe this work will be completed soon (within two months)


Reproducing the results

Hi I have been working with your models (withou NAS) in my own framework and I have been struggling to reproduce your results with the MinkUNet. I would like just to confirm some hyperparameters to see if I'm missing something.
So for the best test so far:

I used your scheduler, the cosine_warmup
learning_rate: 0.24
decay_lr: 1.0e-4
SGD optimizer with momentum 0.9 and nesterov=True
For the criterion I have used mix lovasz and cross-entropy which really increased the performance during my training
And epoch = 20

My main question is, in your paper it's said that after the first 15 epochs with lr = 0.24 a second training with other 15 epochs and lr = 0.096 is done. This second training is only for the NAS version or for the bare models it's also done a second 15 epochs training?
I'm asking because after the 20 epochs of training on my framework I've got only 38% of mIoU in the validation set (seq 08) and ~50% mIoU on the training set.

One more question that I've forgot. On the spvcnn model before the classifier module, the voxel_to_point method is called, which means that the classifier runs over the points not the voxels. However on the minkunet model the voxel_to_point method is not called, so I assume that for the minkunet the classifier runs over the voxels, and thereat, the loss is compute over the voxels and not over the points, is that correct?

One more question that I've forgot. On the spvcnn model before the classifier module, the voxel_to_point method is called, which means that the classifier runs over the points not the voxels. However on the minkunet model the voxel_to_point method is not called, so I assume that for the minkunet the classifier runs over the voxels, and thereat, the loss is compute over the voxels and not over the points, is that correct?

Actually the points for SPVCNN is the same as the voxels at the finest granularity in MinkowskiNet.

A quick update, I could basically arrive at close results, but I've noticed some "overfitting". For the training the motorcyclist class achieves 90% mIoU, but for the validation it's 0%. Do you have any insights?

I think that might be because there are limited amount of training data for small objects and the network just learns to memorize the training set. However, we do empirically find that SPVCNN / SPVNAS can outperform MinkowskiNet on small object categories due to the supplementary fine-grained information from the point-based branch.

@kentangSJTU many thanks! I could reproduce the results now!

Hi @nuneslu , I'm curious how  you were able to increase your results to over 60% mIOU, as right now I'm similarly only getting ~30% mIOU after 15 epoch using the default configuration.

Hi @CCInc, so as far as I remember the biggest problem that I had was that I was trying to use SemanticKITTI class weights, I was using it wrongly, then I just dropped it and used only the CrossEntropyLoss as in the paper, then it worked just fine. But also there was some fix on my framework to deal with SparseTensors properly.

Hi, @CCInc , I also faced the same problem. I trained spvcnn with the default option, but the loss does not fall and the result is 20-30% mIoU. Also, when evaluating with a pretrained model, the average mIOU is almost 0. Do you know any solution?


Get Travis CI working

Travis CI is unable to test this model due to memory constrains. See discussion on PR #11

Endpoints are tested via Travis-CI and the full model is tested via Jenkins.


Only getting DIR:false after collate of SPLIT-seq

Hi - I'm trying to run alevin-fry on the 150k mouse SPLIT-seq data from the original SPLIT-seq paper, roughly following the tutorial here: https://combine-lab.github.io/alevin-fry-tutorials/2022/split-seq/ (but of course with a mouse only index). My current issue is that after I run generate-permit-list and collate I get a collated rad file that only contains DIR:false (i.e. antisense) alignments, whereas before collation I see a mix (and actually about 2x DIR:true i.e. sense). Is this expected?

Hi @davidaknowles,
Thanks for filing the issue / raising this question.  This is an effect of how the collate command works that, admittedly, is not well documented (we'll aim to fix that).
Basically, during collate, alevin-fry also filters out mappings that were not consistent with the required orientation specification.  Since, in the filtered and collated RAD file, it is assumed that all reads have a "consistent" orientation, that information is no longer actively tracked, and the RAD file just marks the orientation of each mapping as FALSE.  This behavior is somewhat of a historical artifact, but it's how the collate command currently works — since that information will no longer participate in quantification.  If there is a good reason that one needs to retain that orientation information, however, we can work on supporting that and propagating the orientation to the collated RAD file.
Best,
Rob

Thanks for the rapid response! I think I can safely ignore orientation then.


Set custom font on ProgressDialog

Hi, I'm wondering how to set some custom font on progressBar message. I've tried everything and haven't succeeded

So I think ProgressDialog use the standard Dialog Styles, so if you override you dialogStyles this should apply to your ProgressDialog.


Convert YUV420 to Bitmap format

Hi, your plugin only works with RGBA32 format. Any solution for YUV420 format? thanks

Not for now, woudl love to see a code to at least convert form that format. Up for a PR?


[BUG] Persistent Fire Modes

Description of the bug:
Fire mode staying when switching to a weapon without fire modes
Video of the bug:
N/A
Steps to recreate the bug:
N/A

Resolved In Release v0.2.2-beta


Outline Manager CLI

Is there an existing issue that is already proposing this?

[X] I have searched the existing issues

Application
Outline Manager
What are you trying to do? What is your use case?
Is it a way to install and Manage Outline Manager on the Server machine directly without the need to install the Outline manager on a Separate computer?
Proposal:
Have Linux Package for Installing Outline on the server
Have a CLI for managing Keys  (CRUD)
Best Regards
Alex
Is your feature request related to a problem? Please describe it.
I want to install and manage outline on the server without access to my personal computer at home
Describe the solution you'd like.
Proposal:
Have Linux Package for Installing Outline on the server
Have a CLI for managing Keys  (CRUD)
Describe alternatives you've considered
No response

You can install the server using the installation script directly on the machine (instructions) and use the API to manage keys in a CRUD manner (instructions). If your server has a GUI, I don't see why you couldn't also install the Linux Manager directly on that machine, but it's unclear to me whether that's what you mean with "Linux Package".
Would either of those solutions work for you?


⚠ Mobitopup has degraded performance

In b2c2d0d, Mobitopup (https://napcard.voz.tech) experienced degraded performance:

HTTP code: 200
Response time: 3775 ms

Resolved: Mobitopup performance has improved in e788e6b after 25 minutes.


Could not open VISA library

Hi,
I got a problem by using VISA library on Win8.1 x64 system. below is what I got when the sequence is: rm = visa.ResourceManager('C:\Windows\system32\visa32.dll')
Please help.
Machine Details:
Platform ID:    Windows-8-6.2.9200
Processor:      Intel64 Family 6 Model 61 Stepping 3, GenuineIntel
Python:
Implementation: CPython
Executable:     C:\Python33\python.exe
Version:        3.3.2
Compiler:       MSC v.1600 32 bit (Intel)
Bits:           32bit
Build:          May 16 2013 00:03:43 (#v3.3.2:d047928ae3f6)
Unicode:        UCS4
VISA:
PyVISA Version: 1.6.dev0
#1: C:\Windows\system32\visa32.dll
found by: auto
bitness: 32
#2: C:\Windows\system32\visa32.dll
found by: auto
bitness: 32
Traceback (most recent call last):
File "C:\Users\cyen\workspace\ForcePad_EVT\FuncGen - bk.py", line 6, in
rm = visa.ResourceManager('C:\Windows\system32\visa32.dll')
File "C:\Python33\Lib\site-packages\pyvisa\highlevel.py", line 1419, in new
visa_library = open_visa_library(visa_library)
File "C:\Python33\Lib\site-packages\pyvisa\highlevel.py", line 1398, in open_visa_library
raise OSError('Could not open VISA library:\n' + '\n'.join(errs))
OSError: Could not open VISA library:
object() takes no parameters

Hello, I am having a similar issue:
The error message:
k1@k1-HP-350-G2 ~/Desktop $ python script.py
Traceback (most recent call last):
File "script.py", line 13, in
NA = NA_AgilentN5245A.NA_AgilentN5245A(NA_IPaddress)
File "/home/k1/Desktop/NA_AgilentN5245A.py", line 48, in init
self.connect(ip_address, reset, use_HiSLIP=use_HiSLIP)
File "/home/k1/Desktop/NA_AgilentN5245A.py", line 56, in connect
rm=visa.ResourceManager('')
File "/usr/local/lib/python2.7/dist-packages/pyvisa/highlevel.py", line 1488, in new
visa_library = open_visa_library(visa_library)
File "/usr/local/lib/python2.7/dist-packages/pyvisa/highlevel.py", line 1460, in open_visa_library
return cls(argument)
File "/usr/local/lib/python2.7/dist-packages/pyvisa/highlevel.py", line 96, in new
raise OSError('Could not open VISA library:\n' + '\n'.join(errs))
OSError: Could not open VISA library:
I am calling ResourceManager() with no argument since I am not sure what directory to pass to it.
My system information:
k1@k1-HP-350-G2 ~/Desktop $ cat /proc/version
Linux version 3.13.0-37-generic (buildd@kapok) (gcc version 4.8.2 (Ubuntu 4.8.2-19ubuntu1) ) #64-Ubuntu SMP Mon Sep 22 21:28:38 UTC 2014
Any help would be appreciated! Thanks.

Do you have VISA installed?

Thanks, I don't:
k1@k1-HP-350-G2 ~ $ python -m visa info
Machine Details:
Platform ID:    Linux-3.13.0-37-generic-x86_64-with-LinuxMint-17.1-rebecca
Processor:      x86_64
Python:
Implementation: CPython
Executable:     /usr/bin/python
Version:        2.7.6
Compiler:       GCC 4.8.2
Bits:           64bit
Build:          Mar 22 2014 22:59:56 (#default)
Unicode:        UCS4
PyVISA Version: 1.9.dev0
Backends:
ni:
Version: 1.9.dev0 (bundled with PyVISA)
Binary library: Not found
I followed the installation instructions found here:
http://www.ni.com/download/ni-visa-5.4/4234/en/
Even though the installation appeared to complete successfully, I still don't seem to have any NI VISA binary library. A folder is created at: /usr/local/natinst/share/etc/ but it is empty except for a text file "share.dir".
I understand that this is no longer a PyVISA issue, but I was wondering if you have any tips regarding the NI VISA Linux installation?

The usage of PyVISA requires NI-VISA. If you are not able to install it, you can try the py backend which is a Python implementation of VISA. Take a look at http://pyvisa-py.readthedocs.org/en/latest/

Hi Hernan,
Got it and thanks for your sharing.
Best Regards,
Casper
From: Hernan Grecco<EMAIL_ADDRESS>Sent: Wednesday, October 21, 2015 5:46 AM
To: hgrecco/pyvisa<EMAIL_ADDRESS>Cc: Casper Yen<EMAIL_ADDRESS>Subject: Re: [pyvisa] Could not open VISA library (#79)
The usage of PyVISA requires NI-VISA. If you are not able to install it, you can try the py backend which is a Python implementation of VISA. Take a look at http://pyvisa-py.readthedocs.org/en/latest/
—
Reply to this email directly or view it on GitHubhttps://github.com/hgrecco/pyvisa/issues/79#issuecomment-149712435.

I face the same problem like Hanwlin，Did you solve it？may you share the solution？please~~~


Question: How PDF.js fetches PDF contents

I have a question about how PDF.js fetches the contents of a PDF file.
I'm using a 3rd party JS "flipbook" web app that is based around PDF.js. From my testing it seems that the initial request to the PDF is a normal HTTP "GET" request (although somehow the entire file is not received at that time). Subsequent requests are for a specific byte-range.
To me it would make more sense to send a HEAD request first to find out the file size.
With another viewer I was using, the first request is for the last 22 bytes, which is another quick way to get the total size.
I'm interested in knowing (if my assumption is correct), why a full GET request is initially sent. It seems to be an unnecessary overhead, especially for large PDFs.

Not all servers support HEAD; GET is the safest method to ensure a response.
The request is aborted if the server claims to support byte-range requests. Otherwise the request continues and its response is used.
The logic is here: https://github.com/mozilla/pdf.js/blob/c0a47fddcca573e49db3d1ba0a6a1777e9889224/src/core/network.js#L369-L434
If you are curious about range request implementations: I have also implemented a JS library that lists zip files. Its requirements are similar to the PDF fetching logic, since in both file formats (zip and pdf), the last chunk of the file is significant. You can learn more about it at:

Documentation of HTTP logic: https://github.com/Rob--W/zipinfo.js#optimization-minimize-fetch
Implementation: https://github.com/Rob--W/zipinfo.js/blob/56fadfed121263b38ee85746ede6a2b23ed9f41a/zipinfo.js#L111-L176

Closing as answered.

Thanks @Rob--W - makes perfect sense now


Introduction link not working for README.md and website

Hi,
Thank you for your work on this project!
I came across 1 tiny little issue that might not even worth bothering about:
The anchor tag of Introduction section is not working currently both at README.md and the static site.
I believe it's due to the mismatch of href and id.
The former one is #intro while the latter is #introduction.
I think this will be a trivial fix.
However I do not understand how the static site is generated so might not be able to help fix it.

@theNewJson Thanks for pointing it out! Im currently planning this weekend to add a bunch of new links and I can fix this as well. I’ve had some issues with the href before on other categories due to exactly what you pointed out (the mismatch)
Glad you like the project and so be sure to check back when all the new links are up!
Nick

Fixed


Brew install or upgrade - fixes MySQL recipe fails if older version of MySQL is installed

This changes #brew_install to run "brew update #{package}" when is package is already installed instead of ignoring.
This addresses an issue we had with #brew_install for mysql which failed because the brew --prefix mysql returns a path for the expected version of MySQL, not the currently installed version of MySQL.
-aram

This seems reasonable.  I took a stab at fixing the brew prefix issue with mysql this weekend in this commit https://github.com/pivotal/pivotal_workstation/commit/82f6d5fe9de1b9daf11e6b24e2bf59d1b1cb0c13
which got a little crazy.
I think this fix is still necessary though.  Ultimately I want to move to an lwrp that is aware of homebrew git hashes, and lets you specify the git hash for each package, so things can be upgraded one by one instead of all at once.
Somehow all sorts of commits have gotten into this pull request.  It looks like I just need to cherry pick the last one?

I'm not sure about all the other commits in the pull request, probably operator error on my part.
The only important changes are in libraries/brew.rb
Basically running "brew upgrade" if the package is already installed.
I'm curious about the individual git hashes, I was under the impression that homebrew couldn't do variant versioning... Do you have an examples of that I could take a look at?

No examples, it's just an idea at this point.  Homebrew is just a git repo, so why not git checkout MYSQLHASH before installing mysql and git checkout POSTGRESHASH before installing postgres?

It's times like these I wonder why we use homebrew.  Homebrew errors out if you try and upgrade something that's already up to date, which kind of makes sense.  However, it also errors if you brew list xyz if xyz has been upgraded and therefore has multiple versions installed.
New Plan: Don't upgrade unless it appears in brew outdated and if you're going to upgrade, do a brew uninstall --force first.  Seems a bit heavy handed, but it just might work.

New plan implemented, this works for all the test cases I tried.  I really want to write about 20 unit tests around this thing.
https://github.com/pivotal/pivotal_workstation/blob/3563964f5a00ac3305265dc75dc4955c65374c24/libraries/brew.rb


Add support to generate keyshare(s) for a subset of the preferred curves

Please note that while we are transitioning from travis-ci to AWS CodeBuild, some tests are run on each platform. Non-AWS contributors will temporarily be unable to see CodeBuild results. We apologize for the inconvenience.
Resolved issues:
Description of changes:

Create an API function that allows customers to support multiple curves, but only generate keyshare(s) for a subset of those curves or send an empty keyshare list.

Adds command line interface support to s2nc that lets customers support multiple curves, but only generate a keyshare for a subset of those curves.

Describe s2n’s current behavior and how your code changes that behavior. If there are no issues this pr is resolving, explain why this change is necessary.
Call-outs:

Currently the API is enabled only in testing mode

Address any potentially confusing code. Is there code added that needs to be cleaned up later? Is there code that is missing because it’s still in development?
Testing:

Added unit tests

How is this change tested (unit tests, fuzz tests, etc.)? Are there any testing steps to be verified by the reviewer?
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Codecov Report

Merging #1962 into master will decrease coverage by 0.06%.
The diff coverage is 70.27%.

@@            Coverage Diff             @@
##           master    #1962      +/-   ##
==========================================
- Coverage   80.31%   80.25%   -0.07%
==========================================
  Files         228      228
  Lines       17037    17100      +63
==========================================
+ Hits        13684    13724      +40
- Misses       3353     3376      +23

verified the latest revision of this CR properly triggers an HRR when s2n sends an empty key_share:


Typo in name

Hi Andrew,
Noticed my name was misspelled here :)

Ugh, sorry man! Thanks again for your contribution!

No worries, glad I could help!


update package references to VS2017 syntax

There's a bunch of explicit project references from NuGet packages in the current source that can be replaced with PackageReference elements that use the NuGet package name.
An example:
<Project Sdk="Microsoft.NET.Sdk">
  <PropertyGroup>
    <TargetFramework>net46</TargetFramework>
  </PropertyGroup>
  <ItemGroup>
    <PackageReference Include="Microsoft.NET.Test.Sdk" Version="15.0.0" />
    <PackageReference Include="xunit" Version="2.2.0" />
    <PackageReference Include="xunit.runner.visualstudio" Version="2.2.0" />
  </ItemGroup>
</Project>

Here's a guide to migrating the project files, which we'd probably need to do to enable this: http://www.natemcmaster.com/blog/2017/03/09/vs2015-to-vs2017-upgrade/

I can take this one too 😁

So it seems that we might not be able to update the Carnac project to the new VS2017 project format (or perhaps I'm misunderstanding something)...

If you are building WPF, Universal Windows, Xamarin, or ASP.NET 4 projects, you’ll have to stick with the old format

Issue for expanding support to the above project types https://github.com/dotnet/sdk/issues/491
I can start by updating the Carnac.Logic and test project, and then we can upgrade the main project once WPF projects can support the new format.

@alfhenrik ugh, there's always a catch. Anyway, have a look and see what we can clean up.

This is turning out to be a bit more effort than I first thought so I'm gonna sideline it for a bit while I do #125 as that has more value for our users 😁

I'm gonna pick this one up again, we won't be able to update the main WPF project but we should be able to :fingerscrossed: update the other ones.


Better diagnosis for unexpected error writing points to database: engine: field type conflict

Using the async WriteAPI and Errors() channel, when above error happens it is impossible to relate this to the originating write. It would be nice if the error type could expose additional information.

@andig it is transfer, please update the title and the description to clarify requirements to the db engine

@bednar updated https://github.com/influxdata/influxdb/issues/24568#issue-2075921700- thank you!


fix authenticate

fix test
BUILD SUCCESSFUL in 5m 36s
12 actionable tasks: 12 executed

@sksamuel please review


Website: show errors in editors

I like this.  We should also update everything else in docs/vendor/codemirror in this PR.

We should also update everything else in docs/vendor/codemirror in this PR.

See #48 for discussion.

Do you mean updating to CodeMirror 6? I probably cannot do that, because my web kung-fu is very limited and the editor was significantly rewritten.

I did, but then I looked at it, and they sure managed to make Codemirror harder to get started with.  Let's make sure we've got the latest build of CodeMirror5, then open a new ticket for moving to CodeMirror6, with the "Help Requested" tag.  Maybe someone will pitch in.

Of course, updating to CodeMirror 5.65.5 didn't "just work" either.  Let's take this as-is.  I'll open the CM6 bug as well.


feat: implement darker theme and remove redundant file

mind updating readme to include a screenshot of new darker pallete


Preserve white spaces and new lines from the comments in hover request

This is mostly visible when there is a markdown table in the comments. The whole table is passed in one line.
/**
 * | a      | b    |
 * |‐-------|-------|
 * | 1      | 2    |
 */

Will be sent as
| a | b | |‐-------|-------| | 1 | 2 |

It would be really helpful for the parsing of the data and better for the visualisation.

I agree, currently it only breaks line when there are 2 new line characters. Setting hover format to "plaintext" does nothing. Let us do "real" plain text, zero formatting, just print as is (maybe only stripping '*' at beginning, but that would be optional for me).

For anyone that might be interested in having as-is parsing. Add this
diff --git a/clang-tools-extra/clangd/Hover.cpp b/clang-tools-extra/clangd/Hover.cpp
index de103e011c70..e3bf8ebef9ad 100644
--- a/clang-tools-extra/clangd/Hover.cpp
+++ b/clang-tools-extra/clangd/Hover.cpp
@@ -1631,6 +1631,8 @@ void parseDocumentation(llvm::StringRef Input, markup::Document &Output) {
     ParagraphLines.clear();
   };

+  Output.addCodeBlock(Input.str(), "");
+  return;
   llvm::StringRef Line, Rest;
   for (std::tie(Line, Rest) = Input.split('\n');
        !(Line.empty() && Rest.empty());

Of course this will break any processing, unconditionally. This is also not "the way" of doing it, but it's a quick workaround.


backend: changes needed to prevent disabled tags to be applied to assets.

Affected module
Does it impact the UI, backend or Ingestion Framework?
Backend
Describe the bug
A clear and concise description of what the bug is.
Currently, users are able to search and assign the disabled tags to assets. Need backend changes to prevent that.
To Reproduce
Screenshots or steps to reproduce
Expected behavior
A clear and concise description of what you expected to happen.
User should not be able to search or assign the Tags that are disabled or comes under disabled Classification.
Version:

OS: [e.g. iOS]
Python version:
OpenMetadata version: [e.g. 0.8]
OpenMetadata Ingestion package version: [e.g. openmetadata-ingestion[docker]==XYZ]

Additional context
Add any other context about the problem here.

tracking here #10198


Show loading with loading new map markers

Old markers & paths module would show a spinner when loading markers for a map.  The new module doesn't do this and it probably should.

This has been taken care of and will be included in the next prerelease.


Add API for triggering actions from content operations

With the new UINavigationItem support for HUBViewModel, it's easy to add navigation bar items to a view in a content operation. However, since the content operation will be the one creating the buttons, we should also make it easy for it to be able to trigger actions.
Implementation suggestion A
Add a HUBContentOperationActionPerformer protocol, that gives it an actionDelegate that it can use to perform an action (very similar to how HUBComponentActionPerformer works).
Implementation suggestion B
Refactor HUBComponentActionPerformerDelegate into something more generic that both a component & content operation can use. For example HUBActionCenter or something (matches naming convention in NSNotificationCenter).

@krris Did you make any progress on this? Otherwise do you mind if I take it over? :)

@JohnSundell Not yet. You can take this.

@krris Got it, thanks! 👍

Implemented in https://github.com/spotify/HubFramework/pull/98


Streaming Fisheye video / pictures

Hi Amy, thanks a lot for such a amazing work !
My ultimate goal is to fly the bebop2 and stream video with the FishEye format to my computer with Python and do some real-time image processing.
I use your demoBebopVision.py and it is working great on my python3.5.
But even if I change the pictures format to jpeg_fisheye with the line :
bebop.set_picture_format('jpeg_fisheye')
I still have pictures in a jpeg classic format. Reading the Bebop doc, I am guessing that it is impossible to record a video with the Fisheye format (only pictures).
In this issue https://github.com/amymcgovern/pyparrot/issues/49#issuecomment-411101707, you suggest that it is possible to save the current image.

You just want to save a photo from the camera? Easy. Just ask it for the current image at the time and then save it.

The problem is that the stream opened with Ffmpeg is a video and so it is impossible to use the Fisheye format. So I want to avoid using video but picture instead.
I implemented the take_picture function for Bebop, which is working fine with Fisheye format when I check the files in the Bebop with my phone. Now I need to find a way to receive them on Python. I tried to write the Bebop functions I need with the help of class MamboGroundcam but I couldnot make them work.
And so simple first question, how can I receive a single picture and not the full stream opened with Ffmpeg ? How can I transfer files saved on the Bebop to my computer ?
Second question, do you think it would it be possible to stream in Fisheye format by taking enough pictures (hopefully at least 20fps) and not a video and send them to the computer ?
I hope I am clear.
Thanks in advance for your help !
Alex

That is a very interesting idea.  I never tried using the fisheye format.  I looked through the commands in ardrone3 and don't see a download command for the photos.  Based on personal experience of flying our own bebop and using photos (outside of the autonomous stuff we do), I doubt you can get a 20 fps rate.  As for how to download it, I don't actually know.  Have you searched on the parrot development forum?

I am quite sure know that it is not possible to take a video with the Fisheye format. This format is only supported for pictures as the Parrot Developers suggest. Moreover you are right, it looks like it needs a long time to take and save pictures on the bebop so I do not think either that it would be possible to take pictures with 20fps rate... I am going to have a try anyway, I'll let you know.
I have implemented a "real-time" (delay ~300/400ms) image processing on the stream of the bebop. For that, I had a lot of issues when I was processing the image in the UserVision callback function like you suggested. So I process now the image ouput of the line img = cv2.imread(self.file), in the _buffer_vision function, from the class DroneVisionGUI. It is not proper I guess but still helpfull to start. I will have a look to improve this too.
Ref to the Parrot SDK doc, it seems that the libARDataTransfer allows us to transfer data saved in the Bebop. Have you ever try to anything like this ?

Download pictures and videos
Once the picture or video has been taken, the Bebop stores it on its internal memory. Pictures are stored in internal_000/Bebop_Drone/media/.
To get the pictures, you can:

simply do a ftp request:
- port: 21
- login: “anonymous”
- no password
use libARDataTransfer which provides an abstraction of the ftp

Here is how to do it with libARDataTransfer.
libARDataTransfer lets you get a list of all stored medias quite quickly. It also provides you a way to enrich the list of medias with their thumbnails. It also gives you the ability to download the media.

Thanks for your work
Alex

If it is ftp, it works like the mambo and we could adapt the mambo interface.  They broke the mambo interface on their last firmware upgrade though.  But the code to do essentially that is in the mambo and would be really easy to adapt.

I am quite sure know that it is not possible to take a video with the Fisheye format.

Actually it is quite possible to change the video output of the drone to a different format. Thanks to this hacking guide we know it is. As you can see in section "4.4.5 Custom camera settings" it is possible to change the FOV of the camera as well as the resolution.
Utilising the "dragon-prog" program which basically controls your drone you can adjust some settings including the FOV. However unfortunately since firmware "3.3.0" those options no longer exist because parrot decided to remove them :/ So you will have to downgrade to "3.2.0" to re-enable those settings.
How to downgrade:
Before you change anything I have to warn you that I did not try this myself yet and I can't guarantee that this will work so please keep that in mind if you choose to downgrade. It is also worth taking a look in at section "5.4" in the bebop hacking guide.

Download 3.2.0 Firmware for Bebop2 from this link

If you have a Bebop1 use this link

Use a USB Stick to downgrade (only bebop2)

I am not sure if this will work but its probably worth to give it a try

Format a USB Drive with FAT32 and put the file on the stick

make sure this is the only file on the stick

Connect the USB stick to your bebop (you will require a microusb to usb cable)
It should automatically downgrade to "3.2.0" and could take up to 15 min or so

Manually downgrading

Rename the file to bebop2_update.plf (or bebop1 if you use one)
Plug the bebop into your PC via a Micro-USB cable
Use File-Zilla to connect to <IP_ADDRESS>
Drop the file to internal_000 and close File-Zilla
Connect to the drone either via telnet or adb-shell. (under windows use something like putty)
telnet <IP_ADDRESS> or
adb connect <IP_ADDRESS>:9050
Then run the command mount -o remount ,rw / which will make the filesystem writable
Open the dgwl.txt file in vi: vi /bin/updater/dgwl.txt
add the version 3.2.0 to the file
Then start the update /bin/updater/updater_scan.sh /data/ftp/internal_000

Set the video resolution an FOV

If the downgrade works connect to the drone using telnet or adb shell und run this command /usr/bin/dragon-prog -c 1280x3072 -s 1024x600 -V 140. It will set the FOV to 140°

NOTE: The newest version of free-flight probably won't work anymore and you will have to search for an older one.


Extension point for localizations uses languageNameLocalized but yo code uses localizedLanguageName

Extension point for localizations uses languageNameLocalized property for the localized language name.
When using yo code to generate a language pack, localizedLanguageName is used instead.
All the published language packs use localizedLanguageName as well.
We have already updated our code to consume the property used by the published language packs.
The extension point for localizations should be updated to use localizedLanguageName as well.
Why is this a problem if we dont update the extension point?

Extension authors that generate the langauge pack using yo code will not get any description on the property on hover (low impact)
Extension authors creating the language pack from scratch and using the snippets to generate the contribution section will end up using the wrong property name (medium impact)

This wasnt much of a problem before as we didnt use this property in the product. But from 1.24 onwards we do use this property. Therefore, ensuring new language packs use the right property name is important
cc @sandy081 @dbaeumer

Fixed with https://github.com/Microsoft/vscode/commit/68ffa00e03677fdb143ae138daab166b3dc05d4d
Note to verifier:

Hover on the localizedLanguageName property in the package.json file of any of the language packs in the vscode-loc repo. In stable build of 1.23 you wont see any text. In 1.24 you should see text describing the property.
In a sample test extension, create a localizations contribution and use snippets from the completion list to create an entry. The resulting snippet will have languageNameLocalized  in the stable build of 1.23 and should have localizedLanguageName in 1.24


Fixed by https://github.com/slsa-framework/example-package/commit/91e7887f650bed74309808fd8d09e120e0fd872b
I think maybe the regex to switch over provenance names over-applied

Repo: https://github.com/slsa-framework/example-package/tree/main
Run: https://github.com/slsa-framework/example-package/actions/runs/4575766561
Workflow file: https://github.com/slsa-framework/example-package/tree/main/.github/workflows/e2e.go.schedule.main.noldflags-multi-uses.slsa3.yml
Workflow runs: https://github.com/slsa-framework/example-package/actions/workflows/e2e.go.schedule.main.noldflags-multi-uses.slsa3.yml
Trigger: workflow_dispatch
Branch: main
Date: Fri Mar 31 13:59:05 UTC 2023
Tests are passing now. Closing this issue.

Thanks @asraa for the fix!


Support for multiple sub-domains?

Hi
We use 2 different sub-domains based but one ZenDesk instance
How hard would it be to cater for more than one sub-domain?
Thanks

Have you tried installing the app twice with two different names? One for each subdomain/api key combo?
I don't think the actual handling of data from two subdomains would be a problem. The issues would likely arise from the settings configuration, that is managing an N number of subdomains/api keys in a Zendesk App fashion.

I was able to install a second copy of the app and provide a new subdomain and api key. I would recommend doing that for the time being :)

Additionally, I just cut a new release that includes an updated app header that displays the subdomain as a link to the Chargify site. This, combined with the distinct app name used when installing the second instance should help your users distinguish between the two Chargify apps.
https://github.com/delivered/chargify-zendesk/releases/tag/1.3.0

thanks very much - works well for me


Add sample to illustrate the use of CLU

Description
As LUIS will soon be retired, it could be useful to have a sample that illustrates how to configure a bot to use the new Custom Language Understanding (CLU) resource.
Describe the solution you'd like
A bot sample configured with CLU.
Describe alternatives you've considered
Create a new sample or update the existing CoreBot that is using LUIS.

Closing as a sample like the one asked by this issue was found in:
https://github.com/Azure-Samples/cognitive-service-language-samples/tree/main/CoreBotWithCLU


Fix: RTL issues

Description
As we know, we always have issues related with the RTL directionality. At this moment, the current implementation of List, Checkbox or Blockquote, force the direction to be LTR, even if the system language is a RTL.
To test this i use some languages as hebrew or arabic that are RTL (as far i know)
Before these changes

After these changes

Related Issues
Fix #1928

[ ] ✨ New feature: Adds new functionality without breaking existing features.
[x] 🛠 Bug fix: Resolves an issue without altering current behavior.
[ ] 🧹 Code refactor: Code restructuring that does not affect behavior.
[ ] ❌ Breaking change: Alters existing functionality and requires updates.
[ ] 🧪 Tests: Adds new tests or modifies existing tests.
[ ] 📝 Documentation: Updates or additions to documentation.
[ ] 🗑 Chore: Routine tasks, or maintenance.
[ ] ✅ Build configuration change: Changes to build or deploy processes.

Suggestions
We really need to avoid harcode the widgets on the editor.
I'll try to separate the logic to another file and make more extensible soon

ok how can add button ltr or rtl

It doesn't work, watch the video, its ontap only works as if it were in the ltr position
https://github.com/user-attachments/assets/ccd43be3-9977-48ee-b057-5ff0580147fa


Journal can be moved to other inventories with hotkey

I was playing around with this plugin on a server, and I noticed this bug. I made a plugin that restricts putting the dragon egg into ender chests and ran into the same bug, so I wanted to share my solution. I made #1619 to fix it, this is just the bug report so you can reproduce the issue.
What is your Quests version / build number (do not say "latest")?
Not sure, it was on a server where I am not an admin, but looking at the source code, the bug still appears to be there.
Describe the problem and how to replicate it. Any console errors to post using a pastebin?
Quest journals can be put into inventories like chests, ender chests, furnaces, etc. To reproduce, put the journal in any hotbar slot and press the hotkey that goes along with it, while hovering over any item slot in the target inventory. The journal will swap places with the item in the target slot (if any). The current implementation of the InventoryClickEvent only handles the current item being interacted with, evn.getCurrentItem(). It does not consider the possibility of hotkeying, where the current item is the one being hovered over, not the one in the hotbar.

Thanks for your submission, but creating a separate issue was not necessary. Closing.


Public address addition

Creates a new command for the addition of public addresses to an existing person.
Fixes #24, #96, #99

Also fixes #23


api/search/suggest?querytext='*' returns empty result using azure AD authention

Iam calling the search api "_api/search/suggest?querytext='*" using httpclient in azure functions. Authentication is done via azure ad application. Application permissions sites.fullcontrol is provided. But when ever i tried to call this suggest api, it returns empty results.
i can able to retreive the results of suggest api using username and password but using the azure ad app auth it gives the empty results.
whether we can able to call this suggest api using application permissions set in azure ad ? kinldy let me know if there are any alternatives

I believe that's by design. The Search API implements security trimming for the current user. When you are using an app permission, there is no context of the user and thus, all results are security trimmed.
/cc @wobba to confirm...

It's not security trimmed really, but it blocks anonymous calls, and as @andrewconnell mentions it does relay on a user context to execute. So by design. Also, searching using app-only permissions is super scary imo, as you have access to absolutely all content. I'd be very very careful of granting search rights to an app-only application.


For safety: Detect duplicate defitions of labels

Currently the latest definition of a label wins, but I don't quite see a usecase where this behavior is needed, I rather think it's a safety hazard most of the time.
Therefore, I think it would be better to reject programs with duplicate label definitions (and maybe reintroduce them later with a more explicit design).

Fixed in b40c8d50b63c2d786a7ed1e64f903dabab991ced. This is something I've been meaning to get around to but forgot, so thanks for reminding me :3


Ability to use the stonecutter on more then just stone

Hello, I have this feature suggestion that I'd think would be nice QoL for people like me who like efficiency and are just a tad bit too lazy to go out and chop down another tree for just one more stair.
Essentially, the stone cutter be made to be capable of turning stuff like planks into stairs, or logs into planks, stuff like that.
I don't know if it is possible, or even in the cards, but it would sure be nice.
I also know of plugins, but they tend to not be updated too often.
I'd love to hear opinions!

This sounds good, It'll probably be a little while before I get to it cause I need to work on fixing the deployment setup first


CUI-7391 Coral.Shell.MenuBar: NVDA workaround screen layout announcement of buttons

Description
In browse mode, NVDA reads elements with display: inline-block as a single block of text. For the Shell.MenuBar, where buttons are rendered with display: inline-block, all the buttons are announced as a line, rather than one button being announced with each ArrowDown. This is the expected behavior for NVDA, and the user can exit NVDA's screen layout mode using NVDA+V keyboard shortcut. However, it may create some confusion.
A workaround may be to use display: flex on ._coral-Shell-menubar, so that the items still appear inline, but do not use display: inline-block on ._coral-Shell-menubar-item.
Related Issue
https://jira.corp.adobe.com/browse/CUI-7391
NVDA issue #11187 closed as not a bug
Motivation and Context
Make navigation of MenuBar buttons in the Shell Header more intuitive in NVDA browse mode.
How Has This Been Tested?
Tested with NVDA on Windows 10 using Chrome, Edge, and Firefox.
Types of changes

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[x] I have read the CONTRIBUTING document.

@icaraps, @indra2gurjar, @adobe/coral-spectrum, @CezCz

Can I get a review?


Can I make a public server with EPS?

I know that it sounds dumb, since it's a personal server, but is it possible to make it available for others, just like it's done in electrumx? I find EPS pretty comfortable implementation and I was wondering if it'd be possible.
I tried connecting to my electrum personal server with LAN, but it didn't seem to work. Is it exclusively for the machine that is being installed, locally? I'm asking because in line 50, it says that it can accept connections from any IP.
Thanks.

Did you definitely set host = 0.0.0. in that section of the config file you linked ?

Yes, I set it to <IP_ADDRESS>

Did you correctly input the server IP address into the client?
You could also try running netstat -l on the command line (on linux) to check if EPS has opened a port binded to <IP_ADDRESS>

I will, but what matters to me right now if it's possible to expose it over WAN.

Have you read this? https://github.com/chris-belcher/electrum-personal-server#exposure-to-the-internet
Exposure to WAN could allow anyone else out the on the internet to figure out which bitcoin addresses are yours.

Oh wait, I had totally forgot about that. I can't run EPS without having inserted some addresses/master keys first, can I? I think that on electrumx it's possible to return you the balance of any address since it keeps the txindex.

Yes that's right. ElectrumX creates a huge database contained every bitcoin address that was ever used. That's why it can synchronize any Electrum wallet without needing to configure beforehand. EPS needs to be configured beforehand but requires much much less disk space, and it much quicker to set up.

I guess that I can't configure that same setting, electrumx has, to EPS. I just face a lot of issues on my way to install electrumx and your server implementation was much more simpler than it.


[ACTOR-MODEL] Race condition occurs when adding/deleting from map in actor state.

Hi, @anthdm
I'm confused about this;
I have logics for storage(map).
1-Adding to map.
2-Deleting from map.
Green side: no race condition; Logics is splitted to two case.
Red side is causing race condition; Logics are staying in one case.
So all status only process one logic at the same time. However, one of them is causing race condition.

Old code which is raising a race condition is here:
https://github.com/abdullahb53/goRoutines/tree/main/hollywood-ws/websocket
no race condition is here: #29

Code:

// It is storing goblin-process and coressponding websocket identities.
// Also it broadcasts messages to all goblin-processes.
func (f *hodorStorage) Receive(ctx *actor.Context) {
	switch msg := ctx.Message().(type) {
	case actor.Started:
		fmt.Println("[HODOR] storage has started, id:", ctx.PID().ID)

	//----------------------------
	//-----CAUSES RACE COND.------
	//----------------------------
	case *letterToHodor:
		fmt.Println("[HODOR] message has received from:", ctx.PID())

		// Delete the incoming websocket value -
		// or add a new websocket and goblin-process_id pair.
		if msg.drop {
			delete(f.storage, msg.ws)
		} else {
			f.storage[msg.ws] = msg.pid
		}

	//------------------------------
	// RACE-COND. IS SOLVED IN HERE.
	//------------------------------
	//
	// // Delete the incoming websocket value.
	// case *deleteFromHodor:
	// 	delete(f.storage, msg.ws)

	// // Add a new websocket and goblin-process pair.
	// case addToHodor:
	// 	f.storage[msg.ws] = msg.pid
	//
	//-----------------------------
	// RACE-COND. IS SOLVED IN HERE.
	//-----------------------------

ERRORS:

Test file:

func TestHandleWebsocket(t *testing.T) {

	// Create a new engine to spawn Hodor-Storage..
	engine = actor.NewEngine()
	hodorProcessId = engine.Spawn(newHodor, "HODOR_STORAGE")

	s := httptest.NewServer(HandleFunc(GenerateProcessForWs))
	defer s.Close()

	u := "ws" + strings.TrimPrefix(s.URL, "http")
	println(u)

	// Connect to the server
	ws, err := websocket.Dial(u, "", u)
	if err != nil {
		t.Fatalf("%v", err)
	}
	defer ws.Close()

	go func(ws *websocket.Conn) {
		for {
			buf := make([]byte, 1024)
			_, err = ws.Read(buf)
			if err != nil {
				continue
			}
			// println(string(buf))
		}
	}(ws)

	for i := 0; i < 10; i++ {
		_, err := ws.Write([]byte("Some text."))
		if err != nil {
			t.Fatalf("WS Write Error: %v", err)
		}
	}

}

I mentioned about my last code which is worked. However, this code is not working.
Because i mistakenly forgot to add (*)addToHodor pointer. So addToHodor type is ignored.
func (f *hodorStorage) Receive(ctx *actor.Context) {
	switch msg := ctx.Message().(type) {
	case actor.Started:
		fmt.Println("[HODOR] storage has started, id:", ctx.PID().ID)

	// Delete the incoming websocket value.
	case *deleteFromHodor:
		delete(f.storage, msg.ws)

	// Add a new websocket and goblin-process pair.
	case *addToHodor:
		f.storage[msg.ws] = msg.pid

The context is not safe to use inside other goroutines.


cmd/compile: go tool compile could not import fmt

What version of Go are you using (go version)?

$ go version
go version go1.20.1 darwin/amd64

Does this issue reproduce with the latest release?
What operating system and processor architecture are you using (go env)?
go env Output
$ go env
GO111MODULE=""
GOARCH="amd64"
GOBIN=""
GOCACHE="/Users/10043479/Library/Caches/go-build"
GOENV="/Users/10043479/Library/Application Support/go/env"
GOEXE=""
GOEXPERIMENT=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="darwin"
GOINSECURE=""
GOMODCACHE="/Users/10043479/go/pkg/mod"
GONOPROXY=""
GONOSUMDB=""
GOOS="darwin"
GOPATH="/Users/10043479/go"
GOPRIVATE=""
GOPROXY="https://proxy.golang.org,direct"
GOROOT="/usr/local/go"
GOSUMDB="sum.golang.org"
GOTMPDIR=""
GOTOOLDIR="/usr/local/go/pkg/tool/darwin_amd64"
GOVCS=""
GOVERSION="go1.20.1"
GCCGO="gccgo"
GOAMD64="v1"
AR="ar"
CC="clang"
CXX="clang++"
CGO_ENABLED="1"
GOMOD="/dev/null"
GOWORK=""
CGO_CFLAGS="-O2 -g"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-O2 -g"
CGO_FFLAGS="-O2 -g"
CGO_LDFLAGS="-O2 -g"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -arch x86_64 -m64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -fdebug-prefix-map=/var/folders/6r/y_jqv72j6mlctgk7_k_lkt_0v3s_6z/T/go-build4156745098=/tmp/go-build -gno-record-gcc-switches -fno-common"
GOROOT/bin/go version: go version go1.20.1 darwin/amd64
GOROOT/bin/go tool compile -V: compile version go1.20.1
uname -v: Darwin Kernel Version 21.6.0: Wed Aug 10 14:28:23 PDT 2022; root:xnu-8020.141.5~2/RELEASE_ARM64_T6000
ProductName:	macOS
ProductVersion:	12.5.1
BuildVersion:	21G83
lldb --version: lldb-14<IP_ADDRESS>
Apple Swift version 5.7.2 (swiftlang-<IP_ADDRESS>.5 clang-14<IP_ADDRESS>)

What did you do?
package main

import "fmt"

func main() {
	fmt.Println(1)
}

I wrote a simple Go program and ran "go run" and "go build", both of which succeeded and produced the expected result. However, I encountered a problem when running "go tool compile -S ./main.go".
What did you expect to see?
I expected the "go tool compile -S ./main.go" command to output the result normally.
What did you see instead?
go tool compile -S ./main.go
./main.go:3:8: could not import fmt (file not found)

hello @chimission,
the expectation is that when users want to build Go code they will use "go build" as opposed to running "go tool compile" directly. The command line flags and APIs for "go tool compile" are complicated and tend to change from release to release. Better to let the "go" command invoke the compiler .
In the specific case of getting "-S" output, you can use
$ go build -gcflags=-S main.go

for that. If you want to see the specifics of how the go command is invoking the compiler, try running your build with "-x -work", then look at the transcript:
$ go build -x -work main.go 1> transcript.txt 2>&1
$

If you look at the transcript, you'll see that the Go command is passing in a config file that tells the compiler where to read the export data for the "fmt" package  (among others).