Support max_recv_queue_length param.

Codecov Report
Base: 43.48% // Head: 43.49% // Increases project coverage by +0.00% :tada:

Coverage data is based on head (2f34022) compared to base (9dd7966).
Patch coverage: 0.00% of modified lines in pull request are covered.

Additional details and impacted files
@@            Coverage Diff             @@
##           lee/uisee     #379   +/-   ##
==========================================
  Coverage      43.48%   43.49%
==========================================
  Files            117      117
  Lines          35197    35203    +6
==========================================
+ Hits           15305    15311    +6
  Misses         19892    19892

Impacted Files
Coverage Δ

src/mqtt/protocol/mqtt/mqtt_quic.c
0.00% <0.00%> (ø)

src/core/tcp.c
77.36% <0.00%> (-1.58%)
:arrow_down:

src/sp/transport/tcp/tcp.c
71.04% <0.00%> (-1.35%)
:arrow_down:

src/supplemental/http/http_conn.c
70.14% <0.00%> (-0.57%)
:arrow_down:

src/supplemental/tls/tls_common.c
72.72% <0.00%> (-0.45%)
:arrow_down:

src/supplemental/websocket/websocket.c
62.68% <0.00%> (-0.22%)
:arrow_down:

src/sp/transport/inproc/inproc.c
79.16% <0.00%> (ø)

src/supplemental/http/http_server.c
40.57% <0.00%> (+0.42%)
:arrow_up:

src/core/dialer.c
84.51% <0.00%> (+1.25%)
:arrow_up:

src/sp/protocol/bus0/bus.c
96.20% <0.00%> (+1.42%)
:arrow_up:

... and 3 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Bot.logout was deprecated

Rationale
After discord.py 1.7 update, Bot.logout was deprecated. This warning keeps popping up.
C:\Users\sarah\AppData\Local\Programs\Python\Python39-32\lib\site-packages\discord\ext\commands\core.py:85:
 DeprecationWarning: logout is deprecated, use Client.close instead.
    ret = await coro(*args, **kwargs)

Summary of changes made
jsk_shutdown was using bot.logout so I changed it to bot.close
Checklist

[x] This PR changes the jishaku module/cog codebase

[ ] These changes add new functionality to the module/cog
[x] These changes fix an issue or bug in the module/cog
[x] I have tested that these changes work on a production bot codebase
[ ] I have tested these changes against the CI/CD test suite
[ ] I have updated the documentation to reflect these changes

[ ] This PR changes the CI/CD test suite

[ ] I have tested my suite changes are well-formed (all tests can be discovered)
[ ] These changes adjust existing test cases
[ ] These changes add new test cases

[ ] This PR changes prose (such as the documentation, README or other Markdown/RST documents)

[ ] I have proofread my changes for grammar and spelling issues
[ ] I have tested that any changes regarding Markdown/RST syntax result in a well formed document

CI is failing but this is due to the change in version locking in d.py 2.0


Glue with the main Android activity or document how to achive that

This is a suggested enchancement.
It would be very useful for people writing applications that use platform-specific features to communicate with Android via NDK interface. In order to handle intents or access features such as USB the application should glue with the main activity.
We may either provide such functionality out of the box or provide documentation on how to achieve the same goal. In the manner as Rust Flutter Bridge did that in their docs (disclaimer: it doesn't work correctly in FRB).

Yeah, it would be nice to have some guidance on the NDK.
We aim to keep our documentation clean and concise, avoiding sections that can quickly become outdated or inaccurate. However, I believe compact guides for the NDK could fit well within the FAQ section. Any PR contributions for this would be greatly appreciated.


Update shared-key-authorization-prevent.md

az storage account show --name  --resource-group  --query "allow-shared-key-access" should be changed ti allowSharedKeyAccess

@pauljewellmsft

Can you review this PR?
IMPORTANT: When this content is ready to merge, you must add #sign-off in a comment or the approval may get overlooked.

NOTE: All the lines above the metadata must be removed.
#label:"aq-pr-triaged"
@MicrosoftDocs/public-repo-pr-review-team

Thank you @pauljewellmsft


Convoy in a mesos cluster- How to move volume with containers to different machine?

So, i have two slaves both of convoy service running.
If i execute: sudo docker run -it -v testvolume:/testvolume --volume-driver=convoy ubuntu in slave 1, It creates testvolume and attach it to the container.
But, if i now execute the same command in slave 2, it creates another volume of the same name, but different id
How can i move volume with container from machine to machine using convoy?

You can use NFS, mount the NFS to the convoy managed volume directory(vfs.path), then you can use the same volume by indicate the same volume name between hosts.


BUG: Login/Sign up page not Responsive

Is there an existing issue for this?

[X] I have searched the existing issues

What happened?
Login/Sign up is not responsive in small devices .

Record

[X] I agree to follow this project's Code of Conduct
[X] I'm a GSSOC'24 contributor
[X] I want to work on this issue

@anuragverma108 assign me!


Added ability to use  tag

closes #4933

allows truncating your blog entries with <!--more--> tag so that only the first part of certain posts are displayed on the homepage.
follows same structure as wordpress more tag to keep the learning curve low for transitioning from WP to Ghost
theme's don't need to change anything for this to take effect, checks if post _.contains a <!--more--> tag
if a <!--more--> tag exists, it supersedes a {{content words="20"}} or {{content characters="256"}} tag
if a <!--more--> tag does not exist, it falls back to what the theme has set.

Closing this for the reasons explained in my comment on the issue: https://github.com/TryGhost/Ghost/issues/4933#issuecomment-84364207

Thanks for this - I just patched my personal Ghost with this patch.
I think being able to have control over the content that goes before the "jump" and the content that goes after "the jump" is essential to anyone who really cares about the appearance of their writing. I'm surprised that the Ghost team doesn't see this.


Rework Event.SetData, require data content encoding

fixes #371

Changed event.SetData(interface{}) to event.SetData(interface{}, contenttype)
Kept Drop event.SetContentType()

This forces data to always be set with the content type.
I did not disallow changing content type on the fly, because if the user wants to corrupt the outbound request, then ... I guess that is what they wanted to do.
As a side effect, we will drop event.Data. Event will have the following form FROM:
type Event struct {
	Context     EventContext
	Data        interface{}
	DataEncoded bool
	DataBinary  bool
	FieldErrors map[string]error
}

TO:
type Event struct {
	Context     EventContext
	DataEncoded []byte
	DataBinary  bool
	FieldErrors map[string]error
}

Also, if you prefer, I like more SetData(contentType, data)

Also fixes #366


Just use the simple beauty of Box

Overview

PR Checklist

[ ] Related to designs:
[ ] Related to JIRA ticket: ABC-123
[ ] I have run this code to verify it works
[ ] This PR includes unit tests for the code change

🚀 Styleguide deploy preview ready!https://60268dbc1ee8f0eabf198fe8--gamut-preview.netlify.appDeploy Logs

📬Published Alpha Packages:@codecademy/gamut-labs@9.3.5-alpha.391ffd.0@codecademy/styleguide@25.2.5-alpha.391ffd.0


fix: revert submodule stuff

Codecov Report

Merging #39 (178ace5) into main (211f951) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main      #39   +/-   ##
=======================================
  Coverage   91.70%   91.70%
=======================================
  Files          68       68
  Lines        1182     1182
  Branches      153      153
=======================================
  Hits         1084     1084
  Misses         98       98

Flag
Coverage Δ

unittests
91.70% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

src/maps/index.ts
0.00% <ø> (ø)

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


🐛 [Immich] Search bar and face recognition does not work

Description
Hello,
I have installed immich on my homeassistant installation on a raspberry pi 4 with 4BG of RAM.
So far the installation works with an external postngres 15 database. I had issues using Immich internal database, somehow it would fail to create and then immich wont start.
When I check the logs on Homeassistant I see a lot of error especially after running the job face recognition.
I was very interested to learn what was the issue, but I lack knowledge so it was not easy.
I did a fresh installation of Immich on a debian 12 server, which happened to buy recently. I was thinking in moving everything to this small machine to have a better experience with homeassistant. It is a small pc with N100 intel cpu and 16GB of ram.
I noticed that the installation of Immich on debian had no issues. Everything seems to work fine and the face recognation works perfectly. There is "SEARCH" bar which for some reason does not appear in immich installed on HA.
There is a page showing people.

But I don't see the search bar on the Immich addon in HA

My initial suspicion was that [immich_machine_learning] container is not working in the instance installed in HA but when looking at the error loge seems to be more related to the immich_typesense container not starting.
Anyway I am no expert on this but clearly the error logs in the immich instance on HomeAssistant show some issues. Could you have a look at it?
Also my request would be, could you add a configuration option especially for homeassistant installation on arm64 that can either include or disable the immich_machine_learning docker? It would help me a lot since I dont need machine learning docker to be running and eating RAM on homeassistant. I can configurare immich on HA to use an exteranal url for machine learning and run this container in a powerful machine. The powerful machine runs periodically every day 4-5 hours.

Reproduction steps
Start Immich on HomeAssistant.
Wait for it to start
Upload pictures.
Check Logs tab in HomeAssistant

Addon Logs
}

[Nest] 1275  - 10/14/2023, 4:24:06 PM   ERROR [JobService] Unable to run job handler (recognizeFaces/recognize-faces): Error: Typesense multi-search error: 404 - Not found.
[Nest] 1275  - 10/14/2023, 4:24:06 PM   ERROR [JobService] Error: Typesense multi-search error: 404 - Not found.
    at TypesenseRepository.asResponse (/app/immich/server/dist/infra/repositories/typesense.repository.js:253:19)
    at TypesenseRepository.searchFaces (/app/immich/server/dist/infra/repositories/typesense.repository.js:233:21)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async PersonService.handleRecognizeFaces (/app/immich/server/dist/domain/person/person.service.js:210:38)
    at async /app/immich/server/dist/domain/job/job.service.js:109:37
    at async Worker.processJob (/app/immich/server/node_modules/bullmq/dist/cjs/classes/worker.js:346:28)
    at async Worker.retryIfFailed (/app/immich/server/node_modules/bullmq/dist/cjs/classes/worker.js:531:24)
[Nest] 1275  - 10/14/2023, 4:24:06 PM   ERROR [JobService] Object:
{
  "id": "dd97319c-39d1-45b1-8fb1-55762d30362b"
}

[Nest] 1275  - 10/14/2023, 4:24:06 PM   ERROR [JobService] Unable to run job handler (recognizeFaces/recognize-faces): Error: Typesense multi-search error: 404 - Not found.
[Nest] 1275  - 10/14/2023, 4:24:06 PM   ERROR [JobService] Error: Typesense multi-search error: 404 - Not found.
    at TypesenseRepository.asResponse (/app/immich/server/dist/infra/repositories/typesense.repository.js:253:19)
    at TypesenseRepository.searchFaces (/app/immich/server/dist/infra/repositories/typesense.repository.js:233:21)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async PersonService.handleRecognizeFaces (/app/immich/server/dist/domain/person/person.service.js:210:38)
    at async /app/immich/server/dist/domain/job/job.service.js:109:37
    at async Worker.processJob (/app/immich/server/node_modules/bullmq/dist/cjs/classes/worker.js:346:28)
    at async Worker.retryIfFailed (/app/immich/server/node_modules/bullmq/dist/cjs/classes/worker.js:531:24)
[Nest] 1275  - 10/14/2023, 4:24:06 PM   ERROR [JobService] Object:
{
  "id": "68ae7512-449a-4d3e-98e6-70a1cc5c8181"
}

[Nest] 1275  - 10/14/2023, 4:24:06 PM   ERROR [JobService] Unable to run job handler (recognizeFaces/recognize-faces): Error: Typesense multi-search error: 404 - Not found.
[Nest] 1275  - 10/14/2023, 4:24:06 PM   ERROR [JobService] Error: Typesense multi-search error: 404 - Not found.
    at TypesenseRepository.asResponse (/app/immich/server/dist/infra/repositories/typesense.repository.js:253:19)
    at TypesenseRepository.searchFaces (/app/immich/server/dist/infra/repositories/typesense.repository.js:233:21)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async PersonService.handleRecognizeFaces (/app/immich/server/dist/domain/person/person.service.js:210:38)
    at async /app/immich/server/dist/domain/job/job.service.js:109:37
    at async Worker.processJob (/app/immich/server/node_modules/bullmq/dist/cjs/classes/worker.js:346:28)
    at async Worker.retryIfFailed (/app/immich/server/node_modules/bullmq/dist/cjs/classes/worker.js:531:24)
[Nest] 1275  - 10/14/2023, 4:24:06 PM   ERROR [JobService] Object:
{
  "id": "e1aab308-4ac6-49aa-996b-1c41258df3e4"
}

[Nest] 1275  - 10/14/2023, 4:24:06 PM   ERROR [JobService] Unable to run job handler (recognizeFaces/recognize-faces): Error: Typesense multi-search error: 404 - Not found.
[Nest] 1275  - 10/14/2023, 4:24:06 PM   ERROR [JobService] Error: Typesense multi-search error: 404 - Not found.
    at TypesenseRepository.asResponse (/app/immich/server/dist/infra/repositories/typesense.repository.js:253:19)
    at TypesenseRepository.searchFaces (/app/immich/server/dist/infra/repositories/typesense.repository.js:233:21)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async PersonService.handleRecognizeFaces (/app/immich/server/dist/domain/person/person.service.js:210:38)
    at async /app/immich/server/dist/domain/job/job.service.js:109:37
    at async Worker.processJob (/app/immich/server/node_modules/bullmq/dist/cjs/classes/worker.js:346:28)
    at async Worker.retryIfFailed (/app/immich/server/node_modules/bullmq/dist/cjs/classes/worker.js:531:24)
[Nest] 1275  - 10/14/2023, 4:24:06 PM   ERROR [JobService] Object:
{
  "id": "83c676d2-315c-4247-8c84-06ec9b9f2ae4"
}

[Nest] 1275  - 10/14/2023, 4:24:06 PM   ERROR [JobService] Unable to run job handler (recognizeFaces/recognize-faces): Error: Typesense multi-search error: 404 - Not found.
[Nest] 1275  - 10/14/2023, 4:24:06 PM   ERROR [JobService] Error: Typesense multi-search error: 404 - Not found.
    at TypesenseRepository.asResponse (/app/immich/server/dist/infra/repositories/typesense.repository.js:253:19)
    at TypesenseRepository.searchFaces (/app/immich/server/dist/infra/repositories/typesense.repository.js:233:21)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async PersonService.handleRecognizeFaces (/app/immich/server/dist/domain/person/person.service.js:210:38)
    at async /app/immich/server/dist/domain/job/job.service.js:109:37
    at async Worker.processJob (/app/immich/server/node_modules/bullmq/dist/cjs/classes/worker.js:346:28)
    at async Worker.retryIfFailed (/app/immich/server/node_modules/bullmq/dist/cjs/classes/worker.js:531:24)
[Nest] 1275  - 10/14/2023, 4:24:06 PM   ERROR [JobService] Object:
{
  "id": "a4410ee9-9ba8-462c-842f-19c56d3067cc"
}

[Nest] 1275  - 10/14/2023, 4:24:06 PM   ERROR [JobService] Unable to run job handler (recognizeFaces/recognize-faces): Error: Typesense multi-search error: 404 - Not found.
[Nest] 1275  - 10/14/2023, 4:24:06 PM   ERROR [JobService] Error: Typesense multi-search error: 404 - Not found.
    at TypesenseRepository.asResponse (/app/immich/server/dist/infra/repositories/typesense.repository.js:253:19)
    at TypesenseRepository.searchFaces (/app/immich/server/dist/infra/repositories/typesense.repository.js:233:21)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async PersonService.handleRecognizeFaces (/app/immich/server/dist/domain/person/person.service.js:210:38)
    at async /app/immich/server/dist/domain/job/job.service.js:109:37
    at async Worker.processJob (/app/immich/server/node_modules/bullmq/dist/cjs/classes/worker.js:346:28)
    at async Worker.retryIfFailed (/app/immich/server/node_modules/bullmq/dist/cjs/classes/worker.js:531:24)
[Nest] 1275  - 10/14/2023, 4:24:06 PM   ERROR [JobService] Object:
{
  "id": "65a8f2e5-5be2-4767-8ba2-09e982ebe368"
}

[Nest] 1275  - 10/14/2023, 4:24:07 PM   ERROR [JobService] Unable to run job handler (recognizeFaces/recognize-faces): Error: Typesense multi-search error: 404 - Not found.
[Nest] 1275  - 10/14/2023, 4:24:07 PM   ERROR [JobService] Error: Typesense multi-search error: 404 - Not found.
    at TypesenseRepository.asResponse (/app/immich/server/dist/infra/repositories/typesense.repository.js:253:19)
    at TypesenseRepository.searchFaces (/app/immich/server/dist/infra/repositories/typesense.repository.js:233:21)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async PersonService.handleRecognizeFaces (/app/immich/server/dist/domain/person/person.service.js:210:38)
    at async /app/immich/server/dist/domain/job/job.service.js:109:37
    at async Worker.processJob (/app/immich/server/node_modules/bullmq/dist/cjs/classes/worker.js:346:28)
    at async Worker.retryIfFailed (/app/immich/server/node_modules/bullmq/dist/cjs/classes/worker.js:531:24)
[Nest] 1275  - 10/14/2023, 4:24:07 PM   ERROR [JobService] Object:
{
  "id": "41399858-f19f-4275-b72b-b4aa7b6525e7"
}

Architecture
aarch64
OS
HAos

Hi,
Wow thanks for all the infos !
Someone has everything set fine in this thread : https://github.com/alexbelgium/hassio-addons/issues/933
There is several options that you could try :
"DISABLE_MACHINE_LEARNING": true/false
"MACHINE_LEARNING_WORKERS": number of workers should be low as uses lots of ram
"MACHINE_LEARNING_WORKER_TIMEOUT": should be rather high
"TYPESENSE_ENABLED": true/false
Perhaps one of these could help plus the other thread might help ?
In theory the first option should totally disable the function. Thanks !

Many thanks @alexbelgium
So solution was in front of my eyes but I did not see it. in the configuration part in HomeAssistant Addon I should have enabled first the option: Show unused optional configuration options
I was able

Great! Thanks for all the details it will help other people too. Have a nice day


(maint) Fix (acceptance|integration)_tests.sh

Typically a bundle is already installed that includes all the gems
necessary to run Beaker based "integration" and "acceptance" tests.
So running bundle install is mostly unnecessary.
Furthermore, running this command with a gemset already installed
will write or alter the local .bundle/config, adding the line:
BUNDLE_WITHOUT: "build:test:development"
This prevents the ability to run bundle exec rake spec since the
Rake gem is loaded in the development group, resulting in an error:

bundler: failed to load command: rake (/Users/Iristyle/source/puppetlabs-dsc_lite/.bundle/gems/ruby/2.4.0/bin/rake)
Gem::Exception: can't find executable rake for gem rake. rake is not currently included in the bundle, perhaps you meant to add it to your Gemfile?
  /usr/local/opt/rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/bundler-1.15.4/lib/bundler/rubygems_integration.rb:432:in `block in replace_bin_path'
  /usr/local/opt/rbenv/versions/2.4.1/lib/ruby/gems/2.4.0/gems/bundler-1.15.4/lib/bundler/rubygems_integration.rb:452:in `block in replace_bin_path'
  /Users/Iristyle/source/puppetlabs-dsc_lite/.bundle/gems/ruby/2.4.0/bin/rake:22:in `<top (required)>'

There isn't a test gem group anymore, so remove both it and
development from the --without clause

This is not run in any of our test suites so it has no impact.  Merging.


Create single thread pool for async id service lookup

This release will include https://github.com/urbanairship/datacube/pull/66


TypeError: The added layer must be an instance of class Layer

from keras.applications import VGG16

conv_base = VGG16(weights='imagenet',
                  include_top=False,
                  input_shape=(150, 150, 3))

from keras import models
from keras import layers

model = models.Sequential()
model.add(conv_base)
model.add(layers.Flatten())
model.add(layers.Dense(256, activation='relu'))
model.add(layers.Dense(1, activation='sigmoid'))

Adding VGG16 from keras.applications with Sequential gives the below error:
TypeError: The added layer must be an instance of class Layer. Found: <tensorflow.python.keras.engine.training.Model object at 0x000002C7010E3C88>
Attached image for reference:

Currently I am using the below versions of TensorFlow and Keras-
TensorFlow: 1.11.0
Keras: 2.2.2

TensorFlow: 1.11.0
Keras: 2.2.2

Update to keras>=2.2.3, it has been fixed already.

Update keras to latest version (at least 2.2.3), this issue has been fixed already.
Also, see Issue template

Updated to 2.2.4 and it worked. Thanks for the quick help!!

I have 2.2.4 but I'm getting the error too:
import tensorflow as tf
Importing the Keras libraries and packages
from tensorflow import keras
from tensorflow.keras.models import Sequential
from keras.layers import LSTM, Dropout, Lambda, BatchNormalization
`def createModel1(input_shape=(10,4),output_shape=(5,4)):
'''
more info: https://keras.io/getting-started/sequential-model-guide/
'''
#Initialising the RNN
regressor=Sequential()

#Adding the first LSTM layer and Dropout regularisation
regressor.add(LSTM(units= 50, return_sequences= True, input_shape=input_shape))
regressor.add(Dropout(rate=0.2))`

Same issue for me, using keras==2.2.4 and tensorflow=1.13.1
from keras.layers import *
from keras.models import Sequential
from keras.applications.resnet50 import ResNet50

base_model = ResNet50(
    weights='imagenet',
    include_top=False,
    input_shape=(224, 224, 3),
    pooling='avg'
)
base_model.trainable = False

pooling = GlobalAveragePooling2D()
predictions = Dense(NB_CLS, activation='softmax')

model = tf.keras.Sequential([
  base_model,
  pooling,
  predictions
])

---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
<ipython-input-21-ccdaf5a437aa> in <module>()
     15   base_model,
     16   pooling,
---> 17   predictions
     18 ])
     19

3 frames
/usr/local/lib/python3.6/dist-packages/tensorflow/python/training/checkpointable/base.py in _method_wrapper(self, *args, **kwargs)
    440     self._setattr_tracking = False  # pylint: disable=protected-access
    441     try:
--> 442       method(self, *args, **kwargs)
    443     finally:
    444       self._setattr_tracking = previous_value  # pylint: disable=protected-access

/usr/local/lib/python3.6/dist-packages/tensorflow/python/keras/engine/sequential.py in __init__(self, layers, name)
    107     if layers:
    108       for layer in layers:
--> 109         self.add(layer)
    110
    111   @property

/usr/local/lib/python3.6/dist-packages/tensorflow/python/training/checkpointable/base.py in _method_wrapper(self, *args, **kwargs)
    440     self._setattr_tracking = False  # pylint: disable=protected-access
    441     try:
--> 442       method(self, *args, **kwargs)
    443     finally:
    444       self._setattr_tracking = previous_value  # pylint: disable=protected-access

/usr/local/lib/python3.6/dist-packages/tensorflow/python/keras/engine/sequential.py in add(self, layer)
    143       raise TypeError('The added layer must be '
    144                       'an instance of class Layer. '
--> 145                       'Found: ' + str(layer))
    146     self.built = False
    147     set_inputs = False

TypeError: The added layer must be an instance of class Layer. Found: <keras.engine.training.Model object at 0x7f17dd956978>

@yoch ,

please stop using both tf.keras and keras, they are not compatible. Choose only one.
include_top=False, means that model will be cut right after last Global Pool, so you do not need another one (GlobalAveragePooling2D)
Try this:

from keras.layers import *
from keras.models import Sequential
from keras.applications.resnet50 import ResNet50

CLASS_COUNT = 10

base_model = ResNet50(
    weights='imagenet',
    include_top=False,
    input_shape=(224, 224, 3),
    pooling='avg',
)
base_model.trainable = False

model = Sequential([
  base_model,
  Dense(CLASS_COUNT, activation='softmax'),
])

In my environment (keras=2.2.4, tensorflow-gpu=1.13.1) that works.

OK, after removing tf.keras it's work. Thank you.

Just import-
from keras.models import Sequential
& then use Sequential only.
I was doing the keras.Sequential before....   This was the reason for my error

yes,its working after removing tensorflow.keras

K.clear_session()
gc.collect()
resnet = DenseNet201(
weights='imagenet',
include_top=False,
input_shape=(224,224,3)
)
model = build_model(resnet ,lr = 1e-4)
model.summary()
i am getting the below error after running the above code..and my tensorflow version is also updated..let me know why i'm getting the error.
The added layer must be an instance of class Layer. Found: <keras.engine.training.Model object at 0x7fe0ebfbd780>

Hello i am getting an error as follows
Traceback (most recent call last):
File "model2.py", line 74, in
model.add(Conv2D(32, kernel_size = (3, 3), activation='relu', input_shape = (1,200 , 200 , 1)))
File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorflow\python\training\tracking\base.py", line 457, in _method_wrapper
result = method(self, *args, **kwargs)
File "c:\users\admin\appdata\local\programs\python\python36\lib\site-packages\tensorflow\python\keras\engine\sequential.py", line 154, in add
'Found: ' + str(layer))
TypeError: The added layer must be an instance of class Layer. Found: <keras.layers.convolutional.Conv2D object at 0x000002CAFB08F048>

here i am sharing my code also
import tensorflow
from tensorflow.keras.layers import Conv2D, MaxPooling2D
from tensorflow.keras.layers import Dense, Dropout, Flatten
import tensorflow as tf
tf.compat.v1.get_default_graph
import tensorflow
from tensorflow.keras.layers import *
import tensorflow.compat.v1 as tf
tf.disable_v2_behavior()
from tensorflow import keras
from PIL import Image
import os
from random import shuffle
import matplotlib.pyplot as plt
import numpy as np

K.clear_session()
gc.collect()
resnet = DenseNet201(
weights='imagenet',
include_top=False,
input_shape=(224,224,3)
)
model = build_model(resnet ,lr = 1e-4)
model.summary()
i am getting the below error after running the above code..and my tensorflow version is also updated..let me know why i'm getting the error.
The added layer must be an instance of class Layer. Found: <keras.engine.training.Model object at 0x7fe0ebfbd780>

I think both of us are referring to the same notebook. Firstly, change your resnet to densenet.
Secondly, you need to change your import statement.
Original import -
from tensorflow.python.keras.layers import Dense
from tensorflow.python.keras import Sequential

Replace it with -
from keras.layers import Dense
from keras import Sequential

model = allcnn()
Traceback (most recent call last):
File "", line 1, in
model = allcnn()
File "", line 30, in allcnn
model.add(GlobalAveragePooling2D)
File "/home/code/.local/lib/python3.7/site-packages/keras/engine/sequential.py", line 133, in add
'Found: ' + str(layer))
TypeError: The added layer must be an instance of class Layer. Found: <class 'keras.layers.pooling.GlobalAveragePooling2D'>

am runing the same issue


Small fee for Tumbler Cashout tx and Client Cashout tx

Cashout tx always has small fee in mainnet and it takes long time to confirm.
Tx in testnet seems to have the same problem but I have no detail data for the problem in testnet.
Investigating tx, I got a problem point for the small fee.
Problem is tx size estimation for both cashout txes.
I explain the problem point as below.

I investigated Tumbler Cashout tx and Client Cashout tx by inserting debug codes in followings.

NTumbleBit/NTumbleBit/PuzzlePromise/PromiseClientSession.cs
NTumbleBit/NTumbleBit/PuzzleSolver/SolverServerSession.cs
NTumbleBit/NTumbleBit/PuzzleSolver/SolverClientSession.cs

Tumbler Cashout tx
This is the Tumbler Cashout tx.
https://blockchain.info/tx/ff7d7c2cda3e02dd6d6984bd7019ecbaba26a4c1212ef6a8bcaa15b4c99a0c78

As see its tx, tx size is 843 bytes and fee per byte is 107.387 sat/Byte.
However, debug code derives the following data.
info: Server[0]
      CheckBlindFactors
info: Server[0]
      0.00290217 BTC/kB
CheckBlindedFactors: tx.GetVirtualSize()
83
CheckBlindedFactors: InternalState.EscrowedCoin.Redeem.Length
118
CheckBlindedFactors: InternalState.OfferTransactionFee
100124
info: Server[0]
      FulfillOffer
info: Server[0]
      0.00290217 BTC/kB
FulfillOffer: size
312
FulfillOffer: feeRate.ToString()
0.00290217 BTC/kB
FulfillOffer: feeRate.GetFee(size)
90547
FulfillOffer: fulfill.Outputs[0].Value
6809329
info: Main[0]
      Broadcaster broadcasted  b23d30f585867aa372cf16d690c2bc5bbc54fe8c98bffb5cb5c18da3a60dc7ed

debug codes: https://github.com/takaya-imai/NTumbleBit/blob/debug_code/NTumbleBit/PuzzleSolver/SolverServerSession.cs#L356
It implies that command estimatefee of bitcoind has proper value but size is very smaller than actual size.
Therefore actual fee becomes very small as following calculation.
107.387 sat/Byte = 0.00290152 BTC/kB * 100,000,000 sat / 1,000 bytes * 312 bytes / 843 bytes

This size is derived from EstimateScriptSigSize() so this might have something bug to estimate scriptsig size.
Client Cashout tx
This is the Client Cashout tx.
https://blockchain.info/tx/9db475abdc00e0b65d53fea937aa3bbb97cc0f0db403ac494287dd47b721f231

As see its tx, tx size is 354 bytes and fee per byte is 69.661 sat/Byte.
However, debug code derives the following data.
info: Main[0]
      CyclePhase.TumblerChannelEstablishment
info: Main[0]
      0.00290187 BTC/kB
CreateSignatureRequest: feeRate.ToString()
0.00290187 BTC/kB
CreateSignatureRequest: cashout.GetVirtualSize()
85
CreateSignatureRequest: fee
24665
CreateSignatureRequest: cashout.Outputs[0].Value
6765335
info: Main[0]
      Tumbler escrow broadcasted b1b96247c83de6c62b07fd8040e07b3cc849860e643d944143be67a83503f991

debug codes: https://github.com/takaya-imai/NTumbleBit/blob/debug_code/NTumbleBit/PuzzlePromise/PromiseClientSession.cs#L252
It implies that command estimatefee of bitcoind has proper value but size is very smaller than actual size.
Therefore, actual fee becomes very small as following calculation.
69.661 sat/Byte = 0.00290187 BTC/kB * 100,000,000 sat / 1,000 bytes * 85 bytes / 354 bytes

This size is derived from GetVirtualSize() in NBitcoin so this might have something bug to estimate size.

GetVirtualSize() in NBitcoin always returns 85 bytes in my NTumbleBit debug code for small fee.
$ grep GetVirtualSize -A 1 client.log
CreateSignatureRequest: cashout.GetVirtualSize()
85
--
CreateOfferRedeemTransaction: tx.GetVirtualSize()
85
--
CreateSignatureRequest: cashout.GetVirtualSize()
85
--
CreateOfferRedeemTransaction: tx.GetVirtualSize()
85
--
CreateSignatureRequest: cashout.GetVirtualSize()
85
--
CreateOfferRedeemTransaction: tx.GetVirtualSize()
85
--
CreateSignatureRequest: cashout.GetVirtualSize()
85
--
CreateOfferRedeemTransaction: tx.GetVirtualSize()
85
--
CreateSignatureRequest: cashout.GetVirtualSize()
85
--
CreateOfferRedeemTransaction: tx.GetVirtualSize()
85

have you tried since my fix on https://github.com/NTumbleBit/NTumbleBit/commit/036c2b6bb7e4805bfe236daff97b58849020fcf0 ?

mmhh wait a second, it seems to be something else, thanks for tracking it down will review carefully.

I think I fixed it can you try https://github.com/NTumbleBit/NTumbleBit/commit/f88bda2ce60eda7fdc65bcc0b9d496710ef4ee12

@NicolasDorier thanks for review! I try https://github.com/NTumbleBit/NTumbleBit/commit/f88bda2ce60eda7fdc65bcc0b9d496710ef4ee12 .

@NicolasDorier
I am testing https://github.com/NTumbleBit/NTumbleBit/commit/f88bda2ce60eda7fdc65bcc0b9d496710ef4ee12
but it looks like fixing only PuzzlePromise Part(Client Cashout) but not fixing PuzzleSolver Part(Tumbler Cashout).
Do you think that below is not needed to fix to include fulfillScript + Op.GetPushOp(offerCoin.Redeem.ToBytes()) size?
https://github.com/NTumbleBit/NTumbleBit/blob/e8b702b1d5b18a6cbf67dc9b4c81a8cc3a6c742f/NTumbleBit/PuzzleSolver/SolverServerSession.cs#L348
Similar to https://github.com/NTumbleBit/NTumbleBit/commit/f88bda2ce60eda7fdc65bcc0b9d496710ef4ee12 , I think it needs to fix as follows.
Below might have mistakes because I do not know NBitcoin grammar though.
                        Transaction fulfill = new Transaction();
                        fulfill.Inputs.Add(new TxIn(offerCoin.Outpoint));
                        fulfill.Outputs.Add(new TxOut(offerCoin.Amount, cashout));

                        var signature = fulfill.Inputs.AsIndexedInputs().First().Sign(InternalState.FulfillKey, offerCoin, SigHash.All);
                        var fulfillScript = SolverScriptBuilder.CreateFulfillScript(signature, solutions);
                        fulfill.Inputs[0].ScriptSig = fulfillScript + Op.GetPushOp(offerCoin.Redeem.ToBytes());

                        var tb = new TransactionBuilder();
                        tb.Extensions.Add(new EscrowBuilderExtension());
                        tb.AddCoins(InternalState.EscrowedCoin);
                        var size = tb.EstimateSize(fulfill, true);
                        var fee = feeRate.GetFee(size);

                        fulfill.Outputs[0].Value -= fee;

wow very nice. I can't believe I made same mistake three time in the code I just pushed a fix, can you try ?

oops, still mistake, real fix on b0f838caf89f5ce3c29f5d9ca63d31bd997ead65

thanks, I am testing https://github.com/NTumbleBit/NTumbleBit/commit/b0f838caf89f5ce3c29f5d9ca63d31bd997ead65 now.

this issue is solved.


FiOS Mobile Crash

I am attempting to get the "FiOS Mobile" application to run.  However, the applications keeps crashing.  I am able to login just fine.  The crash occurs just as it displays the channel line up.  Any insight on the issue?
Console output:
 @@@Minidump generated@@@TURNUJOnAA<!YANKED!>AAAAAAAAAAA@@@main.js:389 printMiniDump_main.js:389 (anonymous function)
main.js:389 prod: ARC
main.js:389 arc_app_name: com.verizon.fiosmobile
main.js:389 ptime: 3484
main.js:389 crash_time: Sat Nov 22 2014 00:46:32 GMT-0500 (EST)
main.js:389 ver: 38.4410.120.43
main.js:389 arc_build_tag: arc-runtime-38.4410.120.43
main.js:389 message: captured minidump
main.js:389 chrome_version: 40.0.2214.10
main.js:389 app_id: dkngdemcmgcadpopjpgpkkclnagnldgn
main.js:389 app_version: 1337
main.js:389 app_package_name: com.verizon.fiosmobile
main.js:389 runtime_name: ARChon Custom Runtime 1.2 - x86_64
main.js:389 runtime_update_url: http://localhost
main.js:389 width: 360
main.js:389 height: 672
main.js:389 is_minimized: false
main.js:389 is_maximized: false
main.js:389 is_fullscreen: false
main.js:389 runtime_updated_while_running: null
main.js:389 log_message: Bad 'android_atomic_release_cas' call at (/vendor/lib/libutils.so+0xc877)
main.js:389 arch: x86-64
main.js:389 nacl_arch: x86-64
main.js:389 os: linux
main.js:389 Crash reporting not enabled in Chrome.  Please enable it.
main.js:389 FINISHED REPORTING CRASH
main.js:389 the child process has been loaded: so_executable/umareporter
main.js:389 ChildPlugin backgroundpage:0:umareporter(so_executable) Run: 180.962ms
main.js:389 0xDE6A4C31 is not a valid instance ID.main.js:389 ChildPlugin.removemain.js:389 ChildPlugin.postExitMessage_main.js:389 ChildPlugin.handleMessageEvent_
main.js:389 ARC Window Popup: 50.887ms
main.js:389 Received a crash

This is a result of the lack of libraries/dependencies I believe and this is due to the fact that this is not a full android VM so the app crashes as a result.


my first ever contribution

thank you anuj garg and code for cause team to provide me this opportunity to contribute a open source project

Got it
On Sat, Sep 5, 2020, 23:51 Abhishek Kumar<EMAIL_ADDRESS>wrote:

@Abhishek-kumar09 requested changes on this pull request.
In src/data/contributors/nausherali.json
https://github.com/codeforcauseorg/pledge/pull/93#discussion_r483975261:

@@ -0,0 +1,10 @@
+{

"name": "Nausher Ali",
"skills": ["MERN", "Django", "Spring"],
"cause": "serve humanity ",

What a great cause to code :) Just a small suggestion.
[image: image]
https://user-images.githubusercontent.com/48255244/92311169-697a1300-efd2-11ea-94c9-9fabf2431e07.png
I think I code for serving humanity is gramatically more accurate.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/codeforcauseorg/pledge/pull/93#pullrequestreview-483071100,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ANL4VMP35MBLIISCRY4RXH3SEJ6RTANCNFSM4Q2OEZSA
.

Thanks for your PR @nausherofficial . Welcome to @codeforcauseorg.

Thanks for your PR @nausherofficial . Welcome to @codeforcauseorg.

thank you so much @Abhishek-kumar09 .


Changed name to something more appropiate

@theterminator3000 Willy Schraub is a contributor to this article and I think that's why his name is used for the example. Rather than modify his name, I changed the example to use one of our approved fictional names: Jamal Hartnett (jamal@fabrikam-fiber.com). I'm merging the PR and it should be live soon. Thank you for your contribution.


QA - Site - Product Detail Page - Product Shipping Data is not display if Product cartoon is more than 50

QA - Site - Product Detail Page - Product Shipping Data is not display if Product cartoon is more than 50.

Click on search button and go to search page.
Click on any product and go tot detail page.
Select Place Order tab and Select product Color.
Enter Qty (it should be contain more than 50 product cartoons) in Qty box.
Select Shipping Address.
Check Shipping Data.

From now onwards, validation message is going to display for it.
Ex. Maximum 10000 quantities are allowed.


FeatureTransforms hard dependency on sfx -> loadSound is annoying

Feature Description
I'd like to be able to use FeatureTransforms without sfx/libsoundfile compiled in.
Use Case
I use flashlight/wav2letter without libsndfile, so the hard dependency from FeatureTransforms to createSoundEffect means I need to patch flashlight before I can use featurization without libsndfile. I'm statically compiling flashlight, so even just refactoring to not have a call to sfx in the FeatureTransforms compile unit would be enough - no need to have any extra build flags to satisfy this need.

cc @avidov @vineelpratap @jacobkahn

I noticed only the AdditiveNoise sfx has a loadSound dependency, so for now I've patched that one out of my flashlight: https://github.com/talonvoice/flashlight/commit/c03c61186a52f191cd6629bdcceddff9ad1000a7


Unformatted legend

Unformatted legend (pure html list element) occurs when legend attribute is set to true. There is a lack of class stackedbar-legend in css.

I found a work-around to make legends show up in the right way. All I had to do was to replace the class value from the legendTemplate variable inside the Chart.StackedBar.js:
legendTemplate : "<ul class="<%=name.toLowerCase()%>-legend">...
for this one:
legendTemplate : "
...


Update ISSUE_TEMPLATE.md to cover platform differences

There are small differences between the platforms, as evident in https://github.com/adobe/brackets/issues/12864. This PR fixes that.
Could someone check that the Linux version has the menu under Help, as I don't have a GUI machine at hand.

Verified Linux too, LGTM.


use AppConfig to config jamdict

Simplify API:

People don't really use XML files to lookup, the default option to create a jamdict most likely will be DB.
jmdict, kanjidic and multikrad most likely will be in a single database.
Add util functions:

read()
parse() from xml file(s) to db file(s)

Fixed in commit 8b30d90


block.super not working?

Snippet from a stencil using inheritance:
{% block title}{{ block.super }} - Home{% endblock %}
Related snippet from the parent stencil:
<title>{% block title %}Main Title{% endblock %}</title>
I'm trying to use {{ block.super }} to insert Main Title as a prefix before  - Home,  but this does not work.
By "does not work" I mean I get a Cannot GET <my endpoint> response from Kitura, but no errors show up in the log. If I remove the line using {{ block.super }} from the stencil, everything works fine.

We have tests showing this works: https://github.com/kylef/Stencil/blob/master/Tests/StencilTests/fixtures/child-super.html#L2 https://github.com/kylef/Stencil/blob/master/Tests/StencilTests/InheritenceSpec.swift#L22-L25
Could you please share a some code example showing this problem? Or better, a failing test.

These are my full stencils:
base.stencil:

    <title>{% block title %}Around the table{% endblock %}</title>

Around the table

    {% block content %}{% endblock %}

home.stencil:
{% extends "base.stencil" %}

{% block title}{{ block.super }} - Home{% endblock %}

{% block content %}
{{ user.id }}
{{ user.name }}
{% endblock %}

In Kitura, I simply render home.stencil with the appropriate context:
router.get("/site/home") {
    request, response, next in
    defer {
        next()
    }

    let context = [
        "user": [
            "id": request.userProfile!.id,
            "name": request.userProfile!.displayName
        ]
    ]
    try response.render("home.stencil", context: context).end()
}

Is it possible this context overrides the one that includes block.super?

I modified the Stencil tests to test this exact template and the tests pass.
diff --git a/Tests/StencilTests/InheritenceSpec.swift b/Tests/StencilTests/InheritenceSpec.swift
index 6b741ae..bd92523 100644
--- a/Tests/StencilTests/InheritenceSpec.swift
+++ b/Tests/StencilTests/InheritenceSpec.swift
@@ -9,19 +9,18 @@ func testInheritence() {
     let loader = FileSystemLoader(paths: [path])
     let environment = Environment(loader: loader)

-    $0.it("can inherit from another template") {
-      let template = try environment.loadTemplate(name: "child.html")
-      try expect(try template.render()) == "Header\nChild"
-    }
-
-    $0.it("can inherit from another template inheriting from another template") {
-      let template = try environment.loadTemplate(name: "child-child.html")
-      try expect(try template.render()) == "Child Child Header\nChild"
-    }
-
     $0.it("can inherit from a template that calls a super block") {
+      let context = [
+        "user": [
+          "id": "some id",
+          "name": "some namel",
+        ],
+      ]
+
       let template = try environment.loadTemplate(name: "child-super.html")
-      try expect(try template.render()) == "Header\nChild Body"
+      let rendered = try template.render(context)
+
+      try expect(rendered.contains("Around the table - Home")).to.beTrue()
     }
   }
 }
diff --git a/Tests/StencilTests/fixtures/base.html b/Tests/StencilTests/fixtures/base.html
index 7c74ae0..53a79ec 100644
--- a/Tests/StencilTests/fixtures/base.html
+++ b/Tests/StencilTests/fixtures/base.html
@@ -1,2 +1,12 @@
-{% block header %}Header{% endblock %}
-{% block body %}Body{% endblock %}
\ No newline at end of file
+
+
+
+    <title>{% block title %}Around the table{% endblock %}</title>
+
+
+
+
Around the table

+    {% block content %}{% endblock %}
+
+
+
diff --git a/Tests/StencilTests/fixtures/child-super.html b/Tests/StencilTests/fixtures/child-super.html
index c8964ee..6113026 100644
--- a/Tests/StencilTests/fixtures/child-super.html
+++ b/Tests/StencilTests/fixtures/child-super.html
@@ -1,3 +1,8 @@
 {% extends "base.html" %}
-{% block body %}Child {{ block.super }}{% endblock %}

+{% block title %}{{ block.super }} - Home{% endblock %}
+
+{% block content %}
+{{ user.id }}
+{{ user.name }}
+{% endblock %}

Thanks! I will open an issue with Kitura then.

@svanimpe In your comment  https://github.com/kylef/Stencil/issues/107#issuecomment-293228388 you missed closing %: {% block title}.
It was printed in the Kitura log:

[2017-04-11T21:52:15.080+03:00] [ERROR] [RouterCreator.swift:206 create()] Failed to render template 'block' tag takes one argument, the block name

After adding the missing %, your example seem to be rendered properly for me.

I can't believe I missed that... I stared at that code for quite some time looking for syntax errors. facepalm
@vadimeisenbergibm How did you get that error in your log? Mine just reads
[HTTPServerRequest.swift:215 parsingCompleted()] HTTP request from=<IP_ADDRESS>; proto=http; over and over again, but no error.

@svanimpe That's OK, I hope you enjoy Kitura :)
Strange, I do get the error in the log, I just used Log.logger = HeliumLogger()

Strange indeed. I was using HeliumLogger.use() but changing that to your code didn't change much.


Flush After Presents

Flush after presents to avoid some cases of capture files with incomplete final blocks. The application logic to quit (e.g. responding to a click on an exit button) is evaluated between a present and the next Vulkan call that would be made and there is lots of code that can crash between the end of one frame's rendering and the next frame's start and between a frame's end and the clean shutdown of the process.
In the event of a clean shutdown, the C standard library is expected to flush any data we have written to our capture file and log, so our concern is with the process we are capturing crashing or being killed by the system, either in any of the logic outside the rendering portion of its main loop, or during the shutdown sequence. By selectively flushing after presents we can take care of these cases at an expected low cost and restrict our exposure to incomplete final blocks to those resulting from crashes and force-kills during the rendering of a frame.
The warning seen when running many captures through convert, compress, and optimize is:
[gfxrecon] WARNING - Incomplete block at end of file

We override the size of file buffers to be 256KB, so on average, with typical real-app captures that space presents out, these flushes will happen with a buffer that is 128KB full, which should still be a big enough buffer to amortise IO overhead, especially if a frame is large enough that many full-size flushes precede the on-average-half-size final one of each frame.
This is a recreation of PR https://github.com/LunarG/gfxreconstruct/pull/862, which was automatically closed on branch rename.

CI gfxreconstruct build queued with queue ID 26875.

CI gfxreconstruct build # 2174 running.

CI gfxreconstruct build # 2174 passed.

CI gfxreconstruct build queued with queue ID 6614.

Rebased on today's post-d3d12 introduction dev. It is a small PR so I suggest we merge it or close it. Either way we reduce our list of PRs by one.
The PR is these few lines:

        // Flush after presents to avoid capture files with incomplete final
        // blocks.
        if (thread_data->call_id_ == format::ApiCall_vkQueuePresentKHR)
        {
            file_stream_->Flush();
        }

CI gfxreconstruct build # 2332 running.

CI gfxreconstruct build # 2332 failed.

CI gfxreconstruct build queued with queue ID 6985.

CI gfxreconstruct build # 2334 running.

CI gfxreconstruct build # 2334 passed.

CI gfxreconstruct build queued with queue ID 10856.

CI gfxreconstruct build # 2376 running.

CI gfxreconstruct build # 2376 failed.

CI gfxreconstruct build queued with queue ID 35413.

CI gfxreconstruct build # 2503 running.

CI gfxreconstruct build # 2503 failed.

CI gfxreconstruct build queued with queue ID 37111.

CI gfxreconstruct build # 2509 running.

CI gfxreconstruct build # 2509 failed.

CI gfxreconstruct build queued with queue ID 47772.

CI gfxreconstruct build # 2591 failed.

CI gfxreconstruct build queued with queue ID 47822.

CI gfxreconstruct build # 2593 running.

CI gfxreconstruct build queued with queue ID 47843.

CI gfxreconstruct build # 2594 running.

I fixed the null pointer dereference.

CI gfxreconstruct build # 2594 passed.

Now the null dereference is fixed, if the review is a 'meh', feel free to close this @bradgrantham-lunarg @davidd-lunarg.

CI gfxreconstruct build queued with queue ID 59204.

CI gfxreconstruct build # 59204 cancelled.

CI gfxreconstruct build queued with queue ID 130.

CI gfxreconstruct build # 2680 running.

CI gfxreconstruct build # 2680 passed.


[Bug]: AttributeError: 'AzureOpenAIEmbeddings' object has no attribute 'embed'

Describe the bug
When using AzureOpenAI llm and embeddings, local search generates the error:
AttributeError: 'AzureOpenAIEmbeddings' object has no attribute 'embed'
Steps to reproduce
in https://github.com/microsoft/graphrag/blob/main/examples_notebooks/local_search.ipynb
set-up:
llm = AzureChatOpenAI(azure_deployment="gpt-4o", temperature=0)
text_embedder = AzureOpenAIEmbeddings(azure_deployment="text-embedding-3-large")

running:
result = await search_engine.asearch("Tell me about Agent Mercer")
results with:
AttributeError: 'AzureOpenAIEmbeddings' object has no attribute 'embed'
Expected Behavior
Answer to the question (no error)
GraphRAG Config Used
encoding_model: cl100k_base
skip_workflows: []
llm:
  api_key: ${GRAPHRAG_API_KEY}
  type: azure_openai_chat # or azure_openai_chat
  model: gpt-4o
  model_supports_json: true # recommended if this is available for your model.
  # max_tokens: 4000
  # request_timeout: 180.0
  api_base: https://asystentai.openai.azure.com/
  api_version: 2024-02-15-preview
  # organization: <organization_id>
  deployment_name: gpt-4o
  # tokens_per_minute: 150_000 # set a leaky bucket throttle
  # requests_per_minute: 10_000 # set a leaky bucket throttle
  # max_retries: 10
  # max_retry_wait: 10.0
  # sleep_on_rate_limit_recommendation: true # whether to sleep when azure suggests wait-times
  # concurrent_requests: 25 # the number of parallel inflight requests that may be made

parallelization:
  stagger: 0.3
  # num_threads: 50 # the number of threads to use for parallel processing

async_mode: threaded # or asyncio

embeddings:
  ## parallelization: override the global parallelization settings for embeddings
  async_mode: threaded # or asyncio
  llm:
    api_key: ${GRAPHRAG_API_KEY}
    type: azure_openai_embedding # or azure_openai_embedding
    model: text-embedding-3-large
    api_base: https://asystentai.openai.azure.com/
    api_version: 2024-02-15-preview
    # organization: <organization_id>
    deployment_name: text-embedding-3-large
    # tokens_per_minute: 150_000 # set a leaky bucket throttle
    # requests_per_minute: 10_000 # set a leaky bucket throttle
    # max_retries: 10
    # max_retry_wait: 10.0
    # sleep_on_rate_limit_recommendation: true # whether to sleep when azure suggests wait-times
    # concurrent_requests: 25 # the number of parallel inflight requests that may be made
    # batch_size: 16 # the number of documents to send in a single request
    # batch_max_tokens: 8191 # the maximum number of tokens to send in a single request
    # target: required # or optional

chunks:
  size: 300
  overlap: 100
  group_by_columns: [id] # by default, we don't allow chunks to cross documents

input:
  type: file # or blob
  file_type: text # or csv
  base_dir: "input"
  file_encoding: utf-8
  file_pattern: ".*\\.txt$"

cache:
  type: file # or blob
  base_dir: "cache"
  # connection_string: <azure_blob_storage_connection_string>
  # container_name: <azure_blob_storage_container_name>

storage:
  type: file # or blob
  base_dir: "output/${timestamp}/artifacts"
  # connection_string: <azure_blob_storage_connection_string>
  # container_name: <azure_blob_storage_container_name>

reporting:
  type: file # or console, blob
  base_dir: "output/${timestamp}/reports"
  # connection_string: <azure_blob_storage_connection_string>
  # container_name: <azure_blob_storage_container_name>

entity_extraction:
  ## llm: override the global llm settings for this task
  ## parallelization: override the global parallelization settings for this task
  ## async_mode: override the global async_mode settings for this task
  prompt: "prompts/entity_extraction.txt"
  entity_types: [organization,person,geo,event]
  max_gleanings: 0

summarize_descriptions:
  ## llm: override the global llm settings for this task
  ## parallelization: override the global parallelization settings for this task
  ## async_mode: override the global async_mode settings for this task
  prompt: "prompts/summarize_descriptions.txt"
  max_length: 500

claim_extraction:
  ## llm: override the global llm settings for this task
  ## parallelization: override the global parallelization settings for this task
  ## async_mode: override the global async_mode settings for this task
  # enabled: true
  prompt: "prompts/claim_extraction.txt"
  description: "Any claims or facts that could be relevant to information discovery."
  max_gleanings: 0

community_report:
  ## llm: override the global llm settings for this task
  ## parallelization: override the global parallelization settings for this task
  ## async_mode: override the global async_mode settings for this task
  prompt: "prompts/community_report.txt"
  max_length: 2000
  max_input_length: 8000

cluster_graph:
  max_cluster_size: 10

embed_graph:
  enabled: false # if true, will generate node2vec embeddings for nodes
  # num_walks: 10
  # walk_length: 40
  # window_size: 2
  # iterations: 3
  # random_seed: 597832

umap:
  enabled: false # if true, will generate UMAP embeddings for nodes

snapshots:
  graphml: false
  raw_entities: false
  top_level_nodes: false

local_search:
  # text_unit_prop: 0.5
  # community_prop: 0.1
  # conversation_history_max_turns: 5
  # top_k_mapped_entities: 10
  # top_k_relationships: 10
  # max_tokens: 12000

global_search:
  # max_tokens: 12000
  # data_max_tokens: 12000
  # map_max_tokens: 1000
  # reduce_max_tokens: 2000
  # concurrency: 32

Logs and screenshots
No response
Additional Information

GraphRAG Version: 0.1.1
Operating System: linux Ubuntu
Python Version: 3.12
Related Issues:

Using CLI command:
python -m graphrag.query --root ./ragtest --method global "Sample question"
works correctly.

Solved.
Changed the model type to:
api_type=OpenaiApiType.AzureOpenAI,

in my case, need to modify these parameter to work well. FYR

type: azure_openai_chat
api_base:   XXXX(yours)
api_version: 2024-02-15-preview
deployment_name:  XXXXXX(yours)


How to apply styles?

how can i apply styles? like change the Root node text size  etc?

You can create a theme and override the style manually with css https://nova.laravel.com/docs/2.0/customization/themes.html


Question

Please When Will These Finish

Unfortunately I'm not getting much time these days. Cannot say an exact timeline. Please ask only issues related to this project in issues category.

I will resume this work by next week. Planning to use NestJs for api's and same ReactJs, React Query, Material UI for frontend with latest version.


App not crashing on unhandled exception

@mbektchiev :
During the latest WebKit update we discovered that ffiClosureCallback
was crashing the application whenever a JS exception escaped it and
removed this behavior as undesirable.
However when the callback is made from the topmost JS frame we need
to crash since there's noone left to handle the exception. In order
to detect this situation we've enabled EXCEPTION_SCOPE_VERIFICATION
in JavaScriptCore in release builds (it was enabled only in debug by
default).
Now whenever we catch an exception we're checking whether we're at the top
before deciding whether to crash or leave it for handling in JS. The scope
is considered to be top level when the exception scope's recursion count
is either 0 or equal to the one set in UIApplicationMain(); or when
UIApplicationMain() is at the top of the callframe stack.

Fixed by #951


Readme updates

Adding additional setup info to the README based on my experience setting up the app. Updating Node version in the top-level package.json to reflect the actual requirement (navigator does not work below Node v21.0.0).

looks great! thanks for taking the tome to test and document your experience!


[Enhancement] support to read compressed text file in backend

What type of PR is this：

[ ] BugFix
[ ] Feature
[X] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Which issues of this PR fixes ：

Fixes #
Problem Summary(Required) ：

In This PR:

CompressedSeekableInputStream is added to wrap CompressedInputStream for RandomAccessFile (by disabling seek / get_size APIs)
guess compressed type by looking at file extension ("gz" -> gzip, "lzo" -> LZO etc)
Only handle the scan range whose offset is 0. Since we can not tell real streamed size in advance, we set file_size a very large value.

Checklist:

[ ] I have added test cases for my bug fix or my new feature
[ ] I have added user document for my new feature or new function

run starrocks_fe_unittest

run starrocks_admit_test

run starrocks_fe_unittest

run starrocks_fe_unittest

[FE PR Coverage Check]
:heart_eyes: pass : 0 / 0 (0%)

@MergifyIO backport branch-2.4


reCaptcha

is reCaptcha possible to be implemented? thank you! :)

In public mode? I guess it could see use, but until registration exists it doesn't make a ton of sense to implement.

The configuration of my lounge is on public. And i dont want to make it private coz it is being associated to my site. But a lot of ip's are scanning my lounge, just connect and quit (spamming my irc room with joins and quits). So I wish to put recaptcha on it.

If you hop on IRC I can walk you through setting
It up

I'm there. Thanks a lot.

Implementing this for private servers would probably be nice too, I don't think there's anything against bruteforce attacks right now?

On a private instance, I think this should only be present in an account creation page (like #914 attempt) and not at every login.

@aspic Every login seems overkill, but maybe after three failed attempts?

CAPTCHA protection that kicks in after n failed login attempts would be good. A number of other services do it, including big players like Google.

So, all the time on public instance, after 3 failed logins on private instance, and whenever someone works on #914 / #641 again, there as well. This does not warrant yet another option IMO, let's make this a reasonable experience for the user, and have it where it should.
In my mind though, a captcha is so 2000s 😅 I know Google has the "I'm not a robot" thing. Is there a way we can do something that un-intrusive without requiring to use Google or another third-party?

In my mind though, a captcha is so 2000s :sweat_smile: I know Google has the "I'm not a robot" thing.

That is reCAPTCHA. They call it "the No CAPTCHA reCAPTCHA experience". I wasn't able to find anything offhand that would let The Lounge do it without a third-party dependency, though.

Sure but is there any other real way of defeating spam/bruteforce? 😕
I don't think showing one every time on a public instance is needed, but hey, guess it could be a config option.
There's https://github.com/DoubleSpout/ccap & https://github.com/lemonce/svg-captcha among the very few FOSS alternatives, but I personally don't really mind using a Google service in this case.

Sure but is there any other real way of defeating spam/bruteforce? 😕

Plenty, some are creative and not really preventing anything, some are very efficient but obstructive. You can see things like "Enter the result of 1 + 2" (or what I've seen very recently, 0.1 + 0.2 ahah), or "What day of the week is today", etc. but those get annoying.
Because of the essence of the project (i.e. we are not Google nor any other favorite target), we could do something as simple as radio buttons: "Are you a robot? ( ) Yes ( ) No" and 99.9% of the spam would be avoided.

This would make for a pleasant experience and I'd be surprised if you get any robot-generated spam with that. It would also avoid us to maintain an image generator, etc. so much easier for us. And finally, implementing it would be much easier, less edge cases, less accessibility/usability issues, etc. meaning it can end up in a release sooner :)

but hey, guess it could be a config option.

Ahahah, I knew this was coming :D
As usual, my motto is: if the UX is excellent, no need for an option. If the UX is atrocious, let's fix it instead. If we have to be anywhere in the middle, then let's consider an option :)

I personally don't really mind using a Google service in this case.

We will definitely not force our users/admins to tie their instance to a third-party, let alone to Google, especially after we just removed a privacy leak (https://github.com/thelounge/lounge/pull/1307) and working on notifications that don't require tying to Google (https://github.com/thelounge/lounge/pull/1124) :)
Hope you understand where we're coming from!

That is reCAPTCHA. They call it "the No CAPTCHA reCAPTCHA experience".

Ah, that's correct, I read this thread about adding a CAPTCHA thing in general, not specifically reCAPTCHA. Will rename the issue to make it clear we are not set on the details.

Hope you understand where we're coming from!
I absolutely understand the concern, I meant that as a "I personally don't mind but I know others do".

Because of the essence of the project (i.e. we are not Google nor any other favorite target), we could do something as simple as radio buttons: "Are you a robot? ( ) Yes ( ) No" and 99.9% of the spam would be avoided.
That would probably stop random crawlers, but not an attack directed at a specific instance, though. Maybe an IP-based rate-limit? Or maybe I'm just a bit too paranoid~

By the way, kudos for your concerns about UX, The Lounge definitely feels polished. :)


As a user I want to have Material origin so that I will know where content comes from

As a user I want to have Material origin so that I will know where content comes from
Every Material obligatory has one of three origins (Джерело):

"Думка експерта"
"Медитека"
"Переклад"

By default Material has origin "Думка експерта", user cannot change the field and don`t see it during creating the Material.
If user has Admin role on the Creating Page (#122, #123, #124) he sees drop-down list of origins and can change origin.
If Admin chooses origin "Переклад" it displays fields to enter data of foreign author, who does not have profile at the app.
Fields are:

Author`s name
Authors details

Acceptance Criteria

the material obligatory has one of three origins

BA check 18/07/21
Accepted.

BA check 20/07/21
Not accepted.
By default Material has origin "Думка експерта", user see it during creating the Material and can change that origin though change still has to be approved by admin.


⚠ Doshipui has degraded performance

In 7cf54a9, Doshipui (https://дошипуй.рф/) experienced degraded performance:

HTTP code: 200
Response time: 5404 ms

Resolved: Doshipui performance has improved in 838f22a after 9 minutes.


fix(RHINENG-7780): Change alert title and text in SystemsSelect

Fixes https://issues.redhat.com/browse/RHINENG-7780.
This adds an extra title to all tasks alerts that notify about the systems eligible for a specific task according to mocks.

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 81.09%.  Consider uploading reports for the commit d23f69b to get more accurate results

Additional details and impacted files
@@           Coverage Diff           @@
##           master     #156   +/-   ##
=======================================
  Coverage   81.09%   81.09%
=======================================
  Files          69       69
  Lines        1486     1486
  Branches      470      470
=======================================
  Hits         1205     1205
  Misses        246      246
  Partials       35       35

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Create a script to consistently format patch files

Based on feedback from distributors, we should automate creating consistent patch files when sending embargoed patches to distributors-announce@

The patches should be a single commit (where possible)
The patches should have any revision added to the file name (e.g. if we need to send out an updated patch, it should have a different filename than the original)
The patches should be in a .zip file when sent via email
The metadata at the top of the .patch file should look like:

From: distributors-announce<EMAIL_ADDRESS>Date: Tue, 31 Oct 2023 18:23:55 +0000
Subject: Fix CVE-20XX-XXXX

---

/remove-lifecycle stale

/remove-lifecycle stale


Panic when using command line to open path that doesn't exist

This should probably simply open the editor. Perhaps it should also show a notification (not that we have a nice method notifications yet?) about the folder not existing.
(This should also be tested to see if it occurs if you open a nonexistent folder in the open folder dialog, but my file explorer updates quickly enough that I can't do that.)

This is fixed (I fixed it but I'll link general cli rewrite by dzhou because I'm too lazy to find my PR) #1003


Installing ThingsBoard on Kubernetes Request 404

After opening https://thingsboard.io/docs/user-guide/install/kubernetes/ a 404 response page appears

Hi, the site you are looking for is now under https://thingsboard.io/docs/user-guide/install/cluster/minikube-cluster-setup/ and https://thingsboard.io/docs/user-guide/install/cluster/openshift-cluster-setup/, accessible. I don't think there are any broken links or such, if there are, please add where you found them!


Django security update

https://docs.djangoproject.com/en/1.11/releases/1.11.5/

Thanks @cuducos!
What I did to test this PR:
1 - Cloned the project
$ git clone git@github.com:datasciencebr/jarbas.git

2 - Checked out to @cuducos branch
$ git checkout -b cuducos-django-security-update origin/cuducos-django-security-update

3 - Run the environment
$ make run.devel

4 - Access localhost:8000 on browser and test some features.
The result:

LGTM ;)


IsAuthorized DB design (Part 2)

Created by: @pepe-zamarripa Jun 21 2022 at 15:27 CET
Last updated: Jul 19 2022 at 15:06 CET
ClickUp ID: IK-3429
Given
A subject is asking for access to a resource
When
IsAuthorized(subject, resource, access) is called
Then
DB should run a cypher, which returns with an appropriate response.
Oslo Discussion Points:
SVO Triples:
We started to discuss the problem from the SVO classic triple (Subject-Verb-Object) perspective; each of these three entities might be itself a triple, group or subgraph. A Policy ties these up together.
Aggregation/Grouping:
A consequence of this complexity is aggregation (or grouping) of identities into roles, actions into permissions, resources into assets.  We need a way to capture those, when querying the graph, without knowing their definition a-priori (customer-defined).
KGraph Schema:
The KG schema (Schema) has been said to solve policy semantic constraints, but that is not totally true as argued later with Blueprints.
The 3 Models:
Permission node and Action link
Just Action link
No Permission-Action policy explicitly stored in db (Permission-Less Model) (based on customer schema)
This last one is our best candidate, because it decouples policies from the KG data the policies apply to:
the schema drives part of the authorization semantics ➝ The authorization problem becomes a reachability problem at schema level
there must be no modification to the graph itself (due to conflicts) ➝ consider projections (GDS) in the future?
we do not implement negative policies, so just positive ones (modelling what User is allowed, not denied to) ➝ for example the subject is a kid in Rema, the resources the 18+ items in the supermarket. Instead of having a policy that says "DT with age<18 cannot access", we would have "DT with age>=18 can access".
cypher generation from graph schema+policy
natural customer interaction with data model, minimal concept translation (visual, nl), to be used for generating the correct cyphers ➝ this maybe could be solved with policy flows (see below)
OPA and Zanzibar (part1):
Zanzibar:

specific indexes for nested triples
user-sets,
zookies,
distributed and highly available
OPA:
set operators,
composition,
...
What we take from these:
being highly available and optimized for performance by design
specific indexes and abstraction of structures, be it in the KG or in the policy data management.
Where is the policy defined?
Partly in the KG schema ➝ conflicts and sync bw policies and schema: schema cannot be changed for policies
partly in the policy data (for now we consider the params listed below as predicates for the policy language).
The returned resources are thus the result of a mix of a graph reachability problem and resource subgraph search.
Problems:
Using the KG schema as it is for authorization ground truth will inevitably lead to conflicts: it embeds business data semantics but lacks policy data semantics. We cannot enforce the two to be coincident in defining policies. Thus this is not just a problem of reachability in the KG.
Need of properly separating two overlapping resource sets being used by two policies. There are situations in which the customer would not define this separation in the KG simply because it does not convey the meaning from business side, it would just in the permission sense. But there would be an abstraction of it that would have also authorization value.
The policy needs an abstraction as well; to not fall back to PBAC, policies should be flexible enough.

Possible Implementation
We try to get to the solution of this by building it up from the other end: the object or the resource set. This has also been the approach taken for Zanzibar, but in our case authorization is at another level and cannot be solved with their tool alone.
There are two sub-problems: resource set search and graph reachability dt➝ resources
resource set search: find the set of resources involved in the policy
graph reachability: we can use directionality from DT to the boundary of the resource set
As said, the KG schema as-is cannot fit the policy semantics. An edited version of it is needed that would give more flexibility to the policy definition. Let's call it a Blueprint, such that we have:
Schema: KG schema, is the business data schema
Blueprint: modified version of the KG schema to fit policy semantics
This does not mean managing many blueprints. We can apply some reasonable generic edits to fit all policies, but then we need to know how to define these policies.
We also have to be able to handle and possibly resolve the most scenarios without the customer intervention, plus to prove the maintenance is at least as precise as having a KG model that has permission/policy data embedded in the graph.
There are three possible macro changes during a business operation:
schema change
policy change
resource set change
Since these will interfere with each other, let's consider the resource set change as the driver of the changes.
3. RS change:
affect schema change (nodes/rels

affect policy change ➝
no policy change ➝
no schema change (nodes/rels added to RS, already existing in the schema) [rel directionality matters for RS too?]toedit
with policy change ➝  another label used to define subgroup toedit
without policy change ➝ for example another label is used to define a subgroup of an already existing label, this is recognized and the policy is not touched?don't think we need to automatically do this.

Policy Definition
Subject: set of DTs (we now assume one DT to validate access request)
Verb: It is now assumed a unique verb, HAS_ACCESS, not in the KG nor the Policy data; we can assume it will be in the latter.
Policy: wires S,V and O up together, relegating the Verb function to indicate the properties of the action, while giving policies the structured key to link S and O in the KG. In FXC there are specific relationships (CEO, Owner) defining role/function of DT over a starting resource (Company, Shares).
Object: set of Resources, with a dynamic configuration.
Blueprint: undirected to abstract the reachability problem from KG semantics; handling multi/sublabels not captured by the schema; optionally identify (and extend with depth/sequence?) self-loops and/or loops in general, plus sequences of nodes/rels/subgraphs TOEDIT is this valuable for policy semantics actually?
FXC KG:
FXC mock small graph with 4 DTS, of which 2 are CEOs of Companies and all are Owners of Shares. 1 DT is double Owner.
The KG schema (or Schema), in this case equivalent to the Policy schema(Blueprint). For the latter, the graph should be considered undirected for the resource subgraph (Shares and Company with interconnections):
We extend slightly the schema to include Companies owning other Companies:
new schema:
Schema Change:
added self-loop in Company ➝ potentially infinite chains of Companies, which policy needs a depth range and which not?
DT-Resources path
Resource Set Change
Policies:
CEO of X access [X, stocks/companies of X].
Owner of stock of X access [X, owned stock]
Simple test cypher:
We just solve the reachability DT-(resources) and give back the connected ones. Policies are here cyphers, can see an example with FXC use case.
If this all boiled down to a reachability problem (it does not), then the cypher would be:
:params
{
dt_id:'002',
resources:['ext_01','ext_02','ext_03','ext_04', 'ext_21', 'ext_31', 'ext_41', 'ext_d11', 'ext_d21'],
action:'CEO',
start_node_label:'Company',
actions:['CEO']
}
MATCH (dt:DigitalTwin{id: $ dt_id})-[r]->(sn)
WHERE TYPE(r)= $ action AND  $ start_node_label IN LABELS(sn)
WITH sn
UNWIND  $ resources AS resource
MATCH(sn)-[*]-(res)
WHERE res.externalId=resource
WITH DISTINCT res.externalId AS resource_id
RETURN resource_id
the first three lines define the cypher "role" in the policy (DT is CEO of Company), the resources returned are ALL those reachable by the DT (via the Company). Those are all the connected nodes to the starting one, if the two starting nodes of two different policies are connected, then those two policies will always found the same set of nodes, even if their intent is pretty different (CEO vs Owner).
Cypher+APOC test cypher:
So to solve the policies above we might add the use of apoc.subgraph:
CEO of X access [X, stocks/companies of X].
:params {
init_cypher:{
dt_id:'002',
action:'CEO',
start_node_label:'Company'
},
subgraph:{
relationshipFilter: 'OF',
labelFilter:'+Shares|+Company',
bfs:true,
filterStartNode:true,
},
resources:['ext_01','ext_02','ext_03','ext_04', 'ext_21', 'ext_31', 'ext_41', 'ext_d11', 'ext_d21']
}
These are the correct entities to show. W has id='ext_01'.
Owner of stock of X access [company X, owned stock]
:params {
init_cypher:{
dt_id:'002',
action:'OWNER',
start_node_label:'Shares'
},
subgraph:{
relationshipFilter: 'OF',
labelFilter:'+Company',
bfs:true,
filterStartNode:true,
},
resources:['ext_01','ext_02','ext_03','ext_04', 'ext_21', 'ext_31', 'ext_41', 'ext_d11', 'ext_d21']
}
These are the correct entities to show. ids here below.
[ext_d26, ext_06, ext_d21, ext_01]
If we then also compare the initial resource id list given and the resulting from the policy, we obtain this query, in which we return the intersection of the two lists:
MATCH (dt:DigitalTwin{id: $ init_cypher.dt_id})-[r]->(sn)
WHERE TYPE(r)= $ init_cypher.action AND  $ init_cypher.start_node_label IN LABELS(sn)
WITH sn
CALL apoc.path.subgraphAll(
sn,
{
relationshipFilter: $ subgraph.relationshipFilter,
labelFilter: $ subgraph.labelFilter,
bfs:true,
filterStartNode:false
})
YIELD nodes,relationships
WITH nodes,relationships
RETURN apoc.coll.intersection([n IN nodes WHERE n.externalId IS NOT NULL],  $ resources) AS allowed

//NOTES
//listcompr RETURN [x IN range(0,10) WHERE x % 2 = 0 ] AS result
// pattcompr RETURN [(a)-->(b:Movie) WHERE b.title CONTAINS 'Matrix' | b.released] AS years
// WITH [(a)-->(b:Movie) | b.released] AS years
//UNWIND years AS year
//WITH year ORDER BY year
//RETURN COLLECT(year) AS sorted_years
//MATCH(sn)-[*]-(res)
//WHERE res.externalId=resource AND  $ res_label IN LABELS(res)
//WITH DISTINCT res.externalId AS resource_id
//RETURN resource_id
Next with this approach:
test RS and Schema changes ➝ the first ones we have to handle and report, the second to halt and report
different actions and resource node properties
by MB, represent:
define action based on many relationships?
eg:
(:Subject)-[one or many]-(one or many)-[action]-(:Resource)
(:Subject)-[action1]-(one or many)-[action2]-(:Resource)
(:Subject)-(one or many nodes with many relationships action)-(:Resource)
Big Filter Cypher:
If the above does not work, a big cypher with subqueries handling different filters (tools) may be used to define the paths between DT and Resources. Have a draft containing pieces of it below (Query), but the logic would have been hard to implement without issues, plus constrained to what a single cypher could do.
One built up from a sequence of smaller ones, connected by an operator, would give a way higher configurability, especially if could be visual. While this last idea is the basis for Policy Flows, let's look at how the big filter cypher would look like:
Query Params: toedit
Subgraph parameters (a bunch, see the cypher)
Degree (degreeFilter: tot/in/out; entityFilter: node_id, label, rel_id, rel_type)
Asymmetric/Symmetric Reachability (directed vs undirected for all or specific relTypes)
others to implement
:params{
"cypher": {
"regex" : ".h.",
"cypher2" : "toedit"
},
"subgraph": {
"startNode": (|Node|list),
"maxLevel",
relationshipFilter,
labelFilter,
bfs:true,
filterStartNode:false,
limit:-1,
endNodes:[],
terminatorNodes:[],
sequence,
beginSequenceAtStart:true
},
"degree": {
"mode" : ("in"/"out"/"tot")*, //*min, max, pos, neg
"maxLevel",
"relationshipFilter",
labelFilter,
bfs:true,
Query: toedit
//apoc subgraph
CALL apoc.path.subgraphAll(
startNode |Node|list,
{
maxLevel: $ subgraph.maxLevel,
relationshipFilter: $ subgraph.relationshipFilter,
labelFilter: $ subgraph.labelFilter,
bfs: $ subgraph.bfs,
filterStartNode: $ subgraph.filterStartNode,
limit: $ subgraph.limit,
endNodes: $ subgraph.endNodes,
terminatorNodes: $ subgraph.terminatorNodes,
sequence: $ subgraph.sequence,
beginSequenceAtStart: $ subgraph.beginSequenceAtStart
}
) yield nodes, relationships
//degree
MATCH (n)
WHERE  $ degLabel IN LABELS(n)
RETURN apoc.node.degree(n, "FOLLOWS>") AS output;
//Subqueries
CALL {
apoc.node.degree.in(node, relationshipName)
apoc.node.degree.out(node, relationshipName)
//degreeCF
WITH nodes,relationships
UNWIND nodes AS n
WITH nodes,relationships,n
MATCH (n: {name: "Michael"})
WHERE  $ degLabel IN LABELS(n) AND
RETURN apoc.node.degree(p, "FOLLOWS>") AS output;
WHERE degree(n)<=> $ degree
UNION
MATCH (p:Person)
RETURN p
ORDER BY p.age DESC
LIMIT 1
}
RETURN p.name, p.age
ORDER BY p.name
//relTypeCF
WITH nodes,relationships
UNWIND nodes AS n
WITH nodes,relationships,n
MATCH(n)-[r]-[m]
//nodeLabelCF
WITH nodes,relationships
UNWIND nodes AS n
WITH nodes,relationships,n
WHERE  $ label1 IN LABELS(n)
RETURN
Policy Flows:
This allows for policies to be defined in a configurable way that we already have implemented code-wise for authflows. Also, we should be able to reduce the overlapping resource set definition since we set some schema constraints and the visual process can prevent bad policies to be defined. Still part of the problem remains, as well as TOEDIT
Each flow block contains:
blueprint: ref_schema ?if unique no need of having this TOEDIT
op: apoc_subgraph(params),
conditions: [conds]
Flow Operations
Sets operators: union, intersection, difference (no complementarity).
Block Operations
WHERE clause filter on nodes:
Params:
in_nodes: input nodes
regex:
list and pattern comprehension:
UNWIND  $ in_nodes AS n
MATCH(n)
WHEREdt
RETURN []
subgraph filter
CALL apoc.path.subgraphAll(
dt,
{
maxLevel: 1 // $ maxLevel,
relationshipFilter: $ relationshipFilter,
labelFilter: $ labelFilter
})
YIELD nodes,relationships
node degree
others
Conclusions
We are testing how a single cypher may behave in policy verification when the policy data is partially given by:
an edited schema of the KG, called Blueprint toedit;
policy params coming from policy data.
Also, the KG data may vary in such a way that the cypher does not capture anymore the correct resource set.
This lead us to think of the problem at least one in another, the inner being the Resource Set search within the KG, that is changing and for which we just assume to have the correct starting anchor (and node labels, rel types and optional depth range, plus some other to implement, but might not capture the RS change).
The first subtask to solve correctly is then the RS change, then we can think about the schema change (started addressing it with the Blueprint).
Next
In a subsequent task this can continue by:
expanding the FXC KG Schema, Data and Policies to highlight fails in the current policy verification query
look at solution
implement in FXC KG
build up starting REMA KG to start verifying policies and query in other KG domain
try the big filter cypher approach if the subgraph based query fails
maybe implement a solution mimicking policy flows if also a big filter cypher fails in the latest tests, considering now a fixed flow represented by a unique cypher with subqueries? It would be like a specific big filter cypher, with an engineered flow of subqueries. The real policy flow would be drawn and edited by the customer so it could change and it does change from policy to policy obviously. What cons does it bring along with the pros?
wiki this (and collaterals) back
Notes
From Conclusions and Next in the APOC cypher paragraph
update Miro back
Ontologies
Compliance: kgraph schema, is the business data schema; the blueprint is the policy data schema.
NOTE: eIDAS might become another compliance ontology sitting alongside the KG
GDS:
In general GDS pipelines which from an input graph project, transform and integrate data back into it, relaying the tasks logic to the pipelines.
entity resolution
signed graph projection for correlation clustering
weak and strong conn components
others using undirected projections
AI:
First approach (from ref1 and ref2):
ml models trained on a first period from the whole customer and then fine-tuned to data of an individual sub-space or individual users to understand the policy
the focus of the model shifts from fraud detection to identity/access assurance. In other  words, how confident can you be that a given user is who he or she  claims to be, based on past successful auths/authZs? This confidence  is gained by learning from data in users’ past interactions, such as:
Location/network
Time of day
Device fingerprint
Pattern of access
Keystroke dynamics
Much of this data is the same as what’s used to establish static  business context rules for access requests. The difference lies in how  the data is applied. Instead of declaring a network address “trusted,”  for example, the idea is to analyze user activity to determine if the  user has repeatedly provided a high level of authentication from a  particular IP address. That provides one data point to consider when  determining confidence in the user’s identity. Combine it with other  data points, creating confidence across multiple attributes, and you can  make an informed determination about whether more authentication is  needed.
Second approach (from ref3):
identity access to authorized resources may be seen of a very strict case of Recommendation  No, seriously!
Third approach (from ref1 and ref2):
all the authorization entities are topologically expanded with their function(s) and attributes embedded in the topology. ID triangles for example can be expanded and used as private key of a scheme similar to functional cryptography.
Katana might be tested to recognize the entities and also correlate them univocally (explain katana flow)

Commented by: @indyboox Jul 01 2022 at 11:05 CET
@pepe-zamarripa @bayegan I would like to continue this by:

expanding the FXC KG Schema, Data and Policies to highlight fails in the current policy verification query
look at solution
implement in FXC KG
build up starting REMA KG to start verifying policies and query in other KG domain
maybe implement a solution mimicking policy flows

I would propose to then open a Part3, addressing these. Thank you!


problems with redirect in safari

I have a strage problem on Safari where fetch follows the first redirect, but not the second one (see wireshark log below). On chrome and firefox  (native fetch) this works as expected.
The simplified flow is:
-> POST on /login
<- 302 found redirect to /
-> OPTIONS
<- 204
-> GET /
-> 302 found redirect to /build/allinOne/lims/lims.html

- fetch ends with error: TypeError: Network request failed

on chrome and ff instead of the error fetch issues a
GET  /build/allinOne/lims/lims.html

from where on everything succeeds
The fetch call is:
fetch(getLimsLogin(), {
            method: 'post',
            body: formData,
            credentials: 'include',
            redirect:'follow',
            follow:20
        })

Any Idea what can be wrong?
Thanks Ognian
POST /login HTTP/1.1
Host: localhost:3000
Content-Type: multipart/form-data; boundary=----WebKitFormBoundaryuZkJrVCuSqoVuZhK
Origin: http://localhost:3100
Cookie: __utma=111872281.885784303.1429298870.1429298870.1429298870.1; connect.sid=s%3AT-1T4jDYXaItMZ91_Lw1bjnhIoxlKb-e.Dweqx3eWKgx%2BxWNfCHkTRi5axLKsWy8R5T5AdZaDXo0
Content-Length: 240
Connection: keep-alive
Accept: */*
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.7 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.7
Referer: http://localhost:3100/index.html
Accept-Language: de-de
Accept-Encoding: gzip, deflate

------WebKitFormBoundaryuZkJrVCuSqoVuZhK
Content-Disposition: form-data; name="username"

ogi
------WebKitFormBoundaryuZkJrVCuSqoVuZhK
Content-Disposition: form-data; name="password"

ogi
------WebKitFormBoundaryuZkJrVCuSqoVuZhK--
HTTP/1.1 302 Found
Vary: X-HTTP-Method-Override, Origin, Accept
Access-Control-Allow-Origin: http://localhost:3100
Access-Control-Allow-Credentials: true
Location: /
Content-Type: text/plain; charset=utf-8
Content-Length: 23
Date: Sat, 28 Nov 2015 13:15:20 GMT
Connection: keep-alive

Found. Redirecting to /
OPTIONS / HTTP/1.1
Host: localhost:3000
Origin: http://localhost:3100
Access-Control-Request-Method: GET
Content-Length: 0
Access-Control-Request-Headers: accept-encoding, origin, accept-language
Connection: keep-alive
Accept: */*
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.7 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.7
Referer: http://localhost:3100/index.html
Accept-Language: de-de
Accept-Encoding: gzip, deflate

HTTP/1.1 204 No Content
Access-Control-Allow-Origin: http://localhost:3100
Vary: Origin
Access-Control-Allow-Credentials: true
Access-Control-Allow-Methods: GET,HEAD,PUT,PATCH,POST,DELETE
Access-Control-Allow-Headers: accept-encoding, origin, accept-language
set-cookie: connect.sid=s%3Al9Hrf_9RmZCW_Q7cMTw8gvWqSnR24sZr.pxwsLiQQ7UZpQTgZWt69Qyc6x1tKXRpeevwW4czwyhY; Path=/; Expires=Sat, 28 Nov 2015 13:45:20 GMT; HttpOnly
Date: Sat, 28 Nov 2015 13:15:20 GMT
Connection: keep-alive

GET / HTTP/1.1
Host: localhost:3000
Origin: http://localhost:3100
Cookie: __utma=111872281.885784303.1429298870.1429298870.1429298870.1; connect.sid=s%3AT-1T4jDYXaItMZ91_Lw1bjnhIoxlKb-e.Dweqx3eWKgx%2BxWNfCHkTRi5axLKsWy8R5T5AdZaDXo0
Connection: keep-alive
Accept: */*
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_1) AppleWebKit/601.2.7 (KHTML, like Gecko) Version/9.0.1 Safari/601.2.7
Accept-Language: de-de
Referer: http://localhost:3100/index.html
Accept-Encoding: gzip, deflate

HTTP/1.1 302 Found
Access-Control-Allow-Origin: http://localhost:3100
Vary: Origin, Accept
Access-Control-Allow-Credentials: true
Location: /build/allinOne/lims/lims.html
Content-Type: text/plain; charset=utf-8
Content-Length: 52
Date: Sat, 28 Nov 2015 13:15:20 GMT
Connection: keep-alive

Found. Redirecting to /build/allinOne/lims/lims.html

I debugged this further:
in fetch.js the xhr.send is called with the POST request.
Instead of returning by calling the xhr.onload function we get an
xhr.onerror called with: Error: InvalidStateError: DOM Exception 11
so it looks like all  "communication" is handled by xhr.send but this returns an error...
Any Ideas on this?
Thanks
Ognian

Just found this but there is no solution either.

Your problem smells like CORS problem but the data you shared with us indicates that all requests are to the same (original) host. Is that true?

Oh I just realized that it is a CORS problem: you have 2 domains (localhost:3000 and localhost:3100 communicating). Since the polyfill uses XMLHttpRequest in Safari, there's little we can do, since all CORS and redirection logic is handled by the browser within xhr.send().

Yes there are just different ports one is 3000 where the login is an the other 3100 from where the web app is served

Ok, I see, so this is indeed a Safari problem...
I will need a different login api.
Thanks
Ognian

I found this webkit issue : https://bugs.webkit.org/show_bug.cgi?id=57600.  It's marked fixed but I think this issue remains.


[#372] enable headless mode for tests in github-actions

Closes #372

Codecov Report

Merging #378 (3654c1d) into master (c7bc88d) will decrease coverage by 0.10%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master     #378      +/-   ##
==========================================
- Coverage   61.26%   61.16%   -0.11%
==========================================
  Files          35       35
  Lines        1877     1877
  Branches      115      115
==========================================
- Hits         1150     1148       -2
- Misses        698      700       +2
  Partials       29       29

Impacted Files
Coverage Δ

selene/support/shared/browser.py
61.32% <0.00%> (-1.89%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a448712...3654c1d. Read the comment docs.


Moving CSV::Row to their own file

Implements part of https://github.com/ruby/csv/issues/5
This does not change any behavior of the csv gem.

Done with the changes requested. Thanks, @kou !

Thanks!


onLayoutChange not triggered when number of items in grid changes

As the title suggests, it appears that onLayoutChange is not triggered when the number of items changes. This makes it challenging to determine the "derived layout" of that specific item.
Or, asked a different way, is there a way to determine the derived layout of an item dynamically added to the grid?

 It is a bug if onLayoutChange is not being fired.

I'm on 0.13.9 ... according to npm view thats the latest.

Could you reproduce this on http://www.webpackbin.com/VymTE3zWG?

Crap ... no, appreciate the webpack bin because that made me reexamine how we were checking for layout changes, and it was the implementation that was the problem. Sorry about that. :disappointed: . Closing.


Allow to update all semver.

Currently seasons-cli allows only updating patch version.
It should also allow to update minor and major version also.


Profiling Tools

Hi,
I'm relatively new to UWP development on Xbox One and I'm wondering what kind of performance profiling tools are available for this platform. Is there something similar to the ETW system present on desktop Windows 10?
Thanks

I'm afraid there's no much support for graphics profiling with UWP on Xbox directly. On PC you can make use of the "new pix" for DirectX 12 work, and the VSTS graphic profiler for DirectX 11 is an option on PC as well.
On UWP on Xbox, I believe you can use the Visual Studio CPU profiler, but not the graphics debugging.
For UWP on Xbox, really your best bet is to optimize it on PC as best you can. For games, the 'Game Mode' gives you a good amount of hardware on UWP on Xbox, and without it you need the app to be really light-weight.
https://walbourn.github.io/directx-and-uwp-on-xbox-one/


keep adding releases and changelogs

re-opening #3 -- no sign of current version 3.7.0 here, or its changelog anywhere.
is PIA really serious about publishing its apps as open source repositories?

no sign of version 3.7.4 or 3.8.0 either! @jaspws?

I'm also curious since there's nothing on the Releases nor any change log. I'm doubting as well whether PIA is really going open source with the apps.

no version 3.8.1, no version 3.8.2 -- PIA is not serious about open sourcing its application.
closing this issue out of disappointment. :-1:


community: AttributeError: module 'openai' has no attribute 'error' bug

Description: Solved following bug according to the openai>=1.0.0 - "AttributeError: module 'openai' has no attribute 'error'".
Issue: #17775
Dependencies: openai>=1.0.0
Twitter handle: https://twitter.com/2_nryn_4

can merge when unit tests pass

Hey @eyurtsev, I think Langchain is using openai = "^1.10.0", so this should work. All the tests have passed. Let me know if I am missing something. Thanks!


request: publish 1.0.0-alpha on npm

it would be nice to have a react-linkify@next version published on npm to test and use the new features implemented with 1.0.0-alpha

Published v1.0.0-alpha 🎉
https://www.npmjs.com/package/react-linkify/v/1.0.0-alpha


Cannot find content center site in my sharepoint admin center templates

[Enter feedback here]

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 03c7584f-82d8-8351-3634-a9f9eb06ab61
Version Independent ID: d2367a72-2839-782f-4ef8-f8cb058098cf
Content: Create a content center in Microsoft SharePoint Syntex
Content Source: microsoft-365/contentunderstanding/create-a-content-center.md
Product: microsoft-365-enterprise
GitHub Login: @efrene
Microsoft Alias: efrene

@efrene  Please add your comment and help us in resolving this issue. Thanks.

@efrene  Please add your comment and help us in resolving this issue. Thanks.

Sorry for the delay in replying back to you.  First, can I ask you if you are able to access your default content center site that was created during setup? You can find this by going to your Microsoft 365 Admin Center, selecting Setup, going to the Files and content section, and then selecting the Manage button in "Automate content understanding".

Sorry for the delay in replying back to you.  First, can I ask you if you are able to access your default content center site that was created during setup? You can find this by going to your Microsoft 365 Admin Center, selecting Setup, going to the Files and content section, and then selecting the Manage button in "Automate content understanding".

@jamilhaddadin

@jamilhaddadin

@jamilhaddadin - Just checking back with you on this. Are you still having issues with this?  If you are, please provide me more information on the issue.  Thanks

@jamilhaddadin - Just checking back with you on this. Are you still having issues with this?  If you are, please provide me more information on the issue.  Thanks

@jamilhaddadin - Have not heard back, so will close this assuming this is no longer an issue. Please let me know if this is not the case. Thanks.

@jamilhaddadin - Have not heard back, so will close this assuming this is no longer an issue. Please let me know if this is not the case. Thanks.


Relicense to another Open Source license

Can you license it under an Open Source license as Public-domain is not recognized in many countries outside the US, particularly in Europe.
Recommended licenses:

public-domain-equivalent licenses such as

BSD Zero Clause License
MIT No Attribution

MIT License

On Fri, Jun 04, 2021 at 03:34:28AM -0700, arnavyc wrote:

Can you re-license (or dual-license it) under any other Open Source license as Public-domain is not recognized in many countries outside the US, particularly in Europe.
Recommended licenses:

public-domain-equivalent licenses such as
BSD Zero Clause License
MIT No Attribution
MIT License

if you send a patch with MIT license I will merge it

See #2.


configurable database

add a configurable database property on redis cache that sets each new client connection to the db

It seems some of this got into the master branch, unfortunately in a broken state.
There's no DATABASE command in Redis, so setting the redis.database config key to a valid integer explodes during provider registration. Replacing the command with the correct SELECT is not enough either, as this has to be called per-client instead once for an otherwise quickly deallocated client.


A more detailed summary of performance runs available with 'get performance' command

changed scenario_performance_map to include multiple performance metrics from mlperf_log_summary.txt file
simplified scenario_performance_map (the beautify_summary function in code_axs already does all the formatting of units etc.. required)
added 99p latency: target latency ratio to 'get performance' summary for server runs

sorry @xihajun I accidentally removed saheli !!

yep I will remove those spaces and the unsightly colon after the validity!

The command ouput now looks like this: ['VALID', 'target_qps=152000', '99.00_percentile_latency=7.722 milliseconds', 'target_latency=15.000 milliseconds', 'latency_cutoff_ratio=0.51', 'Completed_samples_per_second=150593.59']


Fixed facebook api

Shares the embedded url in a recipe. Recipe itself is copied to clipboard for the User to paste in.

Pull Request Test Coverage Report for Build 164

2 of 23 (8.7%) changed or added relevant lines in 5 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage decreased (-0.4%) to 91.199%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

src/main/java/seedu/recipe/ui/util/FacebookHandler.java
0
2
0.0%

src/main/java/seedu/recipe/model/recipe/Recipe.java
0
3
0.0%

src/main/java/seedu/recipe/ui/RecipeListPanel.java
0
5
0.0%

src/main/java/seedu/recipe/ui/UiUtil.java
0
5
0.0%

src/main/java/seedu/recipe/ui/BrowserPanel.java
2
8
25.0%

Totals

Change from base Build 160:
-0.4%

Covered Lines:
1886

Relevant Lines:
2068

💛  - Coveralls